Apache Spark Performance Tuning

Master Spark Performance Tuning on Databricks Cloud

What you'll learn

This is the most comprehensive course ever created for performance tuning Apache Spark on Databricks Cloud. This course will teach you a holistic approach of performance tuning and take you deep into instrumenting, monitoring, diagnosing, pinpointing, and identifying the root cause of the performance problems. Then, it will take you to the approaches for solving, implementing, measuring, and benchmarking the performance tuning solutions.

This is a dual language course. Every scenario and solution are created in Python and Scala languages. The course applies to Spark SQL, PySpark and Scala projects.

The course will simulate and generate various performance problems using large volumes of data at the magnitude of GBs and help you gain knowledge to solve real-life problems.

Performance debugging, benchmarking, analyzing and pinpointing the root cause

Tuning data storage, read operation, partition size, small files, caching, indexing, disk partitioning and pruning

Tuning Data Spill, Data Skew, Data Shuffle, Joins, Wide transformations, UDF and Serialization problems

Fine tune AQE, Data skipping, Dynamic Pruning, Auto Optimize small file, Cleaning stale data

Cluster Selection, VM Selection, Photon Engine, Estimating CPU, Memory, Worker Nodes and Monitoring Utilization

Course Prerequisite

What do you need to know before you start this course

You must already know Spark programming in Python or Scala language

You must be already familiar with Apache Spark Architecture and Internals

You also need to be familier with Databricks Cloud platform features and capabilities

Hear out instructor

Course Content

65 lectures - 25 hours video - revision document

Apache Spark Performance Tuning on Databricks Cloud

Course Features

65 Video Lectures

PDF & Source Code

Total Support

Features & Support

Total Support

We provide support throughout your learning and answer every question during business hours. For blocker issues, you can also request a one-to-one technical support call.

Certification Ready

Students who complete ScholarNest Academy courses earn free, verifiable course completion certificates to share with their friends, co-workers, and potential employers.

Capstone Project

The course includes lifetime access to any future updates, upgrades, revisions, modifications, or topics included in the same course at no additional cost.

Course FAQ

How long can I access the course material?

Do you have refund policy?

How do you provide support?

Enroll into self-paced course

Discover your potential, start today and learn at your own schedule

Schedule a free call

Get in touch with your course coordinator to learn more about the course, instructor-led course options, discount offers, course bundles, and additional payment methods.

For Instructor-led training

Course Enquiry: Request callback

Looking for an Instructor-led course? We have Instructor-led batches starting every month. Fill out the course inquiry form, and we will contact you with more details.


Email: sushant@scholarnest.com

Contact us for current promotional offers, course bundles, and additional payment methods such as NEFT, Net Banking, UPI, etc.


WhatsApp: +91-93534 65988

Want to speak to your course coordinator? We are just a WhatsApp message away.