What you'll learn
This is the most comprehensive course ever created for performance tuning Apache Spark on Databricks Cloud. This course will teach you a holistic approach of performance tuning and take you deep into instrumenting, monitoring, diagnosing, pinpointing, and identifying the root cause of the performance problems. Then, it will take you to the approaches for solving, implementing, measuring, and benchmarking the performance tuning solutions.
This is a dual language course. Every scenario and solution are created in Python and Scala languages. The course applies to Spark SQL, PySpark and Scala projects.
The course will simulate and generate various performance problems using large volumes of data at the magnitude of GBs and help you gain knowledge to solve real-life problems.
Tuning data storage, read operation, partition size, small files, caching, indexing, disk partitioning and pruning
Tuning Data Spill, Data Skew, Data Shuffle, Joins, Wide transformations, UDF and Serialization problems
Fine tune AQE, Data skipping, Dynamic Pruning, Auto Optimize small file, Cleaning stale data
Cluster Selection, VM Selection, Photon Engine, Estimating CPU, Memory, Worker Nodes and Monitoring Utilization
Course Prerequisite
What do you need to know before you start this course
You must be already familiar with Apache Spark Architecture and Internals
You also need to be familier with Databricks Cloud platform features and capabilities
Hear out instructor
Course Content
65 lectures - 25 hours video - revision document
Course Features
65 Video Lectures
PDF & Source Code
Total Support
Features & Support
Total Support
We provide support throughout your learning and answer every question during business hours. For blocker issues, you can also request a one-to-one technical support call.
Certification Ready
Students who complete ScholarNest Academy courses earn free, verifiable course completion certificates to share with their friends, co-workers, and potential employers.
Capstone Project
The course includes lifetime access to any future updates, upgrades, revisions, modifications, or topics included in the same course at no additional cost.
Course FAQ
Enroll into self-paced course
Discover your potential, start today and learn at your own schedule
Schedule a free call
Get in touch with your course coordinator to learn more about the course, instructor-led course options, discount offers, course bundles, and additional payment methods.
For Instructor-led training
Course Enquiry: Request callback
Looking for an Instructor-led course? We have Instructor-led batches starting every month. Fill out the course inquiry form, and we will contact you with more details.
Email: [email protected]
Contact us for current promotional offers, course bundles, and additional payment methods such as NEFT, Net Banking, UPI, etc.
WhatsApp: +91-93534 65988
Want to speak to your course coordinator? We are just a WhatsApp message away.
