# Spark Batch Processing - Comparing with Hive and MapReduce, Key Components, and Performance Optimization (Day 1 Lecture)

> In this lecture, the instructor explores Apache Spark's advantages for data processing and analysis, comparing it with technologies like Hive and MapReduce. The lecture covers Spark's handling of various data sources, its key components (driver and executor), memory management, and performance opti…

- Web page: https://julie.techexpert.io/lesson/spark-batch-day-1-lecture-v2
- Program: [Data Engineering Boot Camp V2 Combined Track](https://julie.techexpert.io/program/data-engineering-boot-camp-v2-combined-track)
- Module: Week 4: Batch Pipelines with Apache Spark V2
- Access: Requires enrollment in Data Engineering Boot Camp V2 Combined Track
- Length: 1 h 13 min video
- Skills: Apache Spark
- Academy: Julies academy to catch all other programs

## About this lesson

In this lecture, the instructor explores Apache Spark's advantages for data processing and analysis, comparing it with technologies like Hive and MapReduce. The lecture covers Spark's handling of various data sources, its key components (driver and executor), memory management, and performance optimization techniques, such as minimizing shuffle and skew.

## Navigation

- Previous lesson: [Flink Streaming - Setting Up Streaming Pipelines and Integrating Kafka with Postgres (Day 1 Lab)](https://julie.techexpert.io/lesson/infra-flink-streaming-day-1-lab-v2.md)
- Next lesson: [Applying Advanced SQL for Analytical Insights - Repeatable Analyses and State Change Tracking (Day 1 Lecture)](https://julie.techexpert.io/lesson/analytical-patterns-day-1-lecture-v2.md)