Overview
-
Get up to speed with Spark, and discover how to leverage this powerful platform to efficiently and effectively work with big data.
Syllabus
-
Introduction
- Welcome
- What you should know before watching this course
- Using the exercise files
- Understanding Spark
- Origins of Spark
- Overview of Spark components
- Where Spark shines
- Overview of Databricks
- Introduction to notebooks and PySpark
- Understanding data interfaces
- Working with text files
- Loading CSV data into DataFrames
- Exploring data in DataFrames
- Saving your results
- Creating tables
- Querying data with Spark SQL
- Visualizing data in Databricks notebooks
- Introduction to machine learning with Spark
- Preparing data for machine learning
- Building a linear regression model
- Evaluating a linear regression model
- Visualizing a linear regression model
- Introduction to streaming analytics
- Streaming context setup
- Querying streaming data
- Setting up spark locally
- Connecting Jupyter notebooks to Spark
- Other connection options
- Next steps
