Overview
-
Learn how to build popular streaming design patterns efficiently with Apache Spark.
Syllabus
-
Introduction
- Streaming with Spark
- Prerequisites
- What is stream processing?
- Streaming opportunities and challenges
- Streaming with Apache Spark
- Spark Structured Streaming APIs and SQL
- Setting up the exercise files
- Setting up Kafka
- Setting up MariaDB and Redis
- Streaming analytics: Pattern
- Streaming analytics: Use case design
- Streaming analytics: Helper classes
- Streaming analytics: Pipeline implementation
- Streaming analytics: Results review
- Alerts and thresholds: Pattern
- Alerts and thresholds: Use case design
- Alerts and thresholds: Helper classes
- Alerts and thresholds: Pipeline implementation
- Alerts and thresholds: Review
- Leaderboards: Pattern
- Leaderboards: Use case design
- Leaderboards: Helper classes
- Leaderboards: Pipeline implementation
- Leaderboards: Review
- Real-time predictions: Pattern
- Real-time predictions: Use case design
- Real-time predictions: Helper classes
- Real-time predictions: Pipeline implementation
- Real-time predictions: Review
- Use case definition
- Design of the project
- Code walk-through
- Execute and analyze
- Next steps
