Apache Spark 3 – Real-time Stream Processing using Scala
Learn to create Real-time Stream Processing applications using Apache Spark
What you’ll learn
-
Real-time Stream Processing Concepts
-
Spark Structured Streaming APIs and Architecture
-
Working with File Streams
-
Working With Kafka Source and Integrating Spark with Kafka
-
State-less and State-full Streaming Transformations
-
Windowing Aggregates using Spark Stream
-
Watermarking and State Cleanup
-
Streaming Joins and Aggregation
-
Handling Memory Problems with Streaming Joins
-
Creating Arbitrary Streaming Sinks
Requirements
-
Spark Fundamentals and exposure to Spark Dataframe APIs
-
Kafka Fundamentals and working knowledge of Apache Kafka
-
Programming Knowledge Using Scala Programming Language
-
A Recent 64-bit Windows/Mac/Linux Machine with 8 GB RAM
Who this course is for:
- Software Engineers and Architects who are willing to design and develop a Bigdata Engineering Projects using Apache Spark
- Programmers and developers who are aspiring to grow and learn Data Engineering using Apache Spark
