本期分享主題:From Spark Streaming to Structured Streaming
講師:敵琺@E-MapReduce
内容提綱
1. Spark Streaming
1.1 Overview
1.2 DStream Model
1.3 Failure Recovery
1.4 Consistency Semantics
1.5 DStream API
1.6 Evaluation
2. Google Dataow
2.1 Overview
2.2 Points
2.3 More
3. Structured Streaming
3.1 DStream Pains
3.2 Structured Streaming Overview
3.3 Program Model
3.4 Output Mode
3.5 API
3.6 Window with Event Time
3.7 EventTime Watermark
3.8 UDF Stateful Operator
3.9 Query Planning
3.10 Consistency Semantics
3.11 Continuous Processing
3.12 Evaluation
3.13 Operational Features
4. Reference
視訊位址:
https://yq.aliyun.com/live/689PPT位址:
https://yq.aliyun.com/download/3127