天天看點

Apache Spark 系列技術直播 - 從 Spark Streaming 到 Structured Streaming本期分享主題:From Spark Streaming to Structured Streaming

本期分享主題:From Spark Streaming to Structured Streaming

講師:敵琺@E-MapReduce

内容提綱

1. Spark Streaming

1.1 Overview

1.2 DStream Model

1.3 Failure Recovery

1.4 Consistency Semantics

1.5 DStream API

1.6 Evaluation

2. Google Dataow

2.1 Overview

2.2 Points

2.3 More

3. Structured Streaming

3.1 DStream Pains

3.2 Structured Streaming Overview

3.3 Program Model

3.4 Output Mode

3.5 API

3.6 Window with Event Time

3.7 EventTime Watermark

3.8 UDF Stateful Operator

3.9 Query Planning

3.10 Consistency Semantics

3.11 Continuous Processing

3.12 Evaluation

3.13 Operational Features

4. Reference

視訊位址:

https://yq.aliyun.com/live/689

PPT位址:

https://yq.aliyun.com/download/3127

繼續閱讀