flink流式处理框架的架构与应用

R: 45

G: 245

B: 190

R: 0

G: 100

B: 90

R: 50

G: 210

B: 220

R: 10

G: 100

B: 130

R: 250

G: 200

B: 50

R: 200

G: 100

B: 20

R: 45

G: 140

B: 240

90% K 80% K 70% K 60% K 50% K 40% K 30% K 20% K 10% K 5% K

R: 45

G: 65

B: 110

2017/10/22

R: 45

G: 245

B: 190

R: 0

G: 100

B: 90

R: 50

G: 210

B: 220

R: 10

G: 100

B: 130

R: 250

G: 200

B: 50

R: 200

G: 100

B: 20

R: 45

G: 140

B: 240

90% K 80% K 70% K 60% K 50% K 40% K 30% K 20% K 10% K 5% K

2

R: 45

G: 65

B: 110

• Architecture

• TypeInformation & serialization

• Fault Tolerance

• Back pressure

• Window (Flink SQL)

• Asynchronous I/O

• Monitor

• In Practice

R: 45

G: 245

B: 190

R: 0

G: 100

B: 90

R: 50

G: 210

B: 220

R: 10

G: 100

B: 130

R: 250

G: 200

B: 50

R: 200

G: 100

B: 20

R: 45

G: 140

B: 240

90% K 80% K 70% K 60% K 50% K 40% K 30% K 20% K 10% K 5% K

R: 45

G: 65

B: 110

R: 45

G: 245

B: 190

R: 0

G: 100

B: 90

R: 50

G: 210

B: 220

R: 10

G: 100

B: 130

R: 250

G: 200

B: 50

R: 200

G: 100

B: 20

R: 45

G: 140

B: 240

90% K 80% K 70% K 60% K 50% K 40% K 30% K 20% K 10% K 5% K

4

R: 45

G: 65

B: 110

R: 45

G: 245

B: 190

R: 0

G: 100

B: 90

R: 50

G: 210

B: 220

R: 10

G: 100

B: 130

R: 250

G: 200

B: 50

R: 200

G: 100

B: 20

R: 45

G: 140

B: 240

90% K 80% K 70% K 60% K 50% K 40% K 30% K 20% K 10% K 5% K

5

R: 45

G: 65

B: 110

• Heron

• Spark Streaming