7.SparkStreaming（上）--SparkStreaming原理介绍.pdf_hadoop读写流程

需积分: 24 259 浏览量更新于2023-05-27 评论 1 收藏 989KB PDF 举报

身份认证购VIP最低享 7 折!

领优惠券(最高得80元）

资源详情

资源评论

资源推荐

第 1 页共 19 页出自石山园，博客地址：http://www.cnblogs.com/shishanyuan

Spark Streaming 原理介绍

第 2 页共 19 页出自石山园，博客地址：http://www.cnblogs.com/shishanyuan

1 SPARK STREAMING简介 ...................................................................................................................................... 3

1.1 概述 ..................................................................................................................................................................... 3

1.2 术语定义 ............................................................................................................................................................. 3

1.3 S

TORM与SPARK STREMING比较 ......................................................................................................................... 4

运行原理 ..................................................................................................................................................................... 5

2.1 S

TREAMING架构 .................................................................................................................................................. 5

2.2 编程模型 ............................................................................................................................................................. 7

2.2.1

如何使用

Spark Streaming ................................................................................................................................ 8

2.2.2 DStream

的输入源

............................................................................................................................................ 9

2.2.3 DStream

的操作

.............................................................................................................................................. 11

2.3 容错、持久化和性能调优 ............................................................................................................................... 16

2.3.1

容错

................................................................................................................................................................ 16

2.3.2

持久化

............................................................................................................................................................ 18

2.3.3

性能调优

........................................................................................................................................................ 18