提升Hadoop 2.0技能：高级指南与下一代数据处理

hadoop

bigdata

需积分: 9 157 浏览量更新于2024-07-22 收藏 5.23MB PDF 举报

身份认证购VIP最低享 7 折!

30元优惠券

资源详情

资源推荐

Table of Contents

[ v ]

Developing YARN applications 162

Writing YARN clients 162

Writing the Application Master entity 169

Monitoring YARN 175

Job scheduling in YARN 181

CapacityScheduler 181

FairScheduler 184

YARN commands 188

User commands 188

Administration commands 189

Summary 190

Chapter 7: Storm on YARN – Low Latency

Processing in Hadoop 191

Batch processing versus streaming 192

Apache Storm 193

Architecture of an Apache Storm cluster 194

Computation and data modeling in Apache Storm 196

Use cases for Apache Storm 197

Developing with Apache Storm 198

Apache Storm 0.9.1 206

Storm on YARN 207

Installing Apache Storm-on-YARN 207

Prerequisites 207

Installation procedure 208

Summary 218

Chapter 8: Hadoop on the Cloud 219

Cloud computing characteristics 219

Hadoop on the cloud 221

Amazon Elastic MapReduce (EMR) 222

Provisioning a Hadoop cluster on EMR 223

Summary 237

Chapter 9: HDFS Replacements 239

HDFS – advantages and drawbacks 240

Amazon AWS S3 240

Hadoop support for S3 241

Implementing a lesystem in Hadoop 243

Implementing an S3 native lesystem in Hadoop 244

Summary 256

www.it-ebooks.info

Preface

We are in an age where data is the primary driver in decision-making. With storage

costs declining, network speeds increasing, and everything around us becoming

digital, we do not hesitate a bit to download, store, or share data with others around

us. About 20 years back, a camera was a device used to capture pictures on lm.

Every photograph had to be captured almost perfectly. The storage of lm negatives

was done carefully lest they get damaged. There was a higher cost associated with

taking prints of these photographs. The time taken between a picture click and to

view it was almost a day. This meant that less data was being captured as these

factors presented a cliff for people from recording each and every moment of their

life, unless it was very signicant.

However, with cameras becoming digital, this has changed. We do not hesitate to

click a photograph of almost anything anytime. We do not worry about storage

as our externals disks of a terabyte capacity always provide a reliable backup. We

seldom take our cameras anywhere as we have mobile devices that we can use to

take photographs. We have applications such as Instagram that can be used to add

effects to our pictures and share them. We gather opinions and information about the

pictures, and we click and base some of our decisions on them. We capture almost

every moment, of great signicance or not, and push it into our memory books. The

era of big data has arrived!

This era of Big Data has similar changes in businesses as well. Almost everything in a

business is logged. Every action taken by a user on the page of an e-commerce page is

recorded to improve quality of service and every item bought by the user are recorded

to cross-sell or up-sell other items. Businesses want to understand the DNA of their

customers and try to infer it by pinching out every possible data they can get about

these customers. Businesses are not worried about the format of the data. They are

ready to accept speech, images, natural language text, or structured data. These data

points are used to drive business decisions and personalize experiences for the user.

The more data, the higher the degree of personalization and better the experience for

the user.

www.it-ebooks.info

剩余373页未读，继续阅读

vanridin

粉丝: 108
资源: 1187

提升Hadoop 2.0技能：高级指南与下一代数据处理

英文原版 packt Mastering Hadoop

mastering elasticsearch[m]. 2nd edition. uk: packt publishing

mastering go 2 pdf

发那科mastering恢复

mastering docker 4 pdf

mastering apache pulsar pdf

mastering docker – second edition

mastering sfml game development pdf

mastering your phd 的pdf版

mastering_go_zh_cn-master

mastering go epub

mastering cmake中文版

mastering delphi

mastering freeswitch pdf

mastering regular expressions 3rd 中文版

mastering opencv with practical projects源码

mastering the freertos real time kernel中文

mastering stm32csdn

mastering ui development with unity

mastering vim pdf

最新资源