迁移指南：将RDBMS与Hadoop生态融合，重构关系应用到NoSQL

需积分: 9 128 浏览量更新于2024-07-20 收藏 12.21MB PDF 举报

"《Practical Hadoop Migration》是一本由Bhushan Lakhe撰写的实用指南，专注于帮助读者如何在Hadoop生态系统中整合关系型数据库管理系统（RDBMS）并重构关系应用到NoSQL架构。作者凭借其在大数据和数据仓库领域的深厚经验，特别是获得了IBM 2012年Gerstner奖，他详细阐述了这个转型过程中的关键步骤。该书首先探讨了决定将RDBMS与Hadoop（如HDFS）融合的最优策略，强调了重新设计应用以优化并发性、安全性、数据冗余和性能的重要性。接着，Lakhe指导读者如何选择ETL工具，以及如何使用SQOOP和Flume进行数据迁移，包括迁移实施步骤和技术优化技巧，如调整分区、计划聚合和重塑ETL流程。书中还深入分析了数据湖和Lambda架构作为整合解决方案的优缺点，并通过实际案例研究展示了它们的实现方法。尽管Hadoop/NoSQL环境本身可能缺乏某些关系型技术特性，如角色基础访问控制和并发更新锁定，Lakhe展示了如何利用开源工具在Hadoop组件中模拟这些功能。《Practical Hadoop Migration》对于那些正在寻求将现有的关系数据库迁移到分布式处理框架，或者希望通过NoSQL架构提高性能和扩展性的IT专业人员来说，是一份宝贵的参考资料。它不仅提供了理论指导，还提供了实践操作的实用建议，帮助读者顺利地完成从传统RDBMS到Hadoop生态系统的转变。"

Foreword

We are in the midst of one of the biggest transformations of Information Technology

(IT). Rapidly evolving business requirements have demanded agility in all aspects of IT.

As more and more paper-based business processes are getting digital, rapid application

development, staging, and deployment have become the norm. In addition, the data

exhaust from these digital applications has become enormous and needs to be analyzed

in real time. Growing volumes of historical data is considered valuable for improving

business efficiency and identifying future trends and disruptions. Ubiquitous end-user

connectivity, cost-efficient software and hardware sensors, and democratization of

content production have led to the deluge of data generated in enterprises. As a result,

the traditional data infrastructure has to be revamped. Of course, this cannot be done

overnight. To prepare your IT to meet the new requirements of the business, one has to

carefully plan re-architecting the data infrastructure so that existing business processes

remain available during this transition.

Hadoop and NoSQL platforms have emerged in the last decade to address the

business requirements of large web-scale companies. Capabilities of these platforms

are evolving rapidly, and, as a result, have created a lot of hype in the industry. However,

none of these platforms is a panacea for all the needs of a modern business. One needs

to carefully consider various business use cases and determine which platform is most

suitable for each specific use case. Introducing immature platforms for use cases that

are not suited for them is the leading cause of failure of data infrastructure projects. Data

architects of today need to understand a variety of data platforms, their design goals, their

current and future data protection capabilities, access methods, and performance sweet

spots, and how they compare in features against traditional data platforms. As a result,

traditional database administrators and business analysts are overwhelmed by the sheer

number of new technologies and the rapidly changing data landscape.

This book is written with those readers in mind. It cuts through the hype and gives

a practical way to transition to the modern data architectures. Although it may feel like

new technologies are emerging every day, the key to evaluating these technologies is to

align your current and future business use cases and requirements to the design-center

of these new technologies. This book helps readers understand various aspects of the

modern data platforms and helps navigate the emerging data architecture. I am confident

that it will help you avoid the complexity of implementing modern data architecture and

allow seamless transition for your business.

—Milind Bhandarkar, PhD

Founder and CEO, Ampool, Inc.

剩余320页未读，继续阅读

DWcsdnNET

粉丝: 415
资源: 651

迁移指南：将RDBMS与Hadoop生态融合，重构关系应用到NoSQL

hadoop命令hadoop classpath

hadoop3.1.4 hadoop-core

hadoop1.0和hadoop3.0

hadoop2.0和hadoop3.0

for host in hadoop101 hadoop102 hadoop103

hadoop 中hadoop-env.sh配置

hadoop1.0与hadoop2.0

原生Hadoop和采购hadoop

如何新创建Hadoop集群，三台服务器分别命名hadoop105、hadoop106、hadoop107。Namenode和JobHistory在hadoop105启动，yarn在hadoop106启动，2NN在hadoop107启动。

Hello Hadoop Goodbye Hadoop

最新资源