精通Hive：Hadoop数据仓库系统实战指南

4星 · 超过85%的资源需积分: 0 143 浏览量更新于2024-07-20 6 收藏 9.15MB PDF 举报

"Practical.Hive.A.Guide.to.Hadoops.Data.Warehouse.System.1484202724" 是一本关于Hadoop数据仓库系统Hive的实践指南，由Scott Shaw、Ankur Gupta、David Kjerrumgaard和Andreas Francois Vermeulen合著。本书深入介绍了如何使用HiveQL，这是Hive特有的SQL样式的语言，用于在Hadoop环境中分析、导出和处理数据。内容涵盖从部署Hive到与Hadoop、MapReduce、Tez等大数据技术的交互，以及性能调优和利用半结构化和非结构化数据。读者将学习到： 1. 安装和配置Hive以处理新旧数据集。 2. 执行数据定义语言(DDL)操作，如创建和管理表。 3. 实现高效的数据操纵语言(DML)操作，如查询和更新数据。 4. 使用表格、分区、桶和用户自定义函数来优化数据处理。 5. 探索Hive性能调优技巧和最佳实践。 6. 学习如何处理半结构化数据，并进行数据分析。 7. 理解Hive的安全性设置和未来发展趋势。本书适合于处理大量数据的开发者、企业和专业人士，假设读者已经具备SQL基础。目录包括： 1. 第一章：Hadoop与Hive的预备知识 2. 第二章：Hive简介 3. 第三章：Hive架构 4. 第四章：Hive表格DDL 5. 第五章：数据操纵语言(DML) 6. 第六章：加载数据到Hive 7. 第七章：查询半结构化数据 8. 第八章：Hive分析 9. 第九章：Hive性能调优 10. 第十章：Hive安全 11. 第十一章：Hive的未来 12. 附录A：构建大数据团队 13. 附录B：Hive函数这本书不仅提供了Hive的基础知识，还深入到高级主题，如性能优化和安全，对于希望在Hadoop生态系统中利用Hive进行大数据分析的读者来说，是一份宝贵的资源。

About the Authors

Scott Shaw has over 15 years of data management experience. He has

worked as an Oracle and SQL Server DBA. He has worked as a consultant

on Microsoft business intelligence projects utilizing Tabular and OLAP

models and co-authored two T-SQL books by Apress. Scott also enjoys

speaking across the country about distributed computing, Big Data

concepts, business intelligence, Hive, and the value of Hadoop. Scott

works as a Senior Solutions Engineer for Hortonworks and lives in Saint

Louis with his wife and two kids.

Andreas François Vermeulen is Consulting Manager of Business

Intelligence, Big Data, Data Science, and Computational Analytics at

Sopra-Steria, doctoral researcher at University of Dundee and St. Andrews

on future concepts in massive distributed computing, mechatronics, Big

Data, business intelligence, and deep learning. He owns and incubates the

“Rapid Information Factory” data processing framework. He is active in

developing next-generation processing frameworks and mechatronics

engineering with over 35 years of international experience in data

processing, software development, and system architecture. Andre is a

data scientist, doctoral trainer, corporate consultant, principal systems

architect, and speaker/author/columnist on data science, distributed

computing, Big Data, business intelligence, and deep learning. Andre

received his Bachelor’s degree at the North West University at Potchefstroom, his Master of Business

Administration at the University of Manchester, Master of Business Intelligence and Data Science at

University of Dundee, and Doctor of Philosophy at the University of Dundee and St. Andrews.

xix

Acknowledgments

Even before I joined Hortonworks I wanted to write a book on Hive. At the time there weren’t many and the

ones I saw where technically sound but not for the average users and especially not for someone coming

from the relational database world. Once I began working at Hortonworks I figured it would be easy to sit

down and write the book. I had all the best resources at my fingertips and access to some of the brightest

people I’ve ever met. I had Hive committers like Alan Gates who never hesitated to answer an e-mail

or spend a moment to talk to you at a conference. I had the friendship and support of the best Solution

Engineering team in the world. Yetalmost 2 and a half years later, there was still no book.

What I didn’t predict was the incredible pace of this market and the herculean time commitment all of

us on the team endure to provide solutions to our customers. It is truly a labor of love, but between work and

family, the book had to wait. It waited a long time. I think any other publisher would have kicked me out the

door and looked elsewhere, but Apress held steady (although I cannot honestly say they didn’t push back a

little and deservedly so) and trusted that someday we would have a book.

The struggle with writing a book on Hive is if you wait six months between writing then you’re writing

a new book. I came to terms that this was not the job of one person and I needed help. Ankur was one of the

first to step up. If not for Ankur’s perseverance and commitment, this book would not be in your hands right

now. It was also Ankur who put us in touch with Andre and, I’m certain Ankur would agree, without Andre’s

incredible writing output and knowledge, you would also not have a book in your hands or, at the very

least, it would be smaller and you would be much less informed. Finally, thank you to David, who has truly

provided the technical exclamation point on the book and was vital to rounding out the edges and moving

us forward.

There are countless other people who have helped in any way they could with little time they had.

Cindy Gross from the Microsoft CAT team was an early participant and helped to keep the project moving

forward. Thank you to Ancil for stepping up and helping with much needed technical reviews—especially

on my chapters. But most especially thank you to Hortonworks for not only supporting the book but being

downright excited about it. The greater Hortonworks team wasn’t excited about the book just because it is

a Hive book; they were excited for us, the team of authors, for our accomplishment. I never was forced to

choose between my work and the book; it was my choice to focus on work.

Finally, thank you to my family. My kids may never have a need for Hive but I know they think it’s pretty

cool that dad help write a book. It’s been a long journey from the days I was an English major to now being

a Solutions Engineer for an open source Big Data company writing technical books, but I really do still look

around me and count my blessings. I’ll say it again I work with some of the brightest people in the industry

and although I can’t hold a candle to their intelligence, I do know their collective knowledge and insight

makes me a better person.

—Scott Shaw

剩余281页未读，继续阅读

ramissue

粉丝: 354
资源: 1487

精通Hive：Hadoop数据仓库系统实战指南

"Hive实用指南：Hadoop数据仓库系统详解【英文云】

Hive 编程指南：大数据处理的强大工具

配置Spark3连接Hive1环境：解决metastore.jars问题

Loading data to table tbds.use FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. org.apache.hadoop.hive.ql.metadata.HiveException: Unable to move source file:/opt/software/UserInfor.txt to destination hdfs://hadoop1:9000/user/hive/warehouse/tbds.db/use

org.apache.hadoop.hive.ql.metadata.hiveexception: java.lang.runtimeexception: unable to instantiate org.apache.hadoop.hive.ql.metadata.sessionhivemetastoreclient

FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient

最新资源