没有合适的资源?快使用搜索试试~ 我知道了~
首页Apache Impala官方文档详解
Apache Impala官方文档详解
需积分: 50 23 下载量 185 浏览量
更新于2024-07-17
收藏 8.45MB PDF 举报
"Apache Impala官方文档"
Apache Impala是Cloudera公司开发的一款开源、分布式SQL查询引擎,专为大规模数据处理设计。它允许用户在Hadoop生态系统内进行实时分析,无需将数据从HDFS或HBase等存储系统中提取到传统的关系型数据库管理系统(RDBMS)中。Impala与Hadoop紧密集成,可直接读取HDFS和HBase的数据,提供低延迟的查询性能,适合大规模数据分析场景。
官方文档详细介绍了Impala的架构、安装、配置、使用方法以及最佳实践。文档通常会包含以下几个部分:
1. **简介**:这部分会介绍Impala的基本概念,包括其设计目标、主要特性以及相对于其他大数据查询工具(如Hive)的优势。
2. **系统架构**:Impala采用MPP(大规模并行处理)架构,由控制节点(Catalog Server、State Store Server)、协调节点(Impalad)和工作节点(Data Node)组成。每个组件的职责和交互方式都会在此部分进行详解。
3. **安装与部署**:指导用户如何在Hadoop集群上安装和配置Impala,包括依赖项、配置参数和启动/停止服务的步骤。
4. **查询语法**:文档会详细介绍Impala支持的SQL语法,包括数据类型、表操作、查询语句、DML(数据操纵语言)如INSERT、UPDATE和DELETE,以及DDL(数据定义语言)如CREATE、ALTER和DROP。
5. **性能优化**:提供查询性能调优的建议,如元数据管理、分区策略、内存管理和并发控制等。
6. **安全性**:讲解如何利用Kerberos进行身份验证,以及如何设置访问控制,确保数据安全。
7. **集成与工具**:介绍如何与Hue、Hue编辑器、Tableau等工具集成,以及如何通过JDBC和ODBC接口与Impala通信。
8. **监控与诊断**:提供监控Impala性能和状态的方法,以及如何解决常见问题和错误。
9. **开发指南**:对于开发者,会有API和开发工具的使用说明,帮助他们构建基于Impala的应用。
10. **附录**:包括版本历史、许可证信息和其他技术细节。
Impala的官方文档还可能包含代码示例,这些示例通常遵循Apache License Version 2.0,用户可以在遵守相应条款的情况下使用。对于开发者和数据分析师来说,这份文档是理解并有效使用Impala的关键资源。
Incompatible Changes Introduced in Impala 2.0.0 / CDH 5.2.0.........................................................................................772
Incompatible Changes Introduced in Impala 1.4.4 / CDH 5.1.5.........................................................................................774
Incompatible Changes Introduced in Impala 1.4.3 / CDH 5.1.4.........................................................................................774
Incompatible Changes Introduced in Impala 1.4.2 / CDH 5.1.3.........................................................................................774
Incompatible Changes Introduced in Impala 1.4.1 / CDH 5.1.2.........................................................................................774
Incompatible Changes Introduced in Impala 1.4.0 / CDH 5.1.0.........................................................................................774
Incompatible Changes Introduced in Impala 1.3.3 / CDH 5.0.5.........................................................................................775
Incompatible Changes Introduced in Impala 1.3.2 / CDH 5.0.4.........................................................................................775
Incompatible Changes Introduced in Impala 1.3.1 / CDH 5.0.3.........................................................................................775
Incompatible Changes Introduced in Impala 1.3.0 / CDH 5.0.0.........................................................................................775
Incompatible Changes Introduced in Impala 1.2.4............................................................................................................776
Incompatible Changes Introduced in Impala 1.2.3............................................................................................................776
Incompatible Changes Introduced in Impala 1.2.2............................................................................................................776
Incompatible Changes Introduced in Impala 1.2.1............................................................................................................777
Incompatible Changes Introduced in Impala 1.2.0 (Beta)..................................................................................................777
Incompatible Changes Introduced in Impala 1.1.1............................................................................................................777
Incompatible Change Introduced in Impala 1.1.................................................................................................................778
Incompatible Changes Introduced in Impala 1.0...............................................................................................................778
Known Issues and Workarounds in Impala......................................................................................................778
Impala Known Issues: Startup............................................................................................................................................778
Impala Known Issues: Crashes and Hangs.........................................................................................................................779
Impala Known Issues: Performance...................................................................................................................................780
Impala Known Issues: Usability..........................................................................................................................................781
Impala Known Issues: JDBC and ODBC Drivers..................................................................................................................782
Impala Known Issues: Security...........................................................................................................................................782
Impala Known Issues: Resources........................................................................................................................................782
Impala Known Issues: Correctness.....................................................................................................................................786
Impala Known Issues: Metadata........................................................................................................................................791
Impala Known Issues: Interoperability...............................................................................................................................792
Impala Known Issues: Limitations......................................................................................................................................794
Impala Known Issues: Miscellaneous / Older Issues..........................................................................................................794
Fixed Issues in Apache Impala..........................................................................................................................795
Issues Fixed in Impala for CDH 5.14.0................................................................................................................................795
Issues Fixed in Impala for CDH 5.13.1................................................................................................................................800
Issues Fixed in Impala for CDH 5.13.0................................................................................................................................800
Issues Fixed in Impala for CDH 5.12.2................................................................................................................................804
Issues Fixed in Impala for CDH 5.12.1................................................................................................................................805
Issues Fixed in Impala for CDH 5.12.0................................................................................................................................805
Issues Fixed in Impala for CDH 5.11.2................................................................................................................................810
Issues Fixed in Impala for CDH 5.11.1................................................................................................................................811
Issues Fixed in Impala for CDH 5.11.0................................................................................................................................811
Issues Fixed in Impala for CDH 5.10.2................................................................................................................................812
Issues Fixed in Impala for CDH 5.10.1................................................................................................................................813
Issues Fixed in Impala for CDH 5.10.0................................................................................................................................813
Issues Fixed in Impala for CDH 5.9.3..................................................................................................................................820
Issues Fixed in Impala for CDH 5.9.2..................................................................................................................................820
Issues Fixed in Impala for CDH 5.9.1..................................................................................................................................821
Issues Fixed in Impala for CDH 5.9.0..................................................................................................................................822
Issues Fixed in Impala for CDH 5.8.5..................................................................................................................................824
Issues Fixed in Impala for CDH 5.8.4..................................................................................................................................826
Issues Fixed in Impala for CDH 5.8.3..................................................................................................................................826
Issues Fixed in Impala for CDH 5.8.2..................................................................................................................................826
Issues Fixed in Impala for CDH 5.8.0..................................................................................................................................827
Issues Fixed in Impala for CDH 5.7.6..................................................................................................................................828
Issues Fixed in Impala for CDH 5.7.5..................................................................................................................................829
Issues Fixed in Impala for CDH 5.7.4..................................................................................................................................829
Issues Fixed in Impala for CDH 5.7.2..................................................................................................................................830
Issues Fixed in Impala for CDH 5.7.1..................................................................................................................................830
Issues Fixed in Impala for CDH 5.7.0..................................................................................................................................830
Issues Fixed in Impala for CDH 5.6.1..................................................................................................................................833
Issues Fixed in Impala for CDH 5.6.0..................................................................................................................................834
Issues Fixed in Impala for CDH 5.5.6..................................................................................................................................834
Issues Fixed in Impala for CDH 5.5.4..................................................................................................................................834
Issues Fixed in Impala for CDH 5.5.2..................................................................................................................................836
Issues Fixed in Impala for CDH 5.5.1..................................................................................................................................838
Issues Fixed in Impala for CDH 5.5.0..................................................................................................................................838
Issues Fixed in Impala for CDH 5.4.10................................................................................................................................838
Issues Fixed in Impala for CDH 5.4.9..................................................................................................................................839
Issues Fixed in Impala for CDH 5.4.8..................................................................................................................................840
Issues Fixed in Impala for CDH 5.4.7..................................................................................................................................841
Issues Fixed in Impala for CDH 5.4.5..................................................................................................................................843
Issues Fixed in Impala for CDH 5.4.3..................................................................................................................................844
Issues Fixed in Impala for CDH 5.4.1..................................................................................................................................844
Issues Fixed in CDH 5.4 / Impala 2.2..................................................................................................................................844
Issues Fixed in Impala for CDH 5.3.10................................................................................................................................846
Issues Fixed in the 2.1.7 Release / CDH 5.3.9.....................................................................................................................846
Issues Fixed in the 2.1.6 Release / CDH 5.3.8.....................................................................................................................847
Issues Fixed in the 2.1.5 Release / CDH 5.3.6.....................................................................................................................848
Issues Fixed in the 2.1.4 Release / CDH 5.3.4.....................................................................................................................848
Issues Fixed in the 2.1.3 Release / CDH 5.3.3.....................................................................................................................849
Issues Fixed in the 2.1.2 Release / CDH 5.3.2.....................................................................................................................850
Issues Fixed in the 2.1.1 Release / CDH 5.3.1.....................................................................................................................850
Issues Fixed in the 2.1.0 Release / CDH 5.3.0.....................................................................................................................851
Issues Fixed in the 2.0.5 Release / CDH 5.2.6.....................................................................................................................851
Issues Fixed in the 2.0.4 Release / CDH 5.2.5.....................................................................................................................851
Issues Fixed in the 2.0.3 Release / CDH 5.2.4.....................................................................................................................852
Issues Fixed in the 2.0.2 Release / CDH 5.2.3.....................................................................................................................852
Issues Fixed in the 2.0.1 Release / CDH 5.2.1.....................................................................................................................853
Issues Fixed in the 2.0.0 Release / CDH 5.2.0.....................................................................................................................853
Issues Fixed in the 1.4.4 Release / CDH 5.1.5.....................................................................................................................855
Issues Fixed in the 1.4.3 Release / CDH 5.1.4.....................................................................................................................855
Issues Fixed in the 1.4.2 Release / CDH 5.1.3.....................................................................................................................855
Issues Fixed in the 1.4.1 Release / CDH 5.1.2.....................................................................................................................855
Issues Fixed in the 1.4.0 Release / CDH 5.1.0.....................................................................................................................856
Issues Fixed in the 1.3.3 Release / CDH 5.0.5.....................................................................................................................858
Issues Fixed in the 1.3.2 Release / CDH 5.0.4.....................................................................................................................858
Issues Fixed in the 1.3.1 Release / CDH 5.0.3.....................................................................................................................858
Issues Fixed in the 1.3.0 Release / CDH 5.0.0.....................................................................................................................860
Issues Fixed in the 1.2.4 Release........................................................................................................................................861
Issues Fixed in the 1.2.3 Release........................................................................................................................................863
Issues Fixed in the 1.2.2 Release........................................................................................................................................863
Issues Fixed in the 1.2.1 Release........................................................................................................................................864
Issues Fixed in the 1.2.0 Beta Release................................................................................................................................864
Issues Fixed in the 1.1.1 Release........................................................................................................................................864
Issues Fixed in the 1.1.0 Release........................................................................................................................................865
Issues Fixed in the 1.0.1 Release........................................................................................................................................866
Issues Fixed in the 1.0 GA Release.....................................................................................................................................867
Issues Fixed in Version 0.7 of the Beta Release..................................................................................................................870
Issues Fixed in Version 0.6 of the Beta Release..................................................................................................................871
Issues Fixed in Version 0.5 of the Beta Release..................................................................................................................872
Issues Fixed in Version 0.4 of the Beta Release..................................................................................................................872
Issues Fixed in Version 0.3 of the Beta Release..................................................................................................................873
Issues Fixed in Version 0.2 of the Beta Release..................................................................................................................873
Appendix: Apache License, Version 2.0.................................................................875
Introducing Apache Impala
Impala provides fast, interactive SQL queries directly on your Apache Hadoop data stored in HDFS, HBase, or the
Amazon Simple Storage Service (S3). In addition to using the same unified storage platform, Impala also uses the same
metadata, SQL syntax (Hive SQL), ODBC driver, and user interface (Impala query UI in Hue) as Apache Hive. This provides
a familiar and unified platform for real-time or batch-oriented queries.
Impala is an addition to tools available for querying big data. Impala does not replace the batch processing frameworks
built on MapReduce such as Hive. Hive and other frameworks built on MapReduce are best suited for long running
batch jobs, such as those involving batch processing of Extract, Transform, and Load (ETL) type jobs.
Note: Impala graduated from the Apache Incubator on November 15, 2017. In places where the
documentation formerly referred to “Cloudera Impala”, now the official name is “Apache Impala”.
Impala Benefits
Impala provides:
• Familiar SQL interface that data scientists and analysts already know.
• Ability to query high volumes of data (“big data”) in Apache Hadoop.
• Distributed queries in a cluster environment, for convenient scaling and to make use of cost-effective commodity
hardware.
• Ability to share data files between different components with no copy or export/import step; for example, to
write with Pig, transform with Hive and query with Impala. Impala can read from and write to Hive tables, enabling
simple data interchange using Impala for analytics on Hive-produced data.
• Single system for big data processing and analytics, so customers can avoid costly modeling and ETL just for
analytics.
How Impala Works with CDH
The following graphic illustrates how Impala is positioned in the broader Cloudera environment:
The Impala solution is composed of the following components:
• Clients - Entities including Hue, ODBC clients, JDBC clients, and the Impala Shell can all interact with Impala. These
interfaces are typically used to issue queries or complete administrative tasks such as connecting to Impala.
Apache Impala Guide | 19
Introducing Apache Impala
• Hive Metastore - Stores information about the data available to Impala. For example, the metastore lets Impala
know what databases are available and what the structure of those databases is. As you create, drop, and alter
schema objects, load data into tables, and so on through Impala SQL statements, the relevant metadata changes
are automatically broadcast to all Impala nodes by the dedicated catalog service introduced in Impala 1.2.
• Impala - This process, which runs on DataNodes, coordinates and executes queries. Each instance of Impala can
receive, plan, and coordinate queries from Impala clients. Queries are distributed among Impala nodes, and these
nodes then act as workers, executing parallel query fragments.
• HBase and HDFS - Storage for data to be queried.
Queries executed using Impala are handled as follows:
1. User applications send SQL queries to Impala through ODBC or JDBC, which provide standardized querying
interfaces. The user application may connect to any impalad in the cluster. This impalad becomes the coordinator
for the query.
2. Impala parses the query and analyzes it to determine what tasks need to be performed by impalad instances
across the cluster. Execution is planned for optimal efficiency.
3. Services such as HDFS and HBase are accessed by local impalad instances to provide data.
4. Each impalad returns data to the coordinating impalad, which sends these results to the client.
Primary Impala Features
Impala provides support for:
• Most common SQL-92 features of Hive Query Language (HiveQL) including SELECT, joins, and aggregate functions.
• HDFS, HBase, and Amazon Simple Storage System (S3) storage, including:
– HDFS file formats: delimited text files, Parquet, Avro, SequenceFile, and RCFile.
– Compression codecs: Snappy, GZIP, Deflate, BZIP.
• Common data access interfaces including:
– JDBC driver.
– ODBC driver.
– Hue Beeswax and the Impala Query UI.
• impala-shell command-line interface.
• Kerberos authentication.
20 | Apache Impala Guide
Introducing Apache Impala
剩余876页未读,继续阅读
点击了解资源详情
点击了解资源详情
点击了解资源详情
2016-04-17 上传
2018-10-24 上传
2014-03-24 上传
2016-06-09 上传
2012-12-20 上传
2019-08-11 上传
Lucien_Hu
- 粉丝: 2
- 资源: 1
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
最新资源
- JHU荣誉单变量微积分课程教案介绍
- Naruto爱好者必备CLI测试应用
- Android应用显示Ignaz-Taschner-Gymnasium取消课程概览
- ASP学生信息档案管理系统毕业设计及完整源码
- Java商城源码解析:酒店管理系统快速开发指南
- 构建可解析文本框:.NET 3.5中实现文本解析与验证
- Java语言打造任天堂红白机模拟器—nes4j解析
- 基于Hadoop和Hive的网络流量分析工具介绍
- Unity实现帝国象棋:从游戏到复刻
- WordPress文档嵌入插件:无需浏览器插件即可上传和显示文档
- Android开源项目精选:优秀项目篇
- 黑色设计商务酷站模板 - 网站构建新选择
- Rollup插件去除JS文件横幅:横扫许可证头
- AngularDart中Hammock服务的使用与REST API集成
- 开源AVR编程器:高效、低成本的微控制器编程解决方案
- Anya Keller 图片组合的开发部署记录
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功