Hive用户手册中文版.pdf_hive文档

Hive

5星 · 超过95%的资源需积分: 50 162 浏览量更新于2023-03-16 评论 6 收藏 1.23MB PDF 举报

身份认证购VIP最低享 7 折!

领优惠券(最高得80元）

资源详情

资源评论

资源推荐

Hive

用户指南

v1.0

1." HIVE 结构"................................................................................................................................."5"

1.1" HIVE 架构"..................................................................................................................."5"

1.2" Hive 和 Hadoop 关系"................................................................................................"6"

1.3" Hive 和普通关系数据库的异同"................................................................................"7"

1.4" HIVE 元数据库"............................................................................................................."8"

1.4.1" DERBY"..............................................................................................................."8"

1.4.2" Mysql"................................................................................................................"9"

1.5" HIVE 的数据存储"....................................................................................................."10"

1.6" 其它 HIVE 操作"........................................................................................................"10"

2." HIVE" 基本操作"......................................................................................................................"11"

2.1" create table".................................................................................................................."11"

2.1.1" 总述"................................................................................................................"11"

2.1.2" 语法"................................................................................................................"11"

2.1.3" 基本例子"........................................................................................................"13"

2.1.4" 创建分区"........................................................................................................"14"

2.1.5" 其它例子"........................................................................................................"15"

2.2" Alter Table".................................................................................................................."16"

2.2.1" Add Partitions"............................................................................................"16"

2.2.2" Drop Partitions".........................................................................................."16"

2.2.3" Rename Table"................................................................................................"16"

2.2.4" Change Column".............................................................................................."17"

2.2.5" Add/Replace Columns".................................................................................."17"

2.3" Create View"................................................................................................................"17"

2.4" Show"..........................................................................................................................."18"

2.5" Load"............................................................................................................................"18"

2.6" Insert"..........................................................................................................................."20"

2.6.1" Inserting data into Hive Tables from queries"................................."20"

2.6.2" Writing data into filesystem from queries"......................................."21"

2.7" Cli"..............................................................................................................................."22"

2.7.1" Hive Command line Options"......................................................................"22"

2.7.2" Hive interactive Shell Command"............................................................"23"

2.7.3" Hive Resources"............................................................................................"24"

2.7.4" 调用 python、shell 等语言"........................................................................"25"

2.8" DROP"............................................................................................................................"26"

2.9" 其它"............................................................................................................................"26"

2.9.1" Limit".............................................................................................................."26"

2.9.2" Top k".............................................................................................................."26"

2.9.3" REGEX Column Specification"...................................................................."26"

3." Hive"Select".............................................................................................................................."27"

3.1" Group By"...................................................................................................................."27"

3.2" Order /Sort By"........................................................................................................"28"

4." Hive"Join"................................................................................................................................."28"

5." HIVE 参数设置"......................................................................................................................."31"

6." HIVE"UDF"................................................................................................................................"32"

6.1" 基本函数"...................................................................................................................."32"

6.1.1" 关系操作符"................................................................................................ ...."32"

6.1.2" 代数操作符"................................................................................................ ...."34"

6.1.3" 逻辑操作符"................................................................................................ ...."35"

6.1.4" 复杂类型操作符"............................................................................................"35"

6.1.5" 内建函数"........................................................................................................"35"

6.1.6" 数学函数"........................................................................................................"35"

6.1.7" 集合函数"........................................................................................................"35"

6.1.8" 类型转换"........................................................................................................"35"

6.1.9" 日期函数"........................................................................................................"35"

6.1.10" 条件函数"........................................................................................................"36"

6.1.11" 字符串函数"................................................................................................ ...."36"

6.2" UDTF"........................................................................................................................."38"

6.2.1" Explode"................................ ........................................................................."39"

7." HIVE" 的 MAP/REDUCE"................................................................................................ ..........."40"

7.1" JOIN"............................................................................................................................"40"

7.2" GROUP"BY"..................................................................................................................."41"

7.3" DISTINCT"....................................................................................................................."41"

8." 使用 HIVE 注意点".................................................................................................................."42"

8.1" 字符集"........................................................................................................................"42"

8.2" 压缩"............................................................................................................................"42"

8.3" count(distinct)"......................................................................................................"42"

8.4" JOIN"............................................................................................................................"42"

8.5" DML 操作"................................................................ ....................................................."43"

8.6" HAVING"........................................................................................................................"43"

8.7" 子查询"........................................................................................................................"43"

8.8" Join 中处理 null 值的语义区别"............................................................................."43"

9." 优化与技巧"............................................................................................................................"46"

9.1" 全排序"........................................................................................................................"46"

9.1.1" 例 1"................................................................................................................."47"

9.1.2" 例 2"................................................................................................................."50"

9.2" 怎样做笛卡尔积"........................................................................................................"53"

9.3" 怎样写 exist/in 子句"................................................................ .............................."53"

9.4" 怎样决定 reducer 个数"............................................................................................"54"

9.5" 合并 MapReduce 操作"................................................................................................"54"

9.6" Bucket'

与

' sampling".................................................................................................."55"

9.7" Partition"................................ ......................................................................................"56"

9.8" JOIN"............................................................................................................................"57"

9.8.1" JOIN 原则"......................................................................................................."57"

9.8.2" Map"Join"......................................................................................................... "57"

9.8.3" 大表 Join 的数据偏斜"...................................................................................."59"

9.9" 合并小文件"................................................................................................................"61"

剩余61页未读，继续阅读

砖厂码农

2019-05-29

very good!

xqg_5083

粉丝: 12
资源: 24

会员权益专享

Hive用户手册中文版.pdf

评论3

会员权益专享

最新资源

Hive用户手册中文版.pdf

评论3

漂亮的嫩黄瓜「Pretty Gherkin」-crx插件

hive基础文档

hive优化经典.pdf

Hive on Spark vs. Hive on Mapreduce：选择哪个更适合你

Hive 数据加载：从本地数据导入到 Hive 中

Hive与实时数据处理

初识 Hive：什么是 Hive 数据仓库

Hive与实时数据处理：Hive on Tez

set mapred.reduce.tasks=100; set hive.exec.reducers.max=100; set hive.auto.convert.join=true; set hive.groupby.skewindata=true; set ngmr.safety.size.single.entry=-1;

hive.exec.dynamic.partition

hive的参数hive.new.job.grouping.set.cardinality 是什么作用

hive用户手册pdf

hive的hive-site.xml怎么配置票据

pyspark连接 HiveConf of name hive.metastore.event.db.notification.api.auth does not exis

13944 [5b28eeb5-e867-49e3-bbdd-5f0d839ee8df main] WARN org.apache.hadoop.hive.ql.session.SessionState - METASTORE_FILTER_HOOK will be ignored, since hive.security.authorization.manager is set to instance of HiveAuthorizerFactory.

hive.auto.convert.join

FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient

在hive客户端执行load data local inpath '/opt/module/hive/datas/location.txt' into table location;，会出现org.apache.hadoop.hive.ql.parse.SemanticException:Line 1:23 Invalid path ''/opt/module/hive/datas/location.txt'': No files matching path file:/opt/module/hive/datas/location.txt错误

会员权益专享

最新资源