Kettle的基础入门文档

Kettle 3.2 使用说明书

目录

概述...........................................................................................................................................7

1.Kettle 资源库管理.................................................................................................................7

2.2 编辑..........................................................................................................................19

2.3 视图..........................................................................................................................21

2.4 资源库......................................................................................................................21

2.5 转换..........................................................................................................................22

2.6 作业..........................................................................................................................25

2.7 向导..........................................................................................................................26

2.8 帮助..........................................................................................................................26

2.9 变量..........................................................................................................................26

2.9.1 变量使用........................................................................................................26

2.9.2 变量范围.......................................................................................................26

4.主对象树..............................................................................................................................30

4.1 转换主对象树..........................................................................................................31

4.1.1 新建转换.......................................................................................................32

4.1.2 转换设置.......................................................................................................32

4.1.5 Hops(节点连接).............................................................................................40

4.1.6 数据库分区 schems ......................................................................................42

4.2.4 作业项目....................................................................................................47

4.2.5 子服务器.......................................................................................................47

5. 转换核心对象....................................................................................................................47

5.1 Transform..................................................................................................................48

5.2 Input ..........................................................................................................................48

5.3 输入..........................................................................................................................49

5.3.1 Access Input ...................................................................................................49

5.3.2 CSV file input ................................................................................................50

5.3.3 Cube 输入 多维立方体 ................................................................................51

5.3.11 LDIF Input....................................................................................................58

5.3.12 Mondrian Input.............................................................................................60

5.3.13 Property Input...............................................................................................60

5.3.14 Streaming XML Input ..................................................................................61

5.3.15 XBase 输入 ..................................................................................................65

5.3.16 XML 输入....................................................................................................66

5.3.17 文本文件输入.............................................................................................70

5.3.18 生成记录.....................................................................................................71

5.3.19 获取系统信息.............................................................................................71

5.3.20 表输入.........................................................................................................73

5.4.7 删除...............................................................................................................80

5.4.8 插入/更新......................................................................................................81

5.4.9 文本文件输出...............................................................................................83

5.4.10 更新.............................................................................................................83

5.4.11 表输出.........................................................................................................84

5.5 查询..........................................................................................................................85

5.5.1 Check if a column exists ................................................................................85

5.5.6 数据库查询...................................................................................................89

5.5.7 数据库连接...................................................................................................91

5.5.8 流查询...........................................................................................................92

5.5.9 调用 DB 存储过程 .......................................................................................94

5.6 转换..........................................................................................................................94

5.6.1 Abort...............................................................................................................95

5.6.3 Add a checksum 增加检查和 .......................................................................97

5.6.4 Analytic Query 分析查询 .............................................................................98

5.6.5 Append Streams .............................................................................................98

5.6.12 Metadata structure of stream 流中元数据结构 .........................................102

5.6.13 Null if 设置为空值 ...................................................................................102

5.6.14 Row Normaliser 行正规化 .......................................................................103

5.6.15 Split field to rows 分离行 .........................................................................103

5.6.16 Switch / case...............................................................................................104

5.6.17 XSD Validator ............................................................................................104

5.6.18 XSL Transformation...................................................................................105

5.6.19 值映射.......................................................................................................106

5.6.20 分组...........................................................................................................107

5.6.21 去除重复记录...........................................................................................108

5.6.28 行扁平化...................................................................................................113

5.6.29 行转列....................................................................................................... 115

5.6.30 计算器....................................................................................................... 116

5.6.31 过滤记录...................................................................................................119

5.7.1 Merge Join....................................................................................................120

5.7.2 Sorted Merge................................................................................................121

5.7.3 XML Join .....................................................................................................122

5.8.2 Regex Evaluation .........................................................................................125

5.8.3 执行 SQL 脚本 ...........................................................................................127

5.9 数据仓库................................................................................................................128

5.9.1 维度更新/查询............................................................................................128

5.9.2 联合更新/查询............................................................................................129

5.10 映射......................................................................................................................130

5.10.1 映射（子转换）.......................................................................................130

5.10.2 映射输入规范...........................................................................................131

5.10.2 映射输出规范...........................................................................................132

5.11 作业......................................................................................................................132

5.12 内联......................................................................................................................136

5.12.2 Socket reader..............................................................................................137

5.12.3 Socket writer ..............................................................................................137

5.13 实验......................................................................................................................138

5.14 不推荐的..............................................................................................................138

5.14.1 聚合记录...................................................................................................139

5.15 Bulk loading..........................................................................................................140

5.16 History...................................................................................................................142

6. 任务 Jobs 核心对象.........................................................................................................143

6.2.4 显示消息对话框.........................................................................................145

6.2.5 任务(Job) ....................................................................................................146

6.2.6 Ping a host....................................................................................................147

6.2.7 Success .........................................................................................................148

6.2.8 文本输出.....................................................................................................148

6.2.9 Write to Log .................................................................................................149

6.3 邮件........................................................................................................................149

6.3.1 Write to Log .................................................................................................149

6.4.3 拷贝文件.....................................................................................................153

6.4.4 拷贝或移动结果文件名.............................................................................153

6.4.5 新建文件夹.................................................................................................154

6.4.6 新建文件.....................................................................................................155

6.4.7 删除文件.....................................................................................................155

6.4.8 从结果集中删除文件名.............................................................................155

6.4.9 删除文件.....................................................................................................156

6.4.10 删除文件夹...............................................................................................156

6.4.11 文件比较...................................................................................................157

6.4.12 HTTP..........................................................................................................157

6.5.2 检查文件是否存在.....................................................................................161

6.5.3 检查数据库表中的列是否存在.................................................................162

6.5.4 检查文件存在.............................................................................................162

6.5.5 检查表是否存在.........................................................................................163

6.5.6 等待.............................................................................................................163

6.6 脚本........................................................................................................................164

6.6.1 Mail ..............................................................................................................164

6.6.2 SQL ..............................................................................................................164

6.6.3 SHELL .........................................................................................................165

6.7 批量加载................................................................................................................166

6.8.3 XSD Validator ..............................................................................................169

6.8.4 XSL Transformation.....................................................................................170

6.9 文件传输................................................................................................................171

6.9.1 FTP...............................................................................................................171

6.9.2 FTP Delete....................................................................................................173

6.9.3 Put a file with FTP .......................................................................................173

6.9.4 Put a file with SFTP .....................................................................................175

6.9.5 SSH2 Get......................................................................................................176