没有合适的资源?快使用搜索试试~ 我知道了~
首页Talend Open Studio 4.1 Components Reference Guide: Business Intelligence SCD Components
Talend Open Studio 4.1 Components Reference Guide: Business Inte...
4星 · 超过85%的资源 需积分: 50 54 下载量 104 浏览量
更新于2024-07-19
收藏 19.05MB PDF 举报
本文档是Talend Open Studio组件参考指南,专为Talend Open Studio v4.1.x版本设计,旨在提供对各种组件的详细说明和用法。Talend Open Studio是一款强大的数据集成工具,它包含丰富的业务智能(Business Intelligence)组件,如针对不同数据库系统的SCD(Slowly Changing Dimension)处理工具,如tDB2SCD、tGreenplumSCD、tInformixSCD和tIngresSCD等。
tDB2SCD组件主要用于处理IBM DB2中的数据变动情况,通过其特定的属性如tDB2SCDProperties,用户可以配置数据更新策略,如插入、更新和删除操作的处理方式。相关场景可能涉及数据仓库的维护和ETL(Extract, Transform, Load)过程。
tDB2SCDELT组件则可能提供了更精细的增量处理功能,用户可以通过调整其属性来适应不同的数据变化环境。在使用时,需要了解其与其他组件如何协同工作,以及如何在实际项目中优化性能和数据一致性。
tGreenplumSCD专为Greenplum数据库设计,其功能类似,允许用户处理来自该数据库的慢变维度数据。tGreenplumSCDProperties同样提供了定制化选项,以满足特定的业务需求和性能要求。
tInformixSCD和tIngresSCD分别针对Informix和Ingres数据库,它们都支持SCD逻辑,帮助处理这些数据库中维度数据的变化。每个组件都有其特定的属性设置,以支持不同数据库平台的数据管理和分析。
tMondrianI部分可能与Mondrian(一个用于OLAP查询的开源框架)有关,但具体信息没有在提供的部分内容中明确提及。这可能是另一个用于分析和报告的组件,可能涉及到数据模型的构建和报表生成。
整个参考指南包括了目标、读者群体、排版约定、版本更新历史以及反馈和支持渠道,旨在为Talend Open Studio的用户和开发者提供全面的组件使用指南,帮助他们高效地利用这些工具进行数据处理和分析工作。由于版权问题,文档采用Creative Commons Public License (CCPL)协议,允许用户在遵循许可条款的情况下使用和分享文档内容。
xvi Talend Open Studio Components
Related scenario ..................................................936
tFileInputMail .........................................................937
tFileInputMail properties .....................................937
Scenario: Extracting key fields from an email ....938
tFileInputMSDelimited ..........................................940
tFileInputMSDelimited properties ......................940
The Multi Schema Editor .................................940
Scenario: Reading a multi structure delimited file ....
941
tFileInputMSPositional .........................................947
tFileInputMSPositional properties ......................947
Related scenario ..................................................948
tFileInputMSXML ..................................................949
tFileInputMSXML Properties .............................949
Scenario: Reading a multi structure XML file ....950
tFileInputPositional ...............................................953
tFileInputPositional properties ............................953
Scenario: From Positional to XML file ...............954
tFileInputProperties ................................................958
tFileInputProperties properties ............................958
Scenario: Reading and matching the keys and the val-
ues of different .properties files and outputting the results
in a glossary ..............................................................958
tFileInputRegex .......................................................962
tFileInputRegex properties ..................................962
Scenario: Regex to Positional file .......................963
tFileInputXML ........................................................ 966
tFileList ...................................................................967
tFileList properties ..............................................967
Scenario: Iterating on a file directory ..................969
tFileOutputARFF ....................................................972
tFileOutputARFF properties ................................972
Related scenarios .................................................973
tFileOutputDelimited ..............................................974
tFileOutputDelimited properties .......................... 974
Scenario: Writing data in a delimited file ...........976
tFileOutputEBCDIC ...............................................981
tFileOutputEBCDIC properties ...........................981
Scenario: Creating an EBCDIC file using two delim-
ited files .....................................................................981
tFileOutputExcel .....................................................984
tFileOutputExcel Properties ................................984
Related scenario ..................................................985
tFileOutputJSON ...................................................986
tFileOutputJSON properties ...............................986
Scenario: Writing a JSON structured file ............986
tFileOutputLDIF .....................................................990
tFileOutputLDIF Properties ................................ 990
Scenario: Writing DB data into an LDIF-type file ....
991
tFileOutputMSDelimited .......................................993
tFileOutputMSDelimited properties ...................993
Related scenarios .................................................994
tFileOutputMSPositional .......................................995
tFileOutputMSPositional properties ....................995
Related scenario ...................................................995
tFileOutputMSXML ................................................996
tFileOutputMSXML Properties ...........................996
Defining the MultiSchema XML tree ...............996
Importing the XML tree ...............................997
Creating manually the XML tree .................999
Mapping XML data from multiple schema sources
999
Defining the node status .................................1000
Loop element .............................................1000
Group element ............................................1000
Related scenario .................................................1001
tFileOutputPositional ............................................1002
tFileOutputPositional Properties ........................1002
Related scenario ................................................1003
tFileOutputProperties ...........................................1004
tFileOutputProperties properties ........................1004
Related scenarios ...............................................1004
tFileOutputXML ....................................................1005
tFileProperties ........................................................1006
tFileProperties Properties ...................................1006
Scenario: Displaying the properties of a processed file
1007
tFileRowCount .......................................................1009
tFileRowCount properties ..................................1009
Related scenario .................................................1010
tFileTouch ...............................................................1011
tFileTouch properties .........................................1011
Related scenario ................................................1011
tFileUnarchive ........................................................1012
tFileUnarchive Properties ..................................1012
Related scenario .................................................1013
tPivotToColumnsDelimited ..................................1014
tPivotToColumnsDelimited Properties ..............1014
Scenario: Using a pivot column to aggregate data .....
1014
Internet components ..............................1017
tFileFetch ................................................................1018
tFileFetch properties ..........................................1018
Related scenario 1: Fetching data through HTTP ......
1019
Related scenario 2: Reading the data from a remote
file in streaming mode .............................................1020
tFileInputJSON ......................................................1021
tFTPConnection .....................................................1022
tFTPConnection properties ................................1022
Related scenarios ...............................................1022
tFTPDelete ..............................................................1023
tFTPDelete properties ........................................1023
Talend Open Studio Components xvii
Related scenario ................................................1023
tFTPFileExist ........................................................1024
tFTPFileExist properties ...................................1024
Related scenario ................................................1025
tFTPFileList ..........................................................1026
tFTPFileList properties .....................................1026
Scenario: Iterating on a remote directory .........1027
tFTPFileProperties ................................................1031
tFTPFileProperties Properties ........................... 1031
Related scenario ................................................1032
tFTPGet ..................................................................1033
tFTPGet properties ............................................1033
Related scenario ................................................1034
tFTPPut ..................................................................1035
tFTPPut properties .............................................1035
Scenario: Putting files on a remote FTP server . 1036
tFTPRename ..........................................................1039
tFTPRename Properties .....................................1039
Related scenario ................................................1040
tFTPTruncate .......................................................1041
tFTPTruncate properties ...................................1041
Related scenario ................................................1042
tJMSInput ..............................................................1043
tJMSInput properties .........................................1043
Related scenario ...............................................1044
tJMSOutput ...........................................................1045
tJMSOutput properties ......................................1045
Related scenario ...............................................1045
tMomInput .............................................................1046
tMomInput Properties ........................................1046
Scenario: asynchronous communication via a MOM
server .......................................................................1047
tMomMessageIdList .............................................1050
tMomMessageIdList Properties ........................1050
Related scenario ................................................1050
tMomOutput ..........................................................1051
tMomOutput Properties .....................................1051
Related scenario ................................................1051
tPOP .......................................................................1052
tPOP properties ..................................................1052
Scenario: Retrieving a selection of email messages
from an email server .............................................. 1053
tRSSInput ..............................................................1056
tRSSInput Properties .........................................1056
Scenario: Fetching frequently updated blog entries. .
1056
tRSSOutput ............................................................ 1059
tRSSOutput Properties ......................................1059
Scenario 1: Creating an RSS flow and storing files on
an FTP server ..........................................................1060
Scenario 2: Creating an RSS flow that contains meta-
data ..........................................................................1064
Scenario 3: Creating an ATOM feed XML file 1066
tSCPClose ...............................................................1070
tSCPClose Properties .........................................1070
Related scenario .................................................1070
tSCPConnection .....................................................1071
tSCPConnection properties ................................1071
Related scenarios ...............................................1071
tSCPDelete ..............................................................1072
tSCPDelete properties ........................................1072
Related scenario .................................................1072
tSCPFileExists ........................................................1073
tSCPFileExists properties ..................................1073
Related scenario .................................................1073
tSCPFileList ...........................................................1074
tSCPFileList properties ......................................1074
Related scenario .................................................1074
tSCPGet ..................................................................1075
tSCPGet properties .............................................1075
Scenario: Getting files from a remote SCP server .....
1075
tSCPPut ..................................................................1077
tSCPPut properties .............................................1077
Related scenario .................................................1077
tSCPRename ..........................................................1078
tSCPRename properties .....................................1078
Related scenario .................................................1078
tSCPTruncate .........................................................1079
tSCPRename properties .....................................1079
Related scenario .................................................1079
tSendMail ...............................................................1080
tSendMail Properties ..........................................1080
Scenario: Email on error ....................................1081
tSocketInput ...........................................................1083
tSocketInput properties ......................................1083
Scenario: Passing on data to the listening port (Java)
1085
tSocketOutput ........................................................1088
tSocketOutput properties ...................................1088
Related Scenario ................................................1089
tSOAP .....................................................................1090
tSOAP properties ...............................................1090
Scenario: Extracting the weather information using a
Web service .............................................................1091
tWebServiceInput ..................................................1094
tWebServiceInput Properties .............................1094
Scenario 1: Extracting images through a Web service
1096
Scenario 2: Reading the data published on a Web ser-
vice using the tWebServiceInput advanced features (Java
only) .........................................................................1097
tXMLRPCInput .....................................................1102
tXMLRPCInput Properties ................................1102
Scenario: Guessing the State name from an XMLRPC
1102
xviii Talend Open Studio Components
Logs & Errors components .................. 1105
tAssert ....................................................................1106
tAssert Properties ..............................................1106
Scenario: Setting up the assertive condition for a Job
execution .................................................................1106
tAssertCatcher .......................................................1112
tAssertCatcher Properties ..................................1112
Related scenarios ...............................................1113
tChronometerStart ................................................1114
tChronometerStart Properties ............................1114
Related scenario ................................................1114
tChronometerStop ................................................1115
tChronometerStop Properties ............................1115
Scenario: Measuring the processing time of a subjob
and part of a subjob ................................................. 1115
tDie ..........................................................................1120
tDie properties ...................................................1120
Related scenarios ...............................................1120
tFlowMeter ............................................................ 1121
tFlowMeter Properties .......................................1121
Related scenario ................................................1121
tFlowMeterCatcher ...............................................1122
tFlowMeterCatcher Properties ..........................1122
Scenario: Catching flow metrics from a Job ..... 1123
tLogCatcher ...........................................................1127
tLogCatcher properties .....................................1127
Scenario1: warning & log on entries .................1127
Scenario 2: Log & kill a Job ..............................1129
tLogRow ................................................................1131
tLogRow properties ...........................................1131
Scenario: Delimited file content display ...........1131
tStatCatcher ...........................................................1132
tStatCatcher Properties ......................................1132
Scenario: Displaying job stats log ..................... 1132
tWarn .....................................................................1135
tWarn Properties ................................................1135
Related scenarios ...............................................1135
Misc group components ........................ 1137
tAddLocationFromIP ..........................................1138
tAddLocationFromIP Properties .......................1138
Scenario: Identifying a real-world geographic loca-
tion of an IP .............................................................1139
tBufferInput ...........................................................1141
tBufferInput properties ......................................1141
Scenario: Retrieving bufferized data (Java) ......1141
tBufferOutput ........................................................1144
tBufferOutput properties ................................... 1144
Scenario1: Buffering data (Java) ....................... 1144
Scenario 2: Buffering output data on the webapp serv-
er ............................................................................1147
Scenario 3: Calling a Job with context variables from
a browser .................................................................1150
Scenario 4: Calling a Job exported as Webservice in
another Job ...............................................................1152
tContextDump ........................................................1155
tContextDump properties ...................................1155
Related Scenario ..............................................1155
tContextLoad .........................................................1156
tContextLoad properties .....................................1156
Scenario: Dynamic context use in MySQL DB insert
1157
tFixedFlowInput ....................................................1160
tFixedFlowInput properties ................................1160
Related scenarios ...............................................1160
tMemorizeRows ....................................................1162
tMemorizeRows properties ................................1162
Scenario: Counting the occurrences of different ages
1163
tMsgBox .................................................................1168
tMsgBox properties ............................................1168
Scenario: ‘Hello world!’ type test ......................1168
tRowGenerator .....................................................1170
tRowGenerator properties ..................................1170
Defining the schema .......................................1170
Defining the function ......................................1171
Scenario: Generating random java data .............1172
Orchestration components ....................1175
tFileList ..................................................................1176
tFlowToIterate .......................................................1177
tFlowToIterate Properties ..................................1177
Scenario: Transforming data flow to a list .........1177
tForeach ..................................................................1182
tForeach Properties ...........................................1182
Related scenario: Iterating on a list and retrieving the
values .......................................................................1182
tInfiniteLoop ..........................................................1185
tInfiniteLoop Properties ....................................1185
Related scenario .................................................1185
tIterateToFlow .......................................................1186
tIterateToFlow Properties ..................................1186
Scenario: Transforming a list of files as data flow ....
1187
tLoop .......................................................................1189
tLoop Properties .................................................1189
Scenario: Job execution in a loop ......................1190
tPostjob ...................................................................1192
tPostjob Properties .............................................1192
Related scenario .................................................1192
tPrejob ....................................................................1193
tPrejob Properties ...............................................1193
Related scenario .................................................1193
Talend Open Studio Components xix
tReplicate ...............................................................1194
tReplicate Properties ..........................................1194
Related scenario ................................................1194
tRunJob .................................................................1195
tSleep ......................................................................1196
tSleep Properties ................................................1196
Related scenarios ...............................................1196
tUnite ......................................................................1197
tUnite Properties ................................................1197
Scenario: Iterate on files and merge the content 1198
tWaitForFile ..........................................................1201
tWaitForFile properties .....................................1201
Scenario: Waiting for a file to be removed ......1203
tWaitForSocket .....................................................1206
tWaitForSocket properties .................................1206
Related scenario ...............................................1207
tWaitForSqlData ...................................................1208
tWaitForSqlData properties ...............................1208
Scenario: Waiting for insertion of rows in a table ....
1209
Processing components ......................... 1213
tAggregateRow .....................................................1214
tAggregateRow properties .................................1214
Scenario: Aggregating values and sorting data .1215
tAggregateSortedRow ...........................................1219
tAggregateSortedRow properties ......................1219
Related scenario ................................................1220
tConvertType .........................................................1221
tConvertType properties ....................................1221
Scenario: Converting java types ........................ 1222
tDenormalize ..........................................................1226
tDenormalize Properties ....................................1226
Scenario 1: Denormalizing on one column in Perl ....
1226
Scenario 2: Denormalizing on multiple columns ......
1228
tDenormalizeSortedRow ......................................1231
tDenormalizeSortedRow properties ..................1231
Scenario: Regrouping sorted rows ....................1231
tEmptyToNull ........................................................1235
tEmptyToNull properties ...................................1235
Scenario: Replacing empty fields by NULL fields
(fields of unknown value) ......................................1235
tExternalSortRow .................................................1239
tExternalSortRow properties .............................1239
Related scenario ................................................1240
tExtractDelimitedFields ........................................1241
tExtractDelimitedFields properties ....................1241
Scenario: Extracting fields from a comma-delimited
file ...........................................................................1242
tExtractPositionalFields .......................................1246
tExtractPositionalFields properties ....................1246
Related scenario .................................................1247
tExtractRegexFields ..............................................1248
tExtractRegexFields properties ..........................1248
Scenario: Extracting name, domain and TLD from
e-mail addresses .......................................................1249
tExtractXMLFields ..............................................1252
tFilterColumns .......................................................1253
tFilterColumns Properties ..................................1253
Related Scenario ................................................1253
tFilterRow ...............................................................1254
tFilterRow Properties .........................................1254
Scenario: Filtering and searching a list of names ......
1255
tMap .......................................................................1257
tMap properties ..................................................1257
Scenario 1: Mapping with filter and simple explicit
join ..........................................................................1258
Scenario 2: Mapping with Inner join rejection ..1262
Scenario 3: Cascading join mapping ..................1268
Scenario 4: Advanced mapping with filters, explicit
joins and Inner join rejection ...................................1268
Scenario 5: Advanced mapping with filters and a
check of all rows ....................................................1274
Scenario 6: Advanced mapping with lookup reload at
each row (java) ........................................................1277
Scenario 7: Mapping with join output tables .....1283
tNormalize ..............................................................1287
tNormalize Properties ........................................1287
Scenario: Normalizing data (in Perl) .................1287
tPivotToRows .........................................................1290
tPivotToRows properties ...................................1290
Scenario: Concatenating a list of columns in a table
by using the other table columns as pivot ...............1291
tReplace ..................................................................1294
tReplace Properties ............................................1294
Scenario: multiple replacements and column filtering
1295
tSampleRow ...........................................................1299
tSampleRow properties ......................................1299
Scenario: Filtering rows and groups of rows .....1299
tSortRow .................................................................1302
tSortRow properties ...........................................1302
Scenario: Sorting entries ....................................1303
System components ...............................1307
tRunJob ..................................................................1308
tRunJob Properties .............................................1308
Scenario: Executing a child Job .........................1309
tSetEnv ....................................................................1315
tSetEnv Properties ..............................................1315
Scenario: Modifying the Date variable during the ex-
xx Talend Open Studio Components
ecution of a Job ......................................................1315
tSSH ........................................................................1319
tSSH Properties .................................................1319
Scenario: Remote system information display via
SSH ........................................................................1320
tSystem ...................................................................1322
tSystem Properties .............................................1322
Scenario: Echo ‘Hello World!’ .......................... 1323
Talend MDM components .................... 1327
tMDMBulkLoad ....................................................1328
tMDMBulkLoad properties ...............................1328
Scenario: Loading records into the ProductFamily
business entity .........................................................1329
tMDMDelete ..........................................................1335
tMDMDelete properties ....................................1335
Scenario: Deleting master data from an MDM hub ..
1336
tMDMInput ...........................................................1340
tMDMInput properties ......................................1340
Scenario: Reading master data in an MDM hub 1341
tMDMOutput ........................................................1345
tMDMOutput properties ....................................1345
Scenario: Writing master data in an MDM hub 1346
tMDMReceive ........................................................1353
tMDMReceive properties ..................................1353
Related scenario ................................................1354
tMDMRouteRecord ..............................................1355
tMDMRouteRecord properties .......................... 1355
Scenario: Routing a record to Event Manager .. 1356
Scenario prerequisites ....................................1356
Routing a record to trigger the corresponding pro-
cess .........................................................................1357
tMDMSP ................................................................1365
tMDMSP Properties ..........................................1365
Scenario: Executing a stored procedure in the MDM
hub ...........................................................................1366
tMDMViewSearch ................................................1372
tMDMViewSearch properties ...........................1372
Scenario: Retrieving records from an MDM hub via
an existing view ...................................................... 1374
tStewardshipTaskInput ........................................1378
tStewardshipTaskInput properties ..................... 1378
Scenario: Reading data in the stewardship console da-
tabase .......................................................................1379
tStewardshipTaskOutput ......................................1383
tStewardshipTaskOutput properties ...................1383
Scenario: Writing data records in the stewardship
console database ......................................................1385
XML components ..................................1393
tAdvancedFileOutputXML ...................................1394
tAdvancedFileOutputXML properties ...............1394
Defining the XML tree ...................................1395
Importing the XML tree .............................1396
Creating the XML tree manually ...............1397
Mapping XML data ........................................1397
Defining the node status .................................1398
Loop element .............................................1398
Group element ............................................1399
Scenario: Creating an XML file using a loop ....1400
tDTDValidator .......................................................1405
tDTDValidator Properties ..................................1405
Scenario: Validating xml files ...........................1405
tExtractXMLField .................................................1408
tExtractXMLField properties .............................1408
Scenario 1: Extracting XML data from a field in a da-
tabase table ..............................................................1409
Scenario 2: Extracting correct and erroneous data
from an XML field in a delimited file .....................1411
tFileInputXML .......................................................1415
tFileInputXML Properties ..................................1415
Scenario 1: Reading and extracting data from an
XML structure .........................................................1417
Scenario 2: Extracting erroneous XML data via a re-
ject flow ...................................................................1418
tFileOutputXML ....................................................1422
tFileOutputXML properties ...............................1422
Scenario: From Positional to XML file .............1423
tWriteXMLField ....................................................1424
tWriteXMLField properties ...............................1424
Scenario: Extracting the structure of an XML file and
inserting it into the fields of a database table ..........1425
tXSDValidator .......................................................1430
tXSDValidator Properties ..................................1430
Related scenario .................................................1430
tXSLT .....................................................................1431
tXSLT Properties ...............................................1431
Scenario: Transforming XML to html using an XSL
stylesheet .................................................................1431
剩余1757页未读,继续阅读
2016-10-11 上传
2013-03-21 上传
113 浏览量
2018-07-24 上传
2016-04-29 上传
2018-11-30 上传
2017-07-16 上传
Joychow
- 粉丝: 1
- 资源: 1
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
最新资源
- 掌握Jive for Android SDK:示例应用的使用指南
- Python中的贝叶斯建模与概率编程指南
- 自动化NBA球员统计分析与电子邮件报告工具
- 下载安卓购物经理带源代码完整项目
- 图片压缩包中的内容解密
- C++基础教程视频-数据类型与运算符详解
- 探索Java中的曼德布罗图形绘制
- VTK9.3.0 64位SDK包发布,图像处理开发利器
- 自导向运载平台的行业设计方案解读
- 自定义 Datadog 代理检查:Python 实现与应用
- 基于Python实现的商品推荐系统源码与项目说明
- PMing繁体版字体下载,设计师必备素材
- 软件工程餐厅项目存储库:Java语言实践
- 康佳LED55R6000U电视机固件升级指南
- Sublime Text状态栏插件:ShowOpenFiles功能详解
- 一站式部署thinksns社交系统,小白轻松上手
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功