没有合适的资源?快使用搜索试试~ 我知道了~
首页Oracle Warehouse Builder 11g Release 2 数据建模、ETL与数据质量指南
"Oracle Warehouse Builder 是一款强大的数据仓库构建工具,涵盖了数据建模、ETL(提取、转换、加载)以及数据质量控制等关键功能。本指南为11g Release 2 (11.2)版,旨在帮助用户充分利用该工具进行高效的数据仓库开发和管理。文档由Richa Agarwala作为主要作者,与Padmaja Potineni和Vishwanath Sreeraman共同完成,旨在提供详尽的使用指导。"
在Oracle Warehouse Builder 11g Release 2中,数据建模是构建数据仓库的基础。这个过程包括概念数据模型设计、逻辑数据模型设计和物理数据模型实现。概念模型关注业务实体和它们之间的关系,逻辑模型则将这些实体转化为更具体的数据库结构,而物理模型考虑了性能优化,如表分区、索引等。
ETL过程是数据仓库系统的核心部分。Oracle Warehouse Builder提供了丰富的ETL工具,用于从各种源系统抽取数据,通过转换(如清洗、验证、聚合等)处理数据,然后加载到目标数据仓库或数据集市。用户可以使用图形化的界面设计、测试和调度ETL作业,大大简化了复杂的数据集成任务。
数据质量是确保数据仓库准确性和可信度的关键。Oracle Warehouse Builder提供了数据质量工具,如数据清洗、匹配和去重,以确保输入到数据仓库的信息是准确和一致的。此外,它还支持监控和报告数据质量问题,帮助用户识别和解决潜在的错误和不一致性。
文档还强调了版权和许可协议,指出软件及其文档受法律保护,使用需遵循特定条款,禁止未经授权的复制、分发等行为。对于软件中的错误,鼓励用户书面报告以便改进。
"Oracle Warehouse Builder Data Modeling, ETL, and Data Quality Guide"是数据仓库开发者和管理员的重要参考资料,它详细介绍了如何利用Oracle Warehouse Builder进行高效的数据管理和分析工作,同时强调了合法合规的软件使用。
xvi
10.1.3.2 Automatic Commit versus Automatic Correlated Commit................................ 10-8
10.1.3.3 Embedding Commit Logic into the Mapping....................................................... 10-9
10.1.4 Committing Data Independently of Mapping Design.............................................. 10-10
10.1.5 Running Multiple Mappings Before Committing Data............................................ 10-10
10.1.5.1 Committing Data at Runtime ................................................................................ 10-11
10.1.5.2 Committing Mappings through the Process Flow Editor ................................. 10-12
10.1.6 Ensuring Referential Integrity in PL/SQL Mappings............................................... 10-13
10.2 Best Practices for Designing SQL*Loader Mappings ....................................................... 10-13
10.2.1 Using Conventional Loading to Ensure Referential Integrity in SQL*Loader Mappings
10-13
10.2.1.1 Maintaining Relationships Between Master and Detail Records..................... 10-14
10.2.1.2 Extracting and Loading Master-Detail Records.................................................. 10-15
10.2.1.3 Error Handling Suggestions .................................................................................. 10-17
10.2.1.4 Subsequent Operations........................................................................................... 10-18
10.2.2 Using Direct Path Loading to Ensure Referential Integrity in SQL*Loader Mappings ....
10-18
10.3 Improved Performance through Partition Exchange Loading........................................ 10-21
10.3.1 About Partition Exchange Loading.............................................................................. 10-22
10.3.2 Configuring a Mapping for PEL................................................................................... 10-22
10.3.3 Direct and Indirect PEL ................................................................................................. 10-23
10.3.3.1 Using Indirect PEL .................................................................................................. 10-23
10.3.3.2 Example: Using Direct PEL to Publish Fact Tables ............................................ 10-24
10.3.4 Using PEL Effectively..................................................................................................... 10-24
10.3.5 Configuring Targets in a Mapping............................................................................... 10-25
10.3.5.1 Step 1: Create All Partitions ................................................................................... 10-25
10.3.5.2 Step 2: Create All Indexes Using the LOCAL Option........................................ 10-26
10.3.5.3 Step 3: Primary/Unique Keys Use "USING INDEX" Option ........................... 10-26
10.3.6 Restrictions for Using PEL in Oracle Warehouse Builder ........................................ 10-26
10.4 High Performance Data Extraction from Remote Sources............................................... 10-26
11 Scheduling ETL Jobs
11.1 Overview of Schedules............................................................................................................ 11-1
11.2 Defining Schedules.................................................................................................................. 11-2
11.2.1 Editing Schedules ............................................................................................................. 11-3
11.2.1.1 Start and End Dates and Times ............................................................................... 11-4
11.2.1.2 Defining Schedules To Repeat................................................................................. 11-4
11.2.1.2.1 By Month ............................................................................................................. 11-6
11.2.1.2.2 By Week Number ............................................................................................... 11-6
11.2.1.2.3 By Year Day......................................................................................................... 11-6
11.2.1.2.4 By Month Day..................................................................................................... 11-7
11.2.1.2.5 By Day.................................................................................................................. 11-7
11.2.1.2.6 By Hour................................................................................................................ 11-7
11.2.1.2.7 By Minute ............................................................................................................ 11-7
11.2.1.2.8 By Second ............................................................................................................ 11-7
11.2.1.2.9 By Set Position .................................................................................................... 11-7
11.2.2 Example Schedules........................................................................................................... 11-8
11.3 Applying Schedules to ETL Objects...................................................................................... 11-8
xvii
11.4 Scheduling ETL Jobs in Oracle Enterprise Manager........................................................... 11-9
11.4.1 The SQLPLUS_EXEC_TEMPLATE SQL Script............................................................ 11-9
11.4.2 The WB_RT_API_EXEC.RUN_TASK Function ......................................................... 11-10
12 Deploying to Target Schemas and Executing ETL Logic
12.1 Overview of Deployment and Execution in Oracle Warehouse Builder......................... 12-1
12.1.1 About Deployment........................................................................................................... 12-1
12.1.1.1 About Deployment Actions ..................................................................................... 12-2
12.1.1.2 About Deployment Status........................................................................................ 12-3
12.1.1.3 About Deploying Dimensional Objects.................................................................. 12-3
12.1.1.4 About Deploying Mappings and Process Flows .................................................. 12-3
12.1.1.5 About Deploying Code Template (CT) Mappings and Web Services............... 12-3
12.1.1.6 About Deploying Schedules .................................................................................... 12-3
12.1.2 About Execution ............................................................................................................... 12-4
12.1.3 About Configurations ...................................................................................................... 12-4
12.1.4 About Viewing and Setting Configuration Properties for Different Configurations........
12-4
12.2 Steps in the Deployment and Execution Process ................................................................ 12-5
12.3 Deploying Objects.................................................................................................................... 12-6
12.3.1 Deploying Objects Using the Control Center Manager .............................................. 12-6
12.3.2 Deploying Objects Using the Projects Navigator......................................................... 12-7
12.3.3 Deploying Target Systems to a Remote System........................................................... 12-8
12.3.4 Reviewing Deployment Results ..................................................................................... 12-8
12.4 Starting ETL Jobs...................................................................................................................... 12-9
12.4.1 Viewing Execution Results for ETL Jobs..................................................................... 12-10
12.4.2 Viewing the Data ............................................................................................................ 12-11
12.4.3 Scheduling ETL Jobs....................................................................................................... 12-11
12.5 Starting ETL Jobs in SQL*Plus ............................................................................................. 12-12
12.5.1 Managing Jobs Using SQL Scripts................................................................................ 12-12
12.6 Example: Updating a Target Schema................................................................................. 12-12
13 Auditing Deployments and Executions
13.1 About Auditing Deployment and Executions..................................................................... 13-1
13.1.1 About the Repository Browser ....................................................................................... 13-2
13.1.2 About the Heterogeneous Repository Browser (HRAB) ............................................ 13-2
13.1.2.1 Differences Between Repository Browser and Heterogeneous Repository Browser.
13-2
13.1.2.2 Installing the Heterogeneous Repository Browser on Heterogeneous Databases
and OC4J Servers 13-3
13.1.2.3 Creating Data Stores.................................................................................................. 13-3
13.1.3 Types of Auditing............................................................................................................. 13-3
13.1.4 List of Heterogeneous Repository Browser Reports ................................................... 13-4
13.1.5 Viewing Audit Reports.................................................................................................... 13-4
13.2 Opening the Repository Browser .......................................................................................... 13-5
13.2.1 Managing the Repository Browser Listener ................................................................. 13-5
13.2.2 Accessing the Repository Browser................................................................................. 13-6
13.2.3 Logging in to a Workspace.............................................................................................. 13-6
xviii
13.2.3.1 Connecting to an Oracle Database.......................................................................... 13-7
13.2.3.2 Connecting to a Heterogeneous Database or OC4J Server.................................. 13-7
13.3 Design Reports ......................................................................................................................... 13-7
13.3.1 Repository Navigator....................................................................................................... 13-7
13.3.2 Object Properties............................................................................................................... 13-8
13.3.3 Object Reports ................................................................................................................... 13-9
13.3.3.1 Summary Reports...................................................................................................... 13-9
13.3.3.2 Detailed Reports ...................................................................................................... 13-10
13.3.3.3 Implementation Reports......................................................................................... 13-11
13.3.3.4 Impact Analysis Reports......................................................................................... 13-11
13.3.4 Object Lineage................................................................................................................. 13-11
13.3.5 Object Impact................................................................................................................... 13-12
13.4 Control Center Reports ......................................................................................................... 13-12
13.4.1 Deployment Reports ...................................................................................................... 13-13
13.4.1.1 Deployment Schedule Report................................................................................ 13-13
13.4.1.2 Locations Report...................................................................................................... 13-14
13.4.1.3 Object Summary Report ......................................................................................... 13-15
13.4.1.4 Location Object Summary Report......................................................................... 13-15
13.4.1.5 Deployment Report................................................................................................. 13-15
13.4.1.6 Deployment Error Detail Report........................................................................... 13-16
13.4.2 Execution Reports........................................................................................................... 13-16
13.4.2.1 Execution Schedule Report .................................................................................... 13-16
13.4.2.2 Execution Summary Report................................................................................... 13-17
13.4.2.3 Execution Report ..................................................................................................... 13-17
13.4.2.4 Error Table Execution Report ................................................................................ 13-17
13.4.2.5 Execution Job Report............................................................................................... 13-17
13.4.2.6 Trace Report ............................................................................................................. 13-18
13.4.2.7 Job File Report.......................................................................................................... 13-18
13.4.2.8 Job Start Report........................................................................................................ 13-18
13.4.2.9 Job Error Diagnostic Report................................................................................... 13-19
13.4.3 Management Reports ..................................................................................................... 13-19
13.4.3.1 Service Node Report ............................................................................................... 13-19
13.4.3.2 Location Validation Report.................................................................................... 13-20
13.5 Common Repository Browser Tasks................................................................................... 13-20
13.5.1 Identifying Recently-Run Processes............................................................................. 13-20
13.5.2 Identifying Why a Process Run Failed ........................................................................ 13-20
13.5.3 Comparing Process Runs............................................................................................... 13-21
13.5.4 Discovering Why a Map Run Gave Unexpected Results ......................................... 13-21
13.5.5 Identifying Recently-Made Deployments................................................................... 13-21
13.5.6 Identifying the Data Objects That Are Deployed to a Specific Location................ 13-22
13.5.7 Identifying the Map Runs that Use a Specific Deployed Data Object .................... 13-22
13.5.8 Discovering the Default Deployment Time Settings of a Deployed Process......... 13-22
13.5.9 Rerunning a Process....................................................................................................... 13-22
13.5.10 Monitoring a Process Run ............................................................................................. 13-22
13.5.11 Terminating a Process Run............................................................................................ 13-23
13.5.12 Removing the Execution Audit Details for a Process................................................ 13-23
13.5.13 Removing Old Deployment Audit details.................................................................. 13-23
xix
13.5.14 Viewing Error Tables Created as a Result of Data Auditor Execution................... 13-23
13.5.15 Unregistering a Location ............................................................................................... 13-24
13.5.16 Updating Location Connection Details for a Changed Database Environment ... 13-24
13.5.17 Updating Service Node Details in a Changing Oracle RAC Environment............ 13-24
14 Managing Metadata Dependencies
14.1 About the Metadata Dependency Manager......................................................................... 14-1
14.1.1 Example: Lineage and Impact Analysis (LIA).............................................................. 14-1
14.1.2 About Lineage and Impact Analysis and Metadata Dependency Diagrams .......... 14-3
14.2 Opening an LIA Diagram ....................................................................................................... 14-4
14.3 Managing and Exploring Objects in an LIA Diagram........................................................ 14-4
14.3.1 Exploring Object Lineage and Impact in an LIA Diagram......................................... 14-4
14.3.2 Using Find to Search for Objects in an LIA Diagram.................................................. 14-5
14.3.3 Using Groups in an LIA Diagram.................................................................................. 14-5
14.3.3.1 Managing Groups in an LIA Diagram ................................................................... 14-6
14.3.4 Displaying an Object's Attributes................................................................................... 14-6
14.3.5 Exporting and Printing LIA Diagrams.......................................................................... 14-7
14.4 Making Changes to Design Metadata Using Automatic Change Propagation.............. 14-7
14.4.1 Automated Change Propagation in the Dependency Manager ................................ 14-8
15 Troubleshooting and Error Handling for ETL Designs
15.1 Inspecting Error Logs in Oracle Warehouse Builder......................................................... 15-1
15.1.1 Troubleshooting Validation Errors ................................................................................ 15-1
15.1.2 Troubleshooting Generation Errors............................................................................... 15-2
15.1.3 Troubleshooting Deployment and Execution Errors .................................................. 15-3
15.1.3.1 Determining the Operators that Caused Errors in Mappings ............................ 15-3
15.1.4 Troubleshooting Name and Address Server Errors.................................................... 15-4
15.2 Using DML Error Logging ..................................................................................................... 15-4
15.2.1 About DML Error Tables................................................................................................. 15-4
15.2.2 Enabling DML Error Logging......................................................................................... 15-5
15.2.2.1 DML Error Logging and ETL .................................................................................. 15-5
15.2.3 DML Error Logging Limitations .................................................................................... 15-6
15.3 Troubleshooting the ETL Process.......................................................................................... 15-6
15.3.1 ORA-04063 While Running Hybrid Maps .................................................................... 15-6
15.3.2 Agent Log Files ................................................................................................................. 15-6
15.3.3 Error Starting the Control Center Agent (CCA)........................................................... 15-7
15.3.4 Error Executing Web Services from the Secure Web Site ........................................... 15-7
15.3.5 REP-01012 While Deploying Mappings to a Target Schema...................................... 15-7
15.3.6 Unable to Delete a Location ............................................................................................ 15-8
16 Creating and Consuming Web Services in Oracle Warehouse Builder
16.1 Introduction to Web Services................................................................................................. 16-1
16.1.1 Advantages of Web Services........................................................................................... 16-2
16.1.2 About Web Services in Oracle Warehouse Builder ..................................................... 16-2
16.1.2.1 About Defining Web Services.................................................................................. 16-3
16.1.2.2 About Publishing Web Services .............................................................................. 16-3
xx
16.1.2.3 About Consuming Web Services............................................................................. 16-3
16.1.3 About Public Web Services ............................................................................................. 16-3
16.2 Publishing Oracle Warehouse Builder Objects as Web Services ...................................... 16-4
16.2.1 Creating Web Service Packages...................................................................................... 16-6
16.2.2 Creating Web Services Based on Oracle Warehouse Builder Objects....................... 16-6
16.2.2.1 Naming the Web Service.......................................................................................... 16-7
16.2.2.2 Defining the Web Service Implementation............................................................ 16-7
16.2.3 Validating Web Services.................................................................................................. 16-8
16.2.4 Generating Web Services................................................................................................. 16-8
16.2.5 Deploying Web Services.................................................................................................. 16-9
16.2.5.1 Deploying Web Services Using the Control Center Manager ............................ 16-9
16.2.5.2 Deploying Web Services Using the Design Center .............................................. 16-9
16.3 Creating Web Services Based on a URL ............................................................................. 16-10
16.3.1 Naming and Describing a Public Web Service........................................................... 16-11
16.4 Executing Web Services ........................................................................................................ 16-11
16.4.1 Using the Control Center Manager to Run Web Services ........................................ 16-11
16.4.2 Using a Browser to Run Web Services......................................................................... 16-12
16.4.3 Performing Operations on Web Services Using a Browser...................................... 16-13
16.4.3.1 Determining If a Web Service or Application Was Deployed to an OC4J Server.......
16-14
16.4.3.2 Executing a Control Center Job ............................................................................. 16-14
16.4.3.3 Terminating an Execution Job ............................................................................... 16-15
16.4.3.4 Running Deployed Applications........................................................................... 16-15
16.5 Using Web Services as Activities in Process Flows .......................................................... 16-16
16.5.1 Rules for Using Web Services in Process Flows......................................................... 16-16
16.5.2 Steps to Use Web Services in Process Flows............................................................... 16-16
16.5.3 Synchronizing Web Service Activities with Their Referenced Web Services........ 16-17
16.6 Using Web Services in Mappings........................................................................................ 16-17
16.7 Using Secure Sockets Layer (SSL) to Access Web Services Securely ............................. 16-19
16.7.1 J2EE Roles for Control Center Agent Security............................................................ 16-19
16.7.2 Setting Up Secure Access on External OC4J Servers................................................. 16-19
16.7.3 Updating the Key Store Password ............................................................................... 16-21
16.8 Case Study: Using Web Services for Data Integration ..................................................... 16-21
16.8.1 Example: Publishing Mappings as Web Services ...................................................... 16-21
16.8.2 Example: Consuming Web Services in Process Flows.............................................. 16-22
16.8.2.1 Modify the LOAD_TOT_SALES_CT_MAP Code Template (CT) Mapping .. 16-22
16.8.2.2 Import the Currency Converter Web Service...................................................... 16-22
16.8.2.3 Create a Process Flow That Consumes the Currency Converter Web Service............
16-23
16.8.3 Example: Integrating Oracle Warehouse Builder Web Services with Oracle BPEL
Process Manager 16-23
17 Moving Large Volumes of Data Using Transportable Modules
17.1 About Transportable Modules............................................................................................... 17-1
17.1.1 About Transportable Modules and Oracle Database Technology ............................ 17-4
17.2 Benefits of Using Transportable Modules............................................................................ 17-4
17.3 Instructions for Using Transportable Modules ................................................................... 17-5
剩余819页未读,继续阅读
2009-01-07 上传
2023-06-18 上传
2008-09-10 上传
2023-06-18 上传
2023-06-18 上传
2019-03-23 上传
weixin_40191861_zj
- 粉丝: 84
- 资源: 1万+
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
最新资源
- 高清艺术文字图标资源,PNG和ICO格式免费下载
- mui框架HTML5应用界面组件使用示例教程
- Vue.js开发利器:chrome-vue-devtools插件解析
- 掌握ElectronBrowserJS:打造跨平台电子应用
- 前端导师教程:构建与部署社交证明页面
- Java多线程与线程安全在断点续传中的实现
- 免Root一键卸载安卓预装应用教程
- 易语言实现高级表格滚动条完美控制技巧
- 超声波测距尺的源码实现
- 数据可视化与交互:构建易用的数据界面
- 实现Discourse外聘回复自动标记的简易插件
- 链表的头插法与尾插法实现及长度计算
- Playwright与Typescript及Mocha集成:自动化UI测试实践指南
- 128x128像素线性工具图标下载集合
- 易语言安装包程序增强版:智能导入与重复库过滤
- 利用AJAX与Spotify API在Google地图中探索世界音乐排行榜
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功