没有合适的资源?快使用搜索试试~ 我知道了~
首页Oracle数据库11g数据仓库建模指南
Oracle数据库11g数据仓库建模指南
需积分: 9 10 下载量 154 浏览量
更新于2024-08-02
收藏 7.6MB PDF 举报
"Oracle数据仓库建模主要集中在利用Oracle数据库技术构建高效的数据存储和分析环境。本资料详细探讨了在11g Release 1 (11.1)版本中的相关方法,包括UML模型和E-R模型的应用。文档由Paul Lane主笔,并有众多贡献者参与,覆盖了数据仓库建模的多个方面,如变更数据捕获等主题。"
在Oracle数据仓库建模中,数据仓库是用于存储和管理大量历史数据的系统,这些数据主要用于分析和决策支持。Oracle数据库因其稳定性和高性能而被广泛用于数据仓库项目。在11g Release 1版本中,Oracle提供了许多先进的特性,以支持大规模的数据集成、转换和查询。
1. **数据仓库设计**:设计阶段通常涉及到概念层、逻辑层和物理层的建模。概念层模型关注业务实体和关系,E-R模型在此阶段发挥关键作用,它描绘了实体、属性和实体间的关系。逻辑层模型进一步细化这些概念,而物理层模型则考虑数据库的实际结构,包括表空间、索引和分区策略。
2. **UML模型**:统一建模语言(UML)是一种标准化的建模工具,可以用来表示数据仓库的各种组件,如实体、关系、接口和流程。UML的类图和用例图在数据仓库设计中特别有用,它们帮助设计师可视化数据流和业务过程。
3. **变更数据捕获(CDC)**:在数据仓库环境中,变更数据捕获是跟踪和处理源系统中数据变化的重要技术。Oracle提供了多种CDC方法,如逻辑日志读取、触发器和API,以高效地获取并同步数据仓库与源系统的更新。
4. **分区技术**:Oracle数据库支持多种分区策略,如范围分区、列表分区、哈希分区和复合分区,这些技术有助于提高查询性能和管理大量数据的效率。
5. **维度建模**:数据仓库建模常采用星型或雪花型架构,其中维度表和事实表是核心组成部分。维度表描述业务实体,事实表记录业务事件或度量。
6. **性能优化**:Oracle提供索引、物化视图、并行查询和查询重写等机制来优化数据仓库的查询性能。此外,通过适当的硬件配置和数据库调优,可以进一步提升数据仓库的响应速度。
7. **数据集成**:Oracle Data Integrator (ODI) 是一个强大的工具,用于从各种异构数据源抽取、转换和加载(ETL)数据到数据仓库。它支持复杂的转换规则和调度,确保数据的质量和一致性。
8. **安全性**:在数据仓库环境中,数据安全和访问控制至关重要。Oracle提供了角色、权限和加密功能,以保护敏感信息并确保合规性。
9. **监控和维护**:Oracle Enterprise Manager提供了全面的监控和管理工具,帮助管理员监控数据仓库的性能、诊断问题并进行必要的维护操作。
10. **OLAP功能**:Oracle提供在线分析处理(OLAP)服务,如Oracle OLAP选项,允许用户执行多维分析和复杂计算,以获得深入的业务洞察。
Oracle数据仓库建模是一个综合的过程,涉及多种技术和策略,旨在创建一个能够高效处理大量数据、支持决策分析的系统。通过深入理解和应用这些知识点,可以构建出满足业务需求的高性能数据仓库。
xvi
Partition Join Syntax ..................................................................................................................... 21-40
Sample of Sparse Data.................................................................................................................. 21-41
Filling Gaps in Data ...................................................................................................................... 21-41
Filling Gaps in Two Dimensions................................................................................................. 21-42
Filling Gaps in an Inventory Table............................................................................................. 21-44
Computing Data Values to Fill Gaps ......................................................................................... 21-45
Time Series Calculations on Densified Data................................................................................. 21-46
Period-to-Period Comparison for One Time Level: Example ................................................ 21-47
Period-to-Period Comparison for Multiple Time Levels: Example....................................... 21-49
Creating a Custom Member in a Dimension: Example........................................................... 21-53
22 SQL for Modeling
Overview of SQL Modeling................................................................................................................ 22-1
How Data is Processed in a SQL Model ...................................................................................... 22-3
Why Use SQL Modeling?............................................................................................................... 22-3
SQL Modeling Capabilities............................................................................................................ 22-4
Basic Topics in SQL Modeling............................................................................................................ 22-7
Base Schema..................................................................................................................................... 22-7
MODEL Clause Syntax................................................................................................................... 22-8
Keywords in SQL Modeling........................................................................................................ 22-10
Assigning Values and Null Handling................................................................................. 22-10
Calculation Definition ........................................................................................................... 22-10
Cell Referencing ............................................................................................................................ 22-11
Symbolic Dimension References.......................................................................................... 22-11
Positional Dimension References ........................................................................................ 22-12
Rules................................................................................................................................................ 22-12
Single Cell References ........................................................................................................... 22-12
Multi-Cell References on the Right Side............................................................................. 22-12
Multi-Cell References on the Left Side................................................................................ 22-13
Use of the CV Function ......................................................................................................... 22-13
Use of the ANY Wildcard..................................................................................................... 22-14
Nested Cell References.......................................................................................................... 22-14
Order of Evaluation of Rules....................................................................................................... 22-14
Global and Local Keywords for Rules ....................................................................................... 22-15
UPDATE, UPSERT, and UPSERT ALL Behavior..................................................................... 22-16
UPDATE Behavior................................................................................................................. 22-16
UPSERT Behavior .................................................................................................................. 22-16
UPSERT ALL Behavior ......................................................................................................... 22-17
Treatment of NULLs and Missing Cells .................................................................................... 22-18
Distinguishing Missing Cells from NULLs........................................................................ 22-19
Use Defaults for Missing Cells and NULLs ....................................................................... 22-20
Using NULLs in a Cell Reference........................................................................................ 22-20
Reference Models.......................................................................................................................... 22-20
Advanced Topics in SQL Modeling................................................................................................. 22-23
FOR Loops...................................................................................................................................... 22-23
Evaluation of Formulas with FOR Loops........................................................................... 22-26
Iterative Models............................................................................................................................. 22-28
xvii
Rule Dependency in AUTOMATIC ORDER Models .............................................................. 22-29
Ordered Rules................................................................................................................................ 22-30
Analytic Functions ........................................................................................................................ 22-31
Unique Dimensions Versus Unique Single References........................................................... 22-32
Rules and Restrictions when Using SQL for Modeling........................................................... 22-33
Performance Considerations with SQL Modeling ....................................................................... 22-35
Parallel Execution.......................................................................................................................... 22-35
Aggregate Computation............................................................................................................... 22-36
Using EXPLAIN PLAN to Understand Model Queries.......................................................... 22-37
Using ORDERED FAST: Example....................................................................................... 22-37
Using ORDERED: Example.................................................................................................. 22-37
Using ACYCLIC FAST: Example ........................................................................................ 22-38
Using ACYCLIC: Example ................................................................................................... 22-38
Using CYCLIC: Example ...................................................................................................... 22-38
Examples of SQL Modeling .............................................................................................................. 22-39
23 OLAP and Data Mining
OLAP and Data Mining Comparison................................................................................................ 23-1
OLAP Overview..................................................................................................................................... 23-2
OLAP Technology in the Oracle Database.................................................................................. 23-2
Full Integration of Multidimensional Technology.............................................................. 23-2
Ease of Application Development......................................................................................... 23-2
Ease of Administration............................................................................................................ 23-2
Security...................................................................................................................................... 23-3
Unmatched Performance and Scalability............................................................................. 23-3
Reduced Costs .......................................................................................................................... 23-3
Querying Dimensional Objects ..................................................................................................... 23-4
Tools for Creating and Managing Dimensional Objects ........................................................... 23-4
24 Advanced Business Intelligence Queries
Examples of Business Intelligence Queries ..................................................................................... 24-1
25 Using Parallel Execution
Introduction to Parallel Execution Tuning ....................................................................................... 25-1
When to Implement Parallel Execution ....................................................................................... 25-2
When Not to Implement Parallel Execution ............................................................................... 25-2
Operations That Can Be Parallelized ........................................................................................... 25-2
How Parallel Execution Works ........................................................................................................... 25-3
Degree of Parallelism...................................................................................................................... 25-4
The Parallel Execution Server Pool............................................................................................... 25-4
Variations in the Number of Parallel Execution Servers.................................................... 25-5
Processing Without Enough Parallel Execution Servers.................................................... 25-5
How Parallel Execution Servers Communicate.......................................................................... 25-5
Parallelizing SQL Statements ........................................................................................................ 25-6
Dividing Work Among Parallel Execution Servers ............................................................ 25-6
Parallelism Between Operations............................................................................................ 25-8
xviii
Producer/Consumer Operations........................................................................................... 25-8
Granules of Parallelism .................................................................................................................. 25-9
Block Range Granules ........................................................................................................... 25-10
Partition Granules.................................................................................................................. 25-10
Types of Parallelism ............................................................................................................................ 25-10
Parallel Query................................................................................................................................ 25-10
Parallel Queries on Index-Organized Tables..................................................................... 25-11
Nonpartitioned Index-Organized Tables ........................................................................... 25-11
Partitioned Index-Organized Tables................................................................................... 25-11
Parallel Queries on Object Types......................................................................................... 25-11
Parallel DDL................................................................................................................................... 25-12
DDL Statements That Can Be Parallelized......................................................................... 25-12
CREATE TABLE ... AS SELECT in Parallel........................................................................ 25-13
Recoverability and Parallel DDL......................................................................................... 25-13
Space Management for Parallel DDL.................................................................................. 25-14
Storage Space When Using Dictionary-Managed Tablespaces....................................... 25-14
Free Space and Parallel DDL................................................................................................ 25-14
Parallel DML.................................................................................................................................. 25-15
Advantages of Parallel DML over Manual Parallelism.................................................... 25-16
When to Use Parallel DML................................................................................................... 25-16
Enabling Parallel DML.......................................................................................................... 25-17
Transaction Restrictions for Parallel DML......................................................................... 25-18
Rollback Segments................................................................................................................. 25-18
Recovery for Parallel DML................................................................................................... 25-18
Space Considerations for Parallel DML.............................................................................. 25-19
Locks for Parallel DML ......................................................................................................... 25-19
Restrictions on Parallel DML ............................................................................................... 25-19
Data Integrity Restrictions.................................................................................................... 25-20
Trigger Restrictions................................................................................................................ 25-21
Distributed Transaction Restrictions................................................................................... 25-21
Examples of Distributed Transaction Parallelization....................................................... 25-21
Parallel Execution of Functions................................................................................................... 25-21
Functions in Parallel Queries ............................................................................................... 25-22
Functions in Parallel DML and DDL Statements.............................................................. 25-22
Other Types of Parallelism .......................................................................................................... 25-22
Initializing and Tuning Parameters for Parallel Execution......................................................... 25-23
Using Default Parameter Settings...............................................................................................
25-24
Setting the Degree of Parallelism for Parallel Execution......................................................... 25-24
How Oracle Database Determines the Degree of Parallelism for Operations ..................... 25-25
Hints and Degree of Parallelism.......................................................................................... 25-25
Table and Index Definitions ................................................................................................. 25-26
Default Degree of Parallelism .............................................................................................. 25-26
Adaptive Multiuser Algorithm............................................................................................ 25-26
Minimum Number of Parallel Execution Servers............................................................. 25-26
Limiting the Number of Available Instances .................................................................... 25-27
Balancing the Workload............................................................................................................... 25-27
Parallelization Rules for SQL Statements.................................................................................. 25-28
xix
Rules for Parallelizing Queries ............................................................................................ 25-28
Rules for UPDATE, MERGE, and DELETE ....................................................................... 25-29
Rules for INSERT ... SELECT ............................................................................................... 25-30
Rules for DDL Statements .................................................................................................... 25-31
Rules for [CREATE | REBUILD] INDEX or [MOVE | SPLIT] PARTITION................ 25-31
Rules for CREATE TABLE AS SELECT.............................................................................. 25-31
Summary of Parallelization Rules ....................................................................................... 25-32
Enabling Parallelism for Tables and Queries............................................................................ 25-33
Degree of Parallelism and Adaptive Multiuser: How They Interact..................................... 25-34
How the Adaptive Multiuser Algorithm Works............................................................... 25-34
Forcing Parallel Execution for a Session.................................................................................... 25-34
Controlling Performance with the Degree of Parallelism....................................................... 25-35
Tuning General Parameters for Parallel Execution....................................................................... 25-35
Parameters Establishing Resource Limits for Parallel Operations ........................................ 25-35
PARALLEL_MAX_SERVERS .............................................................................................. 25-35
Increasing the Number of Concurrent Users..................................................................... 25-36
Limiting the Number of Resources for a User................................................................... 25-36
PARALLEL_MIN_SERVERS................................................................................................ 25-37
SHARED_POOL_SIZE.......................................................................................................... 25-37
Computing Additional Memory Requirements for Message Buffers............................ 25-38
Adjusting Memory After Processing Begins...................................................................... 25-39
PARALLEL_MIN_PERCENT .............................................................................................. 25-41
Parameters Affecting Resource Consumption.......................................................................... 25-41
PGA_AGGREGATE_TARGET ............................................................................................ 25-41
PARALLEL_EXECUTION_MESSAGE_SIZE.................................................................... 25-42
Parameters Affecting Resource Consumption for Parallel DML and Parallel DDL.... 25-42
Parameters Related to I/O........................................................................................................... 25-44
DB_CACHE_SIZE.................................................................................................................. 25-44
DB_BLOCK_SIZE................................................................................................................... 25-45
DB_FILE_MULTIBLOCK_READ_COUNT ....................................................................... 25-45
DISK_ASYNCH_IO and TAPE_ASYNCH_IO.................................................................. 25-45
Monitoring and Diagnosing Parallel Execution Performance ................................................... 25-45
Is There Regression? ..................................................................................................................... 25-46
Is There a Plan Change? ............................................................................................................... 25-47
Is There a Parallel Plan? ............................................................................................................... 25-47
Is There a Serial Plan?................................................................................................................... 25-47
Is There Parallel Execution?......................................................................................................... 25-47
Is the Workload Evenly Distributed?......................................................................................... 25-48
Monitoring Parallel Execution Performance with Dynamic Performance Views ............... 25-48
V$PX_BUFFER_ADVICE...................................................................................................... 25-48
V$PX_SESSION......................................................................................................................
25-49
V$PX_SESSTAT...................................................................................................................... 25-49
V$PX_PROCESS..................................................................................................................... 25-49
V$PX_PROCESS_SYSSTAT.................................................................................................. 25-49
V$PQ_SESSTAT ..................................................................................................................... 25-49
V$FILESTAT........................................................................................................................... 25-49
V$PARAMETER .................................................................................................................... 25-50
xx
V$PQ_TQSTAT ...................................................................................................................... 25-50
V$SESSTAT and V$SYSSTAT .............................................................................................. 25-50
Monitoring Session Statistics....................................................................................................... 25-51
Monitoring System Statistics ....................................................................................................... 25-52
Monitoring Operating System Statistics.................................................................................... 25-53
Affinity and Parallel Operations...................................................................................................... 25-53
Affinity and Parallel Queries....................................................................................................... 25-53
Affinity and Parallel DML ........................................................................................................... 25-54
Miscellaneous Parallel Execution Tuning Tips ............................................................................. 25-54
Setting Buffer Cache Size for Parallel Operations.................................................................... 25-55
Overriding the Default Degree of Parallelism .......................................................................... 25-55
Rewriting SQL Statements........................................................................................................... 25-55
Creating and Populating Tables in Parallel............................................................................... 25-55
Creating Temporary Tablespaces for Parallel Sort and Hash Join ........................................ 25-56
Size of Temporary Extents.................................................................................................... 25-57
Executing Parallel SQL Statements............................................................................................. 25-57
Using EXPLAIN PLAN to Show Parallel Operations Plans................................................... 25-57
Additional Considerations for Parallel DML............................................................................ 25-58
PDML and Direct-Path Restrictions.................................................................................... 25-58
Limitation on the Degree of Parallelism............................................................................. 25-58
Using Local and Global Striping.......................................................................................... 25-58
Increasing INITRANS ........................................................................................................... 25-59
Limitation on Available Number of Transaction Free Lists for Segments .................... 25-59
Using Multiple Archivers ..................................................................................................... 25-59
Database Writer Process (DBWn) Workload..................................................................... 25-59
[NO]LOGGING Clause......................................................................................................... 25-60
Creating Indexes in Parallel......................................................................................................... 25-60
Parallel DML Tips ......................................................................................................................... 25-61
Parallel DML Tip 1: INSERT ................................................................................................ 25-61
Parallel DML Tip 2: Direct-Path INSERT ........................................................................... 25-62
Parallel DML Tip 3: Parallelizing INSERT, MERGE, UPDATE, and DELETE............. 25-62
Incremental Data Loading in Parallel ........................................................................................ 25-63
Updating the Table in Parallel ............................................................................................. 25-64
Inserting the New Rows into the Table in Parallel ........................................................... 25-64
Merging in Parallel ................................................................................................................ 25-64
Glossary
Index
剩余583页未读,继续阅读
2018-04-08 上传
2021-03-05 上传
2022-09-24 上传
2010-03-26 上传
2008-04-11 上传
2012-08-08 上传
2009-08-14 上传
2011-05-05 上传
korry520
- 粉丝: 7
- 资源: 7
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
最新资源
- Java集合ArrayList实现字符串管理及效果展示
- 实现2D3D相机拾取射线的关键技术
- LiveLy-公寓管理门户:创新体验与技术实现
- 易语言打造的快捷禁止程序运行小工具
- Microgateway核心:实现配置和插件的主端口转发
- 掌握Java基本操作:增删查改入门代码详解
- Apache Tomcat 7.0.109 Windows版下载指南
- Qt实现文件系统浏览器界面设计与功能开发
- ReactJS新手实验:搭建与运行教程
- 探索生成艺术:几个月创意Processing实验
- Django框架下Cisco IOx平台实战开发案例源码解析
- 在Linux环境下配置Java版VTK开发环境
- 29街网上城市公司网站系统v1.0:企业建站全面解决方案
- WordPress CMB2插件的Suggest字段类型使用教程
- TCP协议实现的Java桌面聊天客户端应用
- ANR-WatchDog: 检测Android应用无响应并报告异常
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功