没有合适的资源?快使用搜索试试~ 我知道了~
首页Lustre 2.x分布式文件系统集群操作手册概述
Lustre 2.x分布式文件系统集群操作手册概述
需积分: 10 6 下载量 110 浏览量
更新于2024-07-21
收藏 2MB PDF 举报
Lustre是一款专为高性能计算和大数据环境设计的分布式文件系统,尤其适用于集群环境。本手册——Lustre Software Release 2.x Operations Manual,是针对这一版本的操作指南,由Oracle公司及其关联方在2010年和2011年原创,并经Intel在2011年至2013年间对其进行了修改。尽管Intel对原版手册进行了定制,但Oracle及其关联方仍保留了未修改部分的版权。 手册的核心内容涵盖了Lustre分布式文件系统的安装、配置、管理和维护等操作,包括但不限于:如何搭建Lustre集群,数据的高效读写策略,元数据管理,以及故障恢复和性能调优等关键知识点。用户可以从中学习到关于Lustre的架构、数据分布、复制策略以及与硬件和网络的交互方式。 值得注意的是,该手册中的信息仅用于Intel产品相关联,除非另有明确条款,否则不构成对Intel知识产权的许可,也不包括任何默示或明示的保修声明,特别是关于特定用途的适配性。这意味着在购买和使用Intel产品时,用户应查阅Intel的销售条款和条件,以了解可能的法律责任和保修范围。 对于想要深入理解并有效使用Lustre 2.x的管理员和技术人员来说,这份手册是一份不可或缺的参考资料,它详细阐述了如何在分布式环境中实现高效的文件共享,以及如何应对可能出现的问题,确保系统的稳定性和性能。阅读和遵循手册中的指导,有助于提升数据中心的运营效率和数据安全性。
资源详情
资源推荐
Lustre
*
Software Release 2.x
xvi
37.17.3. Output ....................................................................................... 365
37.17.4. Example .................................................................................... 366
37.17.5. Files .......................................................................................... 366
37.18. tunefs.lustre .......................................................................................... 366
37.18.1. Synopsis .................................................................................... 366
37.18.2. Description ................................................................................. 366
37.18.3. Options ...................................................................................... 367
37.18.4. Examples ................................................................................... 368
37.18.5. See Also .................................................................................... 368
37.19. Additional System Configuration Utilities ................................................... 369
37.19.1. Application Profiling Utilities ........................................................ 369
37.19.2. More /proc Statistics for Application Profiling .................................. 369
37.19.3. Testing / Debugging Utilities ......................................................... 370
37.19.4. Flock Feature .............................................................................. 373
Glossary ........................................................................................................................ 374
Index ............................................................................................................................ 381
xvii
List of Figures
1.1. Lustre file system components in a basic cluster ................................................................ 5
1.2. Lustre cluster at scale ................................................................................................... 7
1.3. Layout EA on MDT pointing to file data on OSTs ............................................................. 9
1.4. Lustre client requesting file data ..................................................................................... 9
1.5. File striping on a Lustre file system ............................................................................... 11
3.1. Lustre failover configuration for a active/passive MDT ...................................................... 16
3.2. Lustre failover configuration for a active/active MDTs ...................................................... 17
3.3. Lustre failover configuration for an OSTs ....................................................................... 17
22.1. Overview of the Lustre file system HSM ..................................................................... 154
xviii
List of Tables
1.1. Lustre File System Scalability and Performance ................................................................. 3
1.2. Storage and hardware requirements for Lustre file system components .................................... 7
5.1. Inode Ratios Used for Newly Formatted OSTs ................................................................. 25
5.2. File and file system limits ............................................................................................ 26
8.1. Lustre Test Matrix ...................................................................................................... 43
8.2. Packages Installed on Lustre Servers .............................................................................. 43
8.3. Packages Installed on Lustre Clients .............................................................................. 44
8.4. Network Types Supported by Lustre LNDs ..................................................................... 44
10.1. Default stripe pattern ................................................................................................. 63
xix
Preface
The Lustre
*
Software Release 2.x Operations Manual provides detailed information and procedures to
install, configure and tune a Lustre file system. The manual covers topics such as failover, quotas, striping,
and bonding. This manual also contains troubleshooting information and tips to improve the operation and
performance of a Lustre file system.
1. About this Document
This document is maintained by Intel in Docbook format. The canonical version is available at http://
wiki.hpdd.intel.com/display/PUB/Documentation.
1.1. UNIX
*
Commands
This document may not contain information about basic UNIX
*
operating system commands and proce-
dures such as shutting down the system, booting the system, and configuring devices. Refer to the follow-
ing for this information:
• Software documentation that you received with your system
• Red Hat
*
Enterprise Linux
*
documentation, which is at: http://docs.redhat.com/docs/en-US/index.html
Note
The Lustre client module is available for many different Linux
*
versions and distributions.
The Red Hat Enterprise Linux distribution is the best supported and tested platform for Lustre
servers.
1.2. Shell Prompts
Shell Prompt
C shell machine-name%
C shell superuser machine-name#
Bourne shell and Korn shell $
Bourne shell and Korn shell superuser #
1.3. Related Documentation
Application Title Format Location
Latest information Lustre Software Release
2.x Change Logs
Wiki page Online at http://
wiki.hpdd.intel.com/display/PUB/
Documentation
Service Lustre Software Release
2.x Operations Manual
PDF
HTML
Online at http://
wiki.hpdd.intel.com/display/PUB/
Documentation
1.4. Documentation, Support, and Training
These web sites provide additional resources:
Preface
xx
• Documentation http://wiki.hpdd.intel.com/display/PUB/Documentation
• Support http://www.hpdd.intel.com/
• Training http://www.hpdd.intel.com/
2. Revisions
The Lustre* File System Release 2.x Operations Manual is a community maintained work. Versions of the
manual are continually built as suggestions for changes and improvements arrive. Suggestions for improve-
ments can be submitted through the ticketing system maintained at https://jira.hpdd.intel.com/browse/
LUDOC [http://jira.hpdd.intel.com/browse/LUDOC]. Instructions for providing a patch to the existing
manual are available at: https://wiki.hpdd.intel.com/display/PUB/Making+changes+to+the+Lustre+Man-
ual+source.
This manual currently covers all the 2.x Lustre software releases. Features that are specific to individual
releases are identified within the table of contents using a short hand notation (i.e. 'L24' is a Lustre software
release 2.4 specific feature), and within the text using a distinct box. For example:
Introduced in Lustre 2.4
Lustre software release version 2.4 includes support for multiple metadata servers.
Only the latest revision of this document is made readily available because changes are continually
arriving. The current and latest revision of this manual is available from links maintained at: http://
lustre.opensfs.org/documentation/.
Revision History
Revision 0 Built on 26 Febru-
ary 2015 12:19:05-08:00
Intel Corporation
Continuous build of Manual.
剩余404页未读,继续阅读
Tom_webex
- 粉丝: 0
- 资源: 2
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
最新资源
- 前端面试必问:真实项目经验大揭秘
- 永磁同步电机二阶自抗扰神经网络控制技术与实践
- 基于HAL库的LoRa通讯与SHT30温湿度测量项目
- avaWeb-mast推荐系统开发实战指南
- 慧鱼SolidWorks零件模型库:设计与创新的强大工具
- MATLAB实现稀疏傅里叶变换(SFFT)代码及测试
- ChatGPT联网模式亮相,体验智能压缩技术.zip
- 掌握进程保护的HOOK API技术
- 基于.Net的日用品网站开发:设计、实现与分析
- MyBatis-Spring 1.3.2版本下载指南
- 开源全能媒体播放器:小戴媒体播放器2 5.1-3
- 华为eNSP参考文档:DHCP与VRP操作指南
- SpringMyBatis实现疫苗接种预约系统
- VHDL实现倒车雷达系统源码免费提供
- 掌握软件测评师考试要点:历年真题解析
- 轻松下载微信视频号内容的新工具介绍
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功