深入理解Linux虚拟内存管理

5星 · 超过95%的资源需积分: 10 81 浏览量更新于2024-07-30 1 收藏 8.32MB PDF 举报

"理解Linux虚拟内存管理" 《理解Linux虚拟内存管理》是Bruce Perens的开源系列书籍之一，作者是Mel Gorman。这本书深入探讨了Linux内核中的虚拟内存管理系统，这是操作系统核心的重要组成部分，对系统性能和稳定性起着关键作用。在Linux中，虚拟内存管理（VMM）是一个复杂而精巧的机制，它负责为进程分配和管理内存资源。这个系统允许每个进程都有自己的独立地址空间，即使这些进程可能共享物理内存。以下是一些关键知识点： 1. **分页与分段**：Linux VMM使用分页机制来映射物理内存到虚拟内存。分页将内存划分为固定大小的块，称为页面。同时，分段允许将内存组织成逻辑段，每个段有自己的地址空间，但Linux内核主要依赖分页。 2. **内存分配**：内核通过slab分配器来高效地分配和回收内存。slab分配器预先分配并缓存了不同类型的内存对象，以减少内存碎片和提高分配速度。 3. **交换与交换空间**：当物理内存不足时，VMM会将不活跃的页面写入磁盘上的交换空间，释放物理内存供其他进程使用。这个过程称为交换，可以缓解内存压力，但会增加I/O负载。 4. **内存压缩**：Linux内核还支持内存压缩技术，将不活跃的页面进行压缩，以减少交换到磁盘的需要，从而提高系统性能。 5. **内存访问权限**：VMM控制对页面的读、写和执行权限，以保护系统的安全和稳定。例如，内核页面通常标记为只读和不可执行，防止恶意代码修改或执行。 6. **页表与地址转换**：每个进程有自己的页表，用于记录虚拟地址到物理地址的映射。页表由多级组成，如在x86架构中，通常有四级页表，以支持更大的地址空间。 7. **内存调页策略**：Linux使用多种算法（如LRU - 最近最少使用）来决定何时将页面交换到磁盘，以及何时将页面从磁盘回换到内存。 8. **物理内存管理**：除了虚拟内存，VMM还需要管理物理内存，包括内存分配、回收和空闲列表维护，以优化物理内存的使用。 9. **内存故障处理**：当进程试图访问未映射的地址时，会发生页故障。VMM捕获这个异常，然后根据需要分配新的页面或进行页面替换。 10. **内存缓存与缓冲区**：Linux内核利用内存缓存（如文件系统缓存和缓冲区）来提高数据读取和写入的速度。VMM需要协调这些缓存与进程内存的需求。《理解Linux虚拟内存管理》详细阐述了这些概念，以及如何通过调整内核参数和工具来优化内存管理，对于Linux系统管理员和开发者来说，是一本宝贵的参考资料。

xvi Preface

• A live version of CodeViz, the tool used to generate call graphs for the book,

is available. If you feel that the book’s graphs are lacking some detail you

want,generate them yourself.

• The VMRegress, CodeViz and PatchSet packages, which are discussed

in Chapter 1, are available in /cdrom/software. gcc-3.0.4 is also provided

because it is required for building CodeViz.

Mount the CD on /cdrom as follows:

root@joshua:/$ mount /dev/cdrom /cdrom -o exec

The Web server is Apache 1.3.27 (http://www.apache.org/)andhas been built

and conﬁgured to run with its root as /cdrom/.Ifyour distribution normally uses

another directory, you will need to use this one instead. To start it, run the script

/cdrom/start

server.Ifnoerrors occur, the output should look like:

mel@joshua:~$ /cdrom/start_server

Starting CodeViz Server: done

Starting Apache Server: done

The URL to access is http://localhost:10080/

When the server starts successfully, point your browser to http://localhost:10080

to avail of the CD’s Web services. To shut down the server, run the script

/cdrom/stop

server,andtheCDmay then be unmounted.

Typographic Conventions

The conventions used in this document are simple. New concepts that are in-

troduced, as well as URLs, are in italicized font. Binaries and package names

are in bold.Structures, ﬁeld names, compile time deﬁnes and variables are in a

constant-width font. At times, when talking about a ﬁeld in a structure, both the

structure and ﬁeld name will be included as page→list,forexample. File names

are in a constant-width font, but include ﬁles have angle brackets around them like

<linux/mm.h> and may be found in the include/ directory of the kernel source.

Acknowledgments

The compilation of this book was not a trivial task. This book was researched and

developed in the open, and I would be remiss not to mention some of the people

who helped me at various intervals. If there is anyone I missed, I apologize now.

First, I would like to thank John O’Gorman, who tragically passed away while

the material for this book was being researched. His experience and guidance largely

inspired the format and quality of this book.

Second, I would like to thank Mark L. Taub from Prentice Hall PTR for giving

me the opportunity to publish this book. It has been a rewarding experience and

Preface xvii

made trawling through all the code worthwhile. Massive thanks go to my reviewers,

who provided clear and detailed feedback long after I thought I had ﬁnished writing.

Finally, on the publisher’s front, I would like to thank Bruce Perens for allowing me

to publish in the Bruce Perens’ Open Source Series (http://www.perens.com/Books).

With the technical research, a number of people provided invaluable insight.

Abhishek Nayani was a source of encouragement and enthusiasm early in the re-

search. Ingo Oeser kindly provided invaluable assistance early on with a detailed

explanation of how data is copied from userspace to kernel space, and he included

some valuable historical context. He also kindly oﬀered to help me if I felt I ever got

lost in the twisty maze of kernel code. Scott Kaplan made numerous corrections to

anumber of systems from noncontiguous memory allocation to page replacement

policy. Jonathon Corbet provided the most detailed account of the history of kernel

development with the kernel page he writes for Linux Weekly News. Zack Brown,

the chief behind Kernel Traﬃc, is the sole reason I did not drown in kernel-related

mail. IBM, as part of the Equinox Project, provided an xSeries 350, which was in-

valuable for running my own test kernels on machines larger than those I previously

had access to. Late in the game, Jeﬀrey Haran found the few remaining technical

corrections and more of the ever-present grammar errors. Most importantly, I’m

grateful for his enlightenment on some PPC issues. Finally, Patrick Healy was cru-

cial to ensuring that this book was consistent and approachable to people who are

familiar with, but not experts on, Linux or memory management.

Anumber of people helped with smaller technical issues and general inconsisten-

cies where material was not covered in suﬃcient depth. They are Muli Ben-Yehuda,

Parag Sharma, Matthew Dobson, Roger Luethi, Brian Lowe and Scott Crosby. All

of them sent corrections and queries on diﬀerent parts of the document, which

ensured that too much prior knowledge was not assumed.

Carl Spalletta sent a number of queries and corrections to every aspect of the

book in its earlier online form. Steve Greenland sent a large number of grammar

corrections. Philipp Marek went above and beyond being helpful by sending more

than 90 separate corrections and queries on various aspects. Long after I thought

Iwas ﬁnished, Aris Sotiropoulos sent a large number of small corrections and sug-

gestions. The last person, whose name I cannot remember, but is an editor for a

magazine, sent me more than 140 corrections to an early version. You know who

you are. Thanks.

Eleven people sent a few corrections. Though small, they were still missed

by several of myownchecks. They are Marek Januszewski, Amit Shah, Adrian

Stanciu, Andy Isaacson, Jean Francois Martinez, Glen Kaukola, Wolfgang Oertl,

Michael Babcock, Kirk True, Chuck Luciano and David Wilson.

On the development of VMRegress, nine people helped me keep it together.

Danny Faught and Paul Larson both sent me a number of bug reports and helped

ensure that VMRegress worked with a variety of diﬀerent kernels. Cliﬀ White, from

the OSDL labs, ensured that VMRegress would have a wider application than my

owntest box. Dave Olien, also associated with the OSDL labs, was responsible for

updating VMRegress to work with 2.5.64 and later kernels. Albert Cahalan sent

all the information I needed to make VMRegress function against later proc utilities.

Finally, Andrew Morton, Rik van Riel and Scott Kaplan all provided insight on the

CHAPTER

Introduction

Linux is a relatively new operating system that has begun to enjoy a lot of attention

from the business, academic and free software worlds. As the operating system

matures, its feature set, capabilities and performance grow, but so, out of necessity

does its size and complexity. Table 1.1 shows the size of the kernel source code in

bytes and lines of code of the mm/ part of the kernel tree. This size does not include

the machine-dependent code or any of the buﬀer management code and does not

even pretend to be an accurate metric for complexity, but it still serves as a small

indicator.

Version Release Date Total Size Size of mm/ Line Count

1.0 March 13, 1992 5.9MiB 96KiB 3,109

1.2.13 February 8, 1995 11MiB 136KiB 4,531

2.0.39 January 9, 2001 35MiB 204KiB 6,792

2.2.22 September 16, 2002 93MiB 292KiB 9,554

2.4.22 August 25, 2003 181MiB 436KiB 15,724

2.6.0-test4 August 22, 2003 261MiB 604KiB 21,714

Table 1.1. Kernel Size as an Indicator of Complexity

Out of habit, open source developers tell new developers with questions to refer

directly to the source with the “polite” acronym RTFS

,orrefer them to the kernel

newbies mailing list (http://www.kernelnewbies.org). With the Linux VM manager,

this used to be a suitable response because the time required to understand the VM

could be measured in weeks. Moreover, the books available devoted enough time

to the memory management chapters to make the relatively small amount of code

easy to navigate.

The books that describe the operating system such as Understanding the Linux

Kernel [BC00] [BC03] tend to cover the entire kernel rather than one topic with the

notable exception of device drivers [RC01]. These books, particularly Understanding

the Linux Kernel,provideinvaluable insight into kernel internals, but they miss the

details that are speciﬁc to the VM and not of general interest. But the book you are

holding details why ZONE

NORMAL is exactly 896MiB and exactly how per-cpu caches

Read The Flaming Source. It doesn’t really stand for Flaming, but children could be reading.

2 Introduction Chapter 1

are implemented. Other aspects of the VM, such as the boot memory allocator and

the VM ﬁlesystem, which are not of general kernel interest, are also covered in this

book.

Increasingly, to get a comprehensive view on how the kernel functions, one is

required to read through the source code line by line. This book tackles the VM

speciﬁcally so that this investment of time to understand the kernel functions will

be measured in weeks and not months. The details that are missed by the main

part of the book are caught by the code commentary.

In this chapter, there will be an informal introduction to the basics of acquiring

information on an open source project and some methods for managing, browsing

and comprehending the code. If you do not intend to be reading the actual source,

you may skip to Chapter 2.

1.1 Getting Started

One of the largest initial obstacles to understanding code is deciding where to start

and how to easily manage, browse and get an overview of the overall code structure.

If requested on mailing lists, people will provide some suggestions on how to proceed,

but a comprehensive methodology is rarely oﬀered aside from suggestions to keep

reading the source until it makes sense. The following sections introduce some useful

rules of thumb for open source code comprehension and speciﬁc guidelines for how

the rules may be applied to the kernel.

1.1.1 Conﬁguration and Building

With any open source project, the ﬁrst step is to download the source and read

the installation documentation. By convention, the source will have a README or

INSTALL ﬁle at the top level of the source tree [FF02]. In fact, some automated

build tools such as automake require the install ﬁle to exist. These ﬁles contain

instructions for conﬁguring and installing the package or give a reference to where

more information may be found. Linux is no exception because it includes a README

that describes how the kernel may be conﬁgured and built.

The second step is to build the software. In earlier days, the requirement for

many projects was to edit the Makefile by hand, but this is rarely the case now.

Free software usually uses at least autoconf

to automate testing of the build

environment and automake

to simplify the creation of Makefiles, so building is

often as simple as:

mel@joshua: project $ ./configure && make

Some older projects, such as the Linux kernel, use their own conﬁguration tools,

and some large projects such as the Apache Web server have numerous conﬁguration

options, but usually the conﬁgure script is the starting point. In the case of the

http://www.gnu.org/software/autoconf/

http://www.gnu.org/software/automake/

剩余747页未读，继续阅读

autumnsparrow

粉丝: 0
资源: 11

深入理解Linux虚拟内存管理

PRENTICE_HALL-CPP_Gui_Programming_With_Qt3.2.pdf

[Linux英文原版图书系列].PRENTICE_HALL-Optimizing_Linux_Performance_A_Hands_On_Guide_To_Linux_Performance_Tools.chm

Linux英文原版图书系列].PRENTICE_HALL-A_Practical_Guide_To_Linux_Commands_Editors_And_Shell_Programming.chm

Fundamentals_of_Embedded_Software_-_Where_C_and_Assembly_Meet_(Prentice_Hall-2002).djvu

PRENTICE_HALL-Thinking_In_Python.pdf

[Linux英文原版图书系列].PRENTICE_HALL-Linux_Debugging_and_Performance_Tuning_Tips_and_Techniques.part2

[Linux英文原版图书系列].PRENTICE_HALL-Samba3_by_Example_Practical_Exercises_to_Successful_Deployment_Second_Edition.chm

Akira_Ishimaru-Electromagnetic_wave_propagation,_radiation,_and_scattering-Prentice_Hall(1990).djvu

Prentice_Hall_-_Core_Swing._Advanced_Programming.chm

C程序设计语言(英文第2版)Prentice_Hall.-.The_C_Programming_Language(2nd_Edition).pdf

最新资源