Java NIO：提升效率的新一代I/O技术

需积分: 10 87 浏览量更新于2024-07-27 收藏 2.93MB PDF 举报

"Java NIO（O'Reilly）——由Ron Hitchens著，O'Reilly出版社于2002年8月出版的PDF书籍，详细介绍了Java 1.4版本中的新I/O功能，并展示了如何利用这些特性提升Java代码的效率。书中通过探讨常见的I/O问题和示例，阐述了新特性的实际应用对响应性、可扩展性和可靠性的直接影响。由于NIO API是对1.3版本I/O功能的补充而非替代，读者还将了解到何时使用新的API，以及在何种情况下1.3版本的I/O API更适合特定的应用场景。" Java NIO，即Non-Blocking I/O，是Java平台中的一个重要组成部分，自Java 1.4版本引入，用于替代传统的Java IO API，提供了更高效的数据传输方式。这本书深入浅出地讲解了Java NIO的相关概念和实践，旨在帮助Java开发者更好地理解和利用这一强大的工具。在"Introduction"章节中，作者首先阐述了I/O与CPU时间的关系，指出传统的I/O操作往往是阻塞式的，这在处理大量并发连接时可能会导致CPU资源的浪费。随着Java NIO的引入，程序可以不再被I/O操作阻塞，从而提高了系统的整体性能。1.2节中提到，通过使用非阻塞I/O，Java程序不再受限于CPU，能够更好地处理I/O密集型任务。1.3节则预告了后续章节将展示如何进入Java NIO的精彩世界，学习如何解决实际I/O问题。最后，1.4节开始介绍I/O的基本概念，为后续深入学习Java NIO奠定了基础。 Java NIO的核心组件包括选择器（Selectors）、通道（Channels）和缓冲区（Buffers）。选择器允许单线程管理多个通道，从而提高了多路复用的能力；通道提供了双向数据传输的可能性，而缓冲区则提供了一种高效的数据存取方式，避免了频繁的系统调用。此外，NIO还支持文件的随机读写、异步I/O等特性。书中通过具体的例子和问题分析，指导读者如何有效地利用这些组件来优化应用程序。例如，对于网络编程，NIO可以显著提升服务器处理客户端请求的能力，特别适合高并发的场景，如聊天服务器或大型网络游戏服务器。而对于文件操作，NIO提供了更灵活的方式，尤其是在大数据处理和流媒体服务中。《Java NIO》这本书是Java开发者深入理解并掌握NIO技术的重要参考资料，无论你是刚接触NIO的新手还是寻求优化现有系统的有经验开发者，都能从中获益匪浅。通过学习这本书，你可以提升你的Java代码在处理I/O操作时的效率和灵活性，使你的应用程序更具竞争力。

Java NIO

1.3 Getting to the Good Stuff

Most of the development effort that goes into operating systems is targeted at improving I/O

performance. Lots of very smart people toil very long hours perfecting techniques for

schlepping data back and forth. Operating-system vendors expend vast amounts of time and

money seeking a competitive advantage by beating the other guys in this or that published

benchmark.

Today's operating systems are modern marvels of software engineering (OK, some are more

marvelous than others), but how can the Java programmer take advantage of all this wizardry

and still remain platform-independent? Ah, yet another example of the TANSTAAFL

principle.

The JVM is a double-edged sword. It provides a uniform operating environment that shelters

the Java programmer from most of the annoying differences between operating-system

environments. This makes it faster and easier to write code because platform-specific

idiosyncrasies are mostly hidden. But cloaking the specifics of the operating system means

that the jazzy, wiz-bang stuff is invisible too.

What to do? If you're a developer, you could write some native code using the Java Native

Interface (JNI) to access the operating-system features directly. Doing so ties you to a specific

operating system (and maybe a specific version of that operating system) and exposes the

JVM to corruption or crashes if your native code is not 100% bug free. If you're an operating-

system vendor, you could write native code and ship it with your JVM implementation to

provide these features as a Java API. But doing so might violate the license you signed to

provide a conforming JVM. Sun took Microsoft to court about this over the JDirect package

which, of course, worked only on Microsoft systems. Or, as a last resort, you could turn to

another language to implement performance-critical applications.

The

java.nio

package provides new abstractions to address this problem. The Channel and

Selector classes in particular provide generic APIs to I/O services that were not reachable

prior to JDK 1.4. The TANSTAAFL principle still applies: you won't be able to access every

feature of every operating system, but these new classes provide a powerful new framework

that encompasses the high-performance I/O features commonly available on commercial

operating systems today. Additionally, a new Service Provider Interface (SPI) is provided in

java.nio.channels.spi

that allows you to plug in new types of channels and selectors

without violating compliance with the specifications.

With the addition of NIO, Java is ready for serious business, entertainment, scientific and

academic applications in which high-performance I/O is essential.

The JDK 1.4 release contains many other significant improvements in addition to NIO. As of

1.4, the Java platform has reached a high level of maturity, and there are few application areas

remaining that Java cannot tackle. A great guide to the full spectrum of JDK features in 1.4 is

Java In A Nutshell, Fourth Edition by David Flanagan (O'Reilly).

There Ain't No Such Thing As A Free Lunch.

Java NIO

1.4 I/O Concepts

The Java platform provides a rich set of I/O metaphors. Some of these metaphors are more

abstract than others. With all abstractions, the further you get from hard, cold reality,

the tougher it becomes to connect cause and effect. The NIO packages of JDK 1.4 introduce

a new set of abstractions for doing I/O. Unlike previous packages, these are focused on

shortening the distance between abstraction and reality. The NIO abstractions have very real

and direct interactions with real-world entities. Understanding these new abstractions and, just

as importantly, the I/O services they interact with, is key to making the most of I/O-intensive

Java applications.

This book assumes that you are familiar with basic I/O concepts. This section provides

a whirlwind review of some basic ideas just to lay the groundwork for the discussion of how

the new NIO classes operate. These classes model I/O functions, so it's necessary to grasp

how things work at the operating-system level to understand the new I/O paradigms.

In the main body of this book, it's important to understand the following topics:

•

Buffer handling

• Kernel versus user space

• Virtual memory

• Paging

• File-oriented versus stream I/O

•

Multiplexed I/O (readiness selection)

1.4.1 Buffer Handling

Buffers, and how buffers are handled, are the basis of all I/O. The very term "input/output"

means nothing more than moving data in and out of buffers.

Processes perform I/O by requesting of the operating system that data be drained from

a buffer (write) or that a buffer be filled with data (read). That's really all it boils down to. All

data moves in or out of a process by this mechanism. The machinery inside the operating

system that performs these transfers can be incredibly complex, but conceptually, it's very

straightforward.

Figure 1-1 shows a simplified logical diagram of how block data moves from an external

source, such as a disk, to a memory area inside a running process. The process requests that

its buffer be filled by making the read( ) system call. This results in the kernel issuing

a command to the disk controller hardware to fetch the data from disk. The disk controller

writes the data directly into a kernel memory buffer by DMA without further assistance from

the main CPU. Once the disk controller finishes filling the buffer, the kernel copies the data

from the temporary buffer in kernel space to the buffer specified by the process when it

requested the read( ) operation.

Java NIO

Figure 1-1. Simplified I/O buffer handling

This obviously glosses over a lot of details, but it shows the basic steps involved.

Note the concepts of user space and kernel space in Figure 1-1. User space is where regular

processes live. The JVM is a regular process and dwells in user space. User space is

a nonprivileged area: code executing there cannot directly access hardware devices, for

example. Kernel space is where the operating system lives. Kernel code has special privileges:

it can communicate with device controllers, manipulate the state of processes in user space,

etc. Most importantly, all I/O flows through kernel space, either directly (as decsribed here) or

indirectly (see Section 1.4.2).

When a process requests an I/O operation, it performs a system call, sometimes known as

a trap, which transfers control into the kernel. The low-level open( ), read( ), write( ), and

close( ) functions so familiar to C/C++ coders do nothing more than set up and perform the

appropriate system calls. When the kernel is called in this way, it takes whatever steps are

necessary to find the data the process is requesting and transfer it into the specified buffer in

user space. The kernel tries to cache and/or prefetch data, so the data being requested by the

process may already be available in kernel space. If so, the data requested by the process is

copied out. If the data isn't available, the process is suspended while the kernel goes about

bringing the data into memory.

Looking at Figure 1-1, it's probably occurred to you that copying from kernel space to the

final user buffer seems like extra work. Why not tell the disk controller to send it directly to

the buffer in user space? There are a couple of problems with this. First, hardware is usually

not able to access user space directly.

Second, block-oriented hardware devices such as disk

controllers operate on fixed-size data blocks. The user process may be requesting an oddly

sized or misaligned chunk of data. The kernel plays the role of intermediary, breaking down

and reassembling data as it moves between user space and storage devices.

1.4.1.1 Scatter/gather

Many operating systems can make the assembly/disassembly process even more efficient. The

notion of scatter/gather allows a process to pass a list of buffer addresses to the operating

system in one system call. The kernel can then fill or drain the multiple buffers in sequence,

scattering the data to multiple user space buffers on a read, or gathering from several buffers

on a write (Figure 1-2).

There are many reasons for this, all of which are beyond the scope of this book. Hardware devices usually cannot directly use virtual memory

addresses.

Java NIO

Figure 1-4. Memory pages

1.4.3 Memory Paging

To support the second attribute of virtual memory (having an addressable space larger than

physical memory), it's necessary to do virtual memory paging (often referred to as swapping,

though true swapping is done at the process level, not the page level). This is a scheme

whereby the pages of a virtual memory space can be persisted to external disk storage to make

room in physical memory for other virtual pages. Essentially, physical memory acts as a

cache for a paging area, which is the space on disk where the content of memory pages is

stored when forced out of physical memory.

Figure 1-5 shows virtual pages belonging to four processes, each with its own virtual memory

space. Two of the five pages for Process A are loaded into memory; the others are stored on

disk.

Figure 1-5. Physical memory as a paging-area cache

Aligning memory page sizes as multiples of the disk block size allows the kernel to issue

direct commands to the disk controller hardware to write memory pages to disk or reload

them when needed. It turns out that all disk I/O is done at the page level. This is the only way

data ever moves between disk and physical memory in modern, paged operating systems.

Modern CPUs contain a subsystem known as the Memory Management Unit (MMU). This

device logically sits between the CPU and physical memory. It contains the mapping

information needed to translate virtual addresses to physical memory addresses. When

the CPU references a memory location, the MMU determines which page the location resides

in (usually by shifting or masking the bits of the address value) and translates that virtual page

number to a physical page number (this is done in hardware and is extremely fast). If there is

no mapping currently in effect between that virtual page and a physical memory page, the

MMU raises a page fault to the CPU.

A page fault results in a trap, similar to a system call, which vectors control into the kernel

along with information about which virtual address caused the fault. The kernel then takes

steps to validate the page. The kernel will schedule a pagein operation to read the content of

the missing page back into physical memory. This often results in another page being stolen

to make room for the incoming page. In such a case, if the stolen page is dirty (changed since

剩余253页未读，继续阅读

wanglj_ivy

粉丝: 0
资源: 1

Java NIO：提升效率的新一代I/O技术

Reilly__Java_NIO英文版和中文版

Java.NIO资源下载资源下载

Java NIO 电子书

JavaIO:OReilly.Java.I.O.2nd.Edition中文翻译和学习笔记

Java NIO 英文版

Java NIO深度解析 - O'Reilly经典著作

Java NIO：提升1.4版Java I/O效率的关键技术

Java NIO详解：提升1.4版Java I/O效率的关键技术

Java NIO深入解析

Java NIO编程：提升I/O效率与实战应用

最新资源