GNU Wget 1.16.2 用户手册：网络数据下载工具

1.16.2

需积分: 10 185 浏览量更新于2024-07-22 收藏 427KB PDF 举报

"GNU Wget 1.16.2 English" GNU Wget是一款强大的网络数据下载工具，主要用于非交互式的下载任务。这个文档详细介绍了Wget 1.16.2版本的使用方法和功能特性。该软件遵循GNU通用公共许可证（GPL），并由Hrvoje Nikšić等人维护和更新。 Wget的核心功能在于其对URL（统一资源定位符）的支持。URL格式是Wget进行下载的基础，它包括协议（如http、https或ftp）、主机名、路径等部分。用户可以通过指定URL来告诉Wget要下载的资源位置。在选项语法方面，Wget允许用户通过命令行参数自定义其行为。基本的启动选项包括设置用户代理、指定工作目录、设定重试次数等。这些选项帮助用户控制下载过程，例如，可以使用`--user-agent`选项伪装浏览器身份，避免被服务器识别为机器人。对于日志和输入文件选项，Wget允许用户记录下载过程和配置文件。这使得用户能够跟踪下载进度，或者通过外部文件来批量执行下载任务。`--output-file`选项用于指定日志文件，而`--read-config`则可读取包含下载指令的配置文件。下载选项中，Wget支持断点续传（`--continue`），这意味着如果下载中断，可以从上次停止的地方继续。另外，`--recursive`选项使Wget能够递归地下载整个网站或目录，这对于镜像网站非常有用。同时，`--mirror`选项是`--recursive`和一些相关选项的组合，简化了网站镜像的过程。目录选项涉及到如何处理本地文件系统中的下载内容。例如，`--directory-prefix`可以指定所有下载文件的保存位置，而`--no-host-directories`则禁止创建以主机名为名的子目录。在HTTP和HTTPS选项中，Wget提供了处理HTTP头信息的能力，如设置Cookie、自定义请求头等。HTTPS选项则涉及安全套接层（SSL）和传输层安全（TLS）协议，用户可以配置证书验证、忽略不安全的连接等。 FTP选项允许用户处理FTP服务器上的文件，包括匿名登录、使用特定用户名和密码、以及处理FTP服务器上的目录结构。 GNU Wget 1.16.2是一个强大且灵活的下载工具，适用于各种网络环境和需求。它提供了丰富的选项来满足用户的各种定制化需求，无论是简单的单个文件下载还是复杂的网站镜像任务，都能得心应手。

Chapter 2: Invoking 8

style each dot represents 1K, there are ten dots in a cluster and 50 dots in a line.

The binary style has a more “computer”-like orientation—8K dots, 16-dots clusters

and 48 dots per line (which makes for 384K lines). The mega style is suitable for

downloading large ﬁles—each dot represents 64K retrieved, there are eight dots in

a cluster, and 48 dots on each line (so each line contains 3M). If mega is not enough

then you can use the giga style—each dot represents 1M retrieved, there are eight

dots in a cluster, and 32 dots on each line (so each line contains 32M).

With ‘--progress=bar’, there are currently two possible parameters, force and

noscroll.

When the output is not a TTY, the progress bar always falls back to “dot”, even

if ‘--progress=bar’ was passed to Wget during invokation. This behaviour can

be overridden and the “bar” output forced by using the “force” parameter as

‘--progress=bar:force’.

By default, the ‘bar’ style progress bar scroll the name of the ﬁle from left to right

for the ﬁle being downloaded if the ﬁlename exceeds the maximum length allotted

for its display. In certain cases, such as with ‘--progress=bar:force’, one may not

want the scrolling ﬁlename in the progress bar. By passing the “noscroll” parameter,

Wget can be forced to display as much of the ﬁlename as possible without scrolling

through it.

Note that you can set the default style using the progress command in .wgetrc.

That setting may be overridden from the command line. For example, to force the

bar output without scrolling, use ‘--progress=bar:force:noscroll’.

‘--show-progress’

Force wget to display the progress bar in any verbosity.

By default, wget only displays the progress bar in verbose mode. One may however,

want wget to display the progress bar on screen in conjunction with any other

verbosity modes like ‘--no-verbose’ or ‘--quiet’. This is often a desired a property

when invoking wget to download several small/large ﬁles. In such a case, wget could

simply be invoked with this parameter to get a much cleaner output on the screen.

This option will also force the progress bar to be printed to stderr when used

alongside the ‘--logfile’ option.

‘-N’

‘--timestamping’

Turn on time-stamping. See Chapter 5 [Time-Stamping], page 33, for details.

‘--no-use-server-timestamps’

Don’t set the local ﬁle’s timestamp by the one on the server.

By default, when a ﬁle is downloaded, its timestamps are set to match those from

the remote ﬁle. This allows the use of ‘--timestamping’ on subsequent invocations

of wget. However, it is sometimes useful to base the local ﬁle’s timestamp on when

it was actually downloaded; for that purpose, the ‘--no-use-server-timestamps’

option has been provided.

‘-S’

‘--server-response’

Print the headers sent by http servers and responses sent by ftp servers.

‘--spider’

When invoked with this option, Wget will behave as a Web spider, which means

that it will not download the pages, just check that they are there. For example,

you can use Wget to check your bookmarks:

Chapter 2: Invoking 9

wget --spider --force-html -i bookmarks.html

This feature needs much more work for Wget to get close to the functionality of real

web spiders.

‘-T seconds’

‘--timeout=seconds’

Set the network timeout to seconds seconds. This is equivalent to specifying

‘--dns-timeout’, ‘--connect-timeout’, and ‘--read-timeout’, all at the same

time.

When interacting with the network, Wget can check for timeout and abort the

operation if it takes too long. This prevents anomalies like hanging reads and inﬁnite

connects. The only timeout enabled by default is a 900-second read timeout. Setting

a timeout to 0 disables it altogether. Unless you know what you are doing, it is best

not to change the default timeout settings.

All timeout-related options accept decimal values, as well as subsecond values. For

example, ‘0.1’ seconds is a legal (though unwise) choice of timeout. Subsecond

timeouts are useful for checking server response times or for testing network latency.

‘--dns-timeout=seconds’

Set the DNS lookup timeout to seconds seconds. DNS lookups that don’t complete

within the speciﬁed time will fail. By default, there is no timeout on DNS lookups,

other than that implemented by system libraries.

‘--connect-timeout=seconds’

Set the connect timeout to seconds seconds. TCP connections that take longer to

establish will be aborted. By default, there is no connect timeout, other than that

implemented by system libraries.

‘--read-timeout=seconds’

Set the read (and write) timeout to seconds seconds. The “time” of this timeout

refers to idle time: if, at any point in the download, no data is received for more

than the speciﬁed number of seconds, reading fails and the download is restarted.

This option does not directly aﬀect the duration of the entire download.

Of course, the remote server may choose to terminate the connection sooner than

this option requires. The default read timeout is 900 seconds.

‘--limit-rate=amount’

Limit the download speed to amount bytes per second. Amount may be expressed

in bytes, kilobytes with the ‘k’ suﬃx, or megabytes with the ‘m’ suﬃx. For example,

‘--limit-rate=20k’ will limit the retrieval rate to 20KB/s. This is useful when, for

whatever reason, you don’t want Wget to consume the entire available bandwidth.

This option allows the use of decimal numbers, usually in conjunction with power

suﬃxes; for example, ‘--limit-rate=2.5k’ is a legal value.

Note that Wget implements the limiting by sleeping the appropriate amount of time

after a network read that took less time than speciﬁed by the rate. Eventually this

strategy causes the TCP transfer to slow down to approximately the speciﬁed rate.

However, it may take some time for this balance to be achieved, so don’t be surprised

if limiting the rate doesn’t work well with very small ﬁles.

‘-w seconds’

‘--wait=seconds’

Wait the speciﬁed number of seconds between the retrievals. Use of this option is

recommended, as it lightens the server load by making the requests less frequent.

Chapter 2: Invoking 10

Instead of in seconds, the time can be speciﬁed in minutes using the m suﬃx, in

hours using h suﬃx, or in days using d suﬃx.

Specifying a large value for this option is useful if the network or the destination

host is down, so that Wget can wait long enough to reasonably expect the network

error to be ﬁxed before the retry. The waiting interval speciﬁed by this function is

inﬂuenced by --random-wait, which see.

‘--waitretry=seconds’

If you don’t want Wget to wait between every retrieval, but only between retries of

failed downloads, you can use this option. Wget will use linear backoﬀ, waiting 1

second after the ﬁrst failure on a given ﬁle, then waiting 2 seconds after the second

failure on that ﬁle, up to the maximum number of seconds you specify.

By default, Wget will assume a value of 10 seconds.

‘--random-wait’

Some web sites may perform log analysis to identify retrieval programs such as Wget

by looking for statistically signiﬁcant similarities in the time between requests. This

option causes the time between requests to vary between 0.5 and 1.5 * wait seconds,

where wait was speciﬁed using the ‘--wait’ option, in order to mask Wget’s presence

from such analysis.

A 2001 article in a publication devoted to development on a popular consumer

platform provided code to perform this analysis on the ﬂy. Its author suggested

blocking at the class C address level to ensure automated retrieval programs were

blocked despite changing DHCP-supplied addresses.

The ‘--random-wait’ option was inspired by this ill-advised recommendation to

block many unrelated users from a web site due to the actions of one.

‘--no-proxy’

Don’t use proxies, even if the appropriate *_proxy environment variable is deﬁned.

See Section 8.1 [Proxies], page 49, for more information about the use of proxies

with Wget.

‘-Q quota’

‘--quota=quota’

Specify download quota for automatic retrievals. The value can be speciﬁed in bytes

(default), kilobytes (with ‘k’ suﬃx), or megabytes (with ‘m’ suﬃx).

Note that quota will never aﬀect downloading a single ﬁle. So if you specify ‘wget

-Q10k ftp://wuarchive.wustl.edu/ls-lR.gz’, all of the ls-lR.gz will be down-

loaded. The same goes even when several urls are speciﬁed on the command-line.

However, quota is respected when retrieving either recursively, or from an input ﬁle.

Thus you may safely type ‘wget -Q2m -i sites’—download will be aborted when

the quota is exceeded.

Setting quota to 0 or to ‘inf’ unlimits the download quota.

‘--no-dns-cache’

Turn oﬀ caching of DNS lookups. Normally, Wget remembers the IP addresses it

looked up from DNS so it doesn’t have to repeatedly contact the DNS server for the

same (typically small) set of hosts it retrieves from. This cache exists in memory

only; a new Wget run will contact DNS again.

However, it has been reported that in some situations it is not desirable to cache host

names, even for the duration of a short-running application like Wget. With this

option Wget issues a new DNS lookup (more precisely, a new call to gethostbyname

or getaddrinfo) each time it makes a new connection. Please note that this option

Chapter 2: Invoking 11

will not aﬀect caching that might be performed by the resolving library or by an

external caching layer, such as NSCD.

If you don’t understand exactly what this option does, you probably won’t need it.

‘--restrict-file-names=modes’

Change which characters found in remote URLs must be escaped during generation

of local ﬁlenames. Characters that are restricted by this option are escaped, i.e.

replaced with ‘%HH’, where ‘HH’ is the hexadecimal number that corresponds to the

restricted character. This option may also be used to force all alphabetical cases to

be either lower- or uppercase.

By default, Wget escapes the characters that are not valid or safe as part of ﬁle

names on your operating system, as well as control characters that are typically

unprintable. This option is useful for changing these defaults, perhaps because you

are downloading to a non-native partition, or because you want to disable escaping

of the control characters, or you want to further restrict characters to only those in

the ascii range of values.

The modes are a comma-separated set of text values. The acceptable values are

‘unix’, ‘windows’, ‘nocontrol’, ‘ascii’, ‘lowercase’, and ‘uppercase’. The values

‘unix’ and ‘windows’ are mutually exclusive (one will override the other), as are

‘lowercase’ and ‘uppercase’. Those last are special cases, as they do not change

the set of characters that would be escaped, but rather force local ﬁle paths to be

converted either to lower- or uppercase.

When “unix” is speciﬁed, Wget escapes the character ‘/’ and the control characters

in the ranges 0–31 and 128–159. This is the default on Unix-like operating systems.

When “windows” is given, Wget escapes the characters ‘\’, ‘|’, ‘/’, ‘:’, ‘?’, ‘"’,

‘*’, ‘<’, ‘>’, and the control characters in the ranges 0–31 and 128–159. In addi-

tion to this, Wget in Windows mode uses ‘+’ instead of ‘:’ to separate host and

port in local ﬁle names, and uses ‘@’ instead of ‘?’ to separate the query por-

tion of the ﬁle name from the rest. Therefore, a URL that would be saved as

‘www.xemacs.org:4300/search.pl?input=blah’ in Unix mode would be saved as

‘www.xemacs.org+4300/search.pl@input=blah’ in Windows mode. This mode is

the default on Windows.

If you specify ‘nocontrol’, then the escaping of the control characters is also

switched oﬀ. This option may make sense when you are downloading URLs whose

names contain UTF-8 characters, on a system which can save and display ﬁlenames

in UTF-8 (some possible byte values used in UTF-8 byte sequences fall in the range

of values designated by Wget as “controls”).

The ‘ascii’ mode is used to specify that any bytes whose values are outside the

range of ascii characters (that is, greater than 127) shall be escaped. This can be

useful when saving ﬁlenames whose encoding does not match the one used locally.

‘-4’

‘--inet4-only’

‘-6’

‘--inet6-only’

Force connecting to IPv4 or IPv6 addresses. With ‘--inet4-only’ or ‘-4’, Wget

will only connect to IPv4 hosts, ignoring AAAA records in DNS, and refusing to

connect to IPv6 addresses speciﬁed in URLs. Conversely, with ‘--inet6-only’ or

‘-6’, Wget will only connect to IPv6 hosts and ignore A records and IPv4 addresses.

Neither options should be needed normally. By default, an IPv6-aware Wget will

use the address family speciﬁed by the host’s DNS record. If the DNS responds with

剩余70页未读，继续阅读

Mark_Hui

粉丝: 0
资源: 5

GNU Wget 1.16.2 用户手册：网络数据下载工具

GNU Wget 1.11.4：网络数据下载神器指南

wget2-1.99.2.tar.gz

Wget manual

相比Wget，Wget2 速度更快，支持更多的协议，特别是围绕 HTTP/2 和压缩，支持多线程/并行连接，以及其他改进。

wget-1.11.4-1源代码

GNU GCC 手册 2.mht

GNU make 指南 GNU make 指南GNU make 指南

GNU GCC 手册 1.mht

Wget创建一个网站的镜像1

GNURadio.rar_GNU Radio_gnuradio_gnuradio 开发_gnuradio官网_gunradio

最新资源