hadoop 单节点
时间: 2023-12-08 17:38:55 浏览: 32
Hadoop是一个分布式计算框架,但是也可以在单节点上运行。以下是在单节点上运行Hadoop的步骤:
1.下载Hadoop并解压缩
```shell
wget https://archive.apache.org/dist/hadoop/common/hadoop-3.2.0/hadoop-3.2.0.tar.gz
tar -xzvf hadoop-3.2.0.tar.gz
```
2.配置环境变量
```shell
export HADOOP_HOME=/path/to/hadoop-3.2.0
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
```
3.配置Hadoop
```shell
cd $HADOOP_HOME/etc/hadoop
cp mapred-site.xml.template mapred-site.xml
```
4.修改配置文件
```shell
vim $HADOOP_HOME/etc/hadoop/core-site.xml
```
将以下内容添加到文件中:
```xml
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
```
```shell
vim $HADOOP_HOME/etc/hadoop/hdfs-site.xml
```
将以下内容添加到文件中:
```xml
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
```
5.格式化HDFS
```shell
hdfs namenode -format
```
6.启动Hadoop
```shell
start-all.sh
```
7.运行Hadoop示例程序
```shell
hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.0.jar grep input output 'dfs[a-z.]+'
```