centos安装hadoop和hbase
时间: 2024-10-15 12:29:06 浏览: 3
CentOS 安装 Hadoop 和 HBase 的步骤相对复杂,因为它们都是大型分布式系统,涉及多个组件和服务。以下是简化的安装过程:
**Hadoop安装:**
1. **更新包列表并安装必要的依赖**:
```
sudo yum update -y
sudo yum install java-1.8.0-openjdk-devel git wget
```
2. **下载Hadoop源码**:
```
cd /opt/
wget https://www.apache.org/dist/hadoop/common/hadoop-3.x/stable/hadoop-3.x.y.tar.gz
```
3. **解压并配置**:
```
tar xvf hadoop*.tar.gz
cd hadoop*
./configure
```
4. **创建目录结构**:
```
sudo mkdir -p /usr/local/hadoop/{bin,etc,mapred,logs,conf}
sudo chown -R root:hadoop /usr/local/hadoop
```
5. **编译并安装**:
```
make all
sudo make install
```
6. **配置环境变量**:
在`~/.bashrc`或`~/.bash_profile`中添加:
```bash
export HADOOP_HOME=/usr/local/hadoop
PATH=$PATH:$HADOOP_HOME/bin
```
7. **启动Hadoop服务**:
```
start-dfs.sh start-yarn.sh
```
**HBase安装:**
1. **下载HBase** (假设已安装Hadoop):
```
cd /opt/
wget https://archive.apache.org/dist/hbase/hbase-2.x/apache-hbase-2.x.y-bin.tar.gz
```
2. **解压并配置**:
```
tar xvf apache-hbase*.tar.gz
cd apache-hbase*
cp hbase-site.xml.template hbase-site.xml
```
3. **配置HBase以指向Hadoop**:
在`hbase-site.xml`中设置`hbase.rootdir`和`hbase.zookeeper.quorum`。
4. **启动HBase Master、RegionServer**:
```
bin/start-hbase.sh
```
5. **检查服务是否运行正常**:
使用`jps`命令查看进程,并访问`http://localhost:60010`查看HBase Web UI。