分布式 Kafka 安装
时间: 2023-11-23 21:55:27 浏览: 47
以下是分布式Kafka安装的步骤:
1. 下载Kafka安装包:
```
wget https://archive.apache.org/dist/kafka/2.4.1/kafka_2.11-2.4.1.tgz
```
2. 解压Kafka安装包并移动到/usr/local/目录下:
```
tar -xzf kafka_2.11-2.4.1.tgz -C /usr/local/
```
3. 修改Kafka配置文件:
```
cd /usr/local/kafka_2.11-2.4.1/config/
cp server.properties server.properties.bak
vim server.properties
```
在配置文件中修改以下参数:
```
broker.id=0 # 每个Kafka节点的唯一标识
listeners=PLAINTEXT://localhost:9092 # 监听地址和端口
log.dirs=/tmp/kafka-logs # Kafka日志存储路径
```
4. 启动Zookeeper:
```
wget https://archive.apache.org/dist/zookeeper/zookeeper-3.5.8/apache-zookeeper-3.5.8-bin.tar.gz
tar -xzf apache-zookeeper-3.5.8-bin.tar.gz -C /usr/local/
cd /usr/local/apache-zookeeper-3.5.8-bin/
cp conf/zoo_sample.cfg conf/zoo.cfg
bin/zkServer.sh start
```
5. 启动Kafka:
```
cd /usr/local/kafka_2.11-2.4.1/
bin/kafka-server-start.sh config/server.properties
```
6. 创建Topic:
```
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
```
7. 发送消息:
```
bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
```
8. 消费消息:
```
bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning
```