下面分 单机(开发/测试) 和 集群(生产) 两种常见场景,说明 Kafka 在 Ubuntu 上的配置步骤。以 Kafka 3.x + Ubuntu 20.04/22.04 为例。
Kafka 依赖 JVM:
sudo apt update
sudo apt install openjdk-11-jdk -y
验证:
java -version
去官网或镜像下载(以 3.6.1 为例):
cd /opt
sudo wget https://downloads.apache.org/kafka/3.6.1/kafka_2.13-3.6.1.tgz
sudo tar -xzf kafka_2.13-3.6.1.tgz
sudo mv kafka_2.13-3.6.1 kafka
cd /opt/kafka
bin/zookeeper-server-start.sh config/zookeeper.properties
新版本 Kafka 已逐步去 Zookeeper,但仍可用
新开一个终端:
cd /opt/kafka
bin/kafka-server-start.sh config/server.properties
看到:
[KafkaServer id=0] started
说明启动成功。
bin/kafka-topics.sh \
--create \
--topic test-topic \
--bootstrap-server localhost:9092 \
--partitions 1 \
--replication-factor 1
bin/kafka-topics.sh --list --bootstrap-server localhost:9092
bin/kafka-console-producer.sh \
--topic test-topic \
--bootstrap-server localhost:9092
bin/kafka-console-consumer.sh \
--topic test-topic \
--from-beginning \
--bootstrap-server localhost:9092
路径:
/opt/kafka/config/server.properties
| 参数 | 说明 |
|---|---|
broker.id |
节点 ID,集群中唯一 |
listeners |
监听地址 |
log.dirs |
数据目录 |
zookeeper.connect |
Zookeeper 地址 |
num.partitions |
默认分区数 |
listeners=PLAINTEXT://0.0.0.0:9092
advertised.listeners=PLAINTEXT://<服务器IP>:9092
sudo nano /etc/systemd/system/zookeeper.service
[Unit]
Description=Zookeeper
After=network.target
[Service]
Type=simple
ExecStart=/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
ExecStop=/opt/kafka/bin/zookeeper-server-stop.sh
Restart=on-failure
[Install]
WantedBy=multi-user.target
sudo nano /etc/systemd/system/kafka.service
[Unit]
Description=Kafka
After=zookeeper.service
[Service]
Type=simple
ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
ExecStop=/opt/kafka/bin/kafka-server-stop.sh
Restart=on-failure
[Install]
WantedBy=multi-user.target
sudo systemctl daemon-reload
sudo systemctl start zookeeper
sudo systemctl start kafka
sudo systemctl enable zookeeper
sudo systemctl enable kafka
在三台机器上:
broker.id=1 # 每台不同
zookeeper.connect=zk1:2181,zk2:2181,zk3:2181
netstat -tunlp | grep 9092
/tmp 权限advertised.listenerssudo ufw allow 9092
✅ Ubuntu 上 Kafka 基本流程:
server.properties如果你需要:
可以直接告诉我你的使用场景。