下面以 Debian 系列(如 Debian 11/12、Ubuntu) 为例,系统说明 Kafka 的安装与基本配置。Kafka 依赖 ZooKeeper(或新版 KRaft 模式),这里先讲最常见的 ZooKeeper 模式,再补充 KRaft 模式。
Kafka 需要 JDK 8 或 11(推荐 11)
sudo apt update
sudo apt install -y openjdk-11-jdk
验证:
java -version
以 Kafka 3.6 为例:
cd /opt
sudo wget https://downloads.apache.org/kafka/3.6.1/kafka_2.13-3.6.1.tgz
sudo tar -xzf kafka_2.13-3.6.1.tgz
sudo mv kafka_2.13-3.6.1 kafka
编辑:
sudo nano /opt/kafka/config/zookeeper.properties
常见配置:
dataDir=/var/lib/zookeeper
clientPort=2181
maxClientCnxns=0
创建数据目录:
sudo mkdir -p /var/lib/zookeeper
编辑:
sudo nano /opt/kafka/config/server.properties
关键配置说明:
# broker 唯一 ID
broker.id=0
# 监听地址(重要)
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://your-server-ip:9092
# 日志目录
log.dirs=/var/lib/kafka-logs
# ZooKeeper 地址
zookeeper.connect=localhost:2181
# 允许删除 topic(可选)
delete.topic.enable=true
创建日志目录:
sudo mkdir -p /var/lib/kafka-logs
# 启动 ZooKeeper
/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
# 另一个终端启动 Kafka
/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
sudo nano /etc/systemd/system/zookeeper.service
[Unit]
Description=ZooKeeper
After=network.target
[Service]
Type=simple
ExecStart=/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
ExecStop=/opt/kafka/bin/zookeeper-server-stop.sh
Restart=on-abnormal
[Install]
WantedBy=multi-user.target
sudo nano /etc/systemd/system/kafka.service
[Unit]
Description=Apache Kafka
After=zookeeper.service
[Service]
Type=simple
ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
ExecStop=/opt/kafka/bin/kafka-server-stop.sh
Restart=on-abnormal
[Install]
WantedBy=multi-user.target
sudo systemctl daemon-reload
sudo systemctl enable zookeeper
sudo systemctl enable kafka
sudo systemctl start zookeeper
sudo systemctl start kafka
查看状态:
sudo systemctl status kafka
/opt/kafka/bin/kafka-topics.sh \
--create \
--topic test \
--bootstrap-server localhost:9092 \
--partitions 1 \
--replication-factor 1
/opt/kafka/bin/kafka-console-producer.sh \
--topic test \
--bootstrap-server localhost:9092
/opt/kafka/bin/kafka-console-consumer.sh \
--topic test \
--from-beginning \
--bootstrap-server localhost:9092
Kafka 3.x 起支持 KRaft。
/opt/kafka/bin/kafka-storage.sh random-uuid
sudo nano /opt/kafka/config/kraft/server.properties
关键:
process.roles=broker,controller
node.id=1
controller.quorum.voters=1@localhost:9093
listeners=PLAINTEXT://:9092,CONTROLLER://:9093
log.dirs=/var/lib/kafka-logs
/opt/kafka/bin/kafka-storage.sh format \
-t <cluster-id> \
-c /opt/kafka/config/kraft/server.properties
/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/kraft/server.properties
advertised.listeners 必须配置为客户端可访问的 IPbroker.id 必须唯一9092log.dirs如果你愿意,我可以:
你现在是 单机测试还是生产集群?