下面给你一个在 Debian(如 Debian 11/12)上配置 Apache Kafka 的实用指南,涵盖安装、基础配置和启动方式,适合学习和测试环境(生产环境会再补充注意点)。
Kafka 3.x 推荐使用 Java 8 / 11 / 17
sudo apt update
sudo apt install -y openjdk-17-jdk
验证:
java -version
cd /opt
sudo wget https://downloads.apache.org/kafka/3.7.0/kafka_2.13-3.7.0.tgz
sudo tar -xzf kafka_2.13-3.7.0.tgz
sudo mv kafka_2.13-3.7.0 kafka
Kafka 依赖 ZooKeeper(老版本)或 KRaft(新版本)
下面分别说明。
编辑:
sudo nano /opt/kafka/config/zookeeper.properties
常见配置:
dataDir=/opt/kafka/zookeeper-data
clientPort=2181
maxClientCnxns=0
创建数据目录:
sudo mkdir -p /opt/kafka/zookeeper-data
编辑:
sudo nano /opt/kafka/config/server.properties
关键配置:
broker.id=0
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://localhost:9092
log.dirs=/opt/kafka/kafka-logs
zookeeper.connect=localhost:2181
num.partitions=1
创建日志目录:
sudo mkdir -p /opt/kafka/kafka-logs
KAFKA_CLUSTER_ID=$(/opt/kafka/bin/kafka-storage.sh random-uuid)
sudo nano /opt/kafka/config/kraft/server.properties
示例:
process.roles=broker,controller
node.id=1
controller.quorum.voters=1@localhost:9093
listeners=PLAINTEXT://:9092,CONTROLLER://:9093
advertised.listeners=PLAINTEXT://localhost:9092
log.dirs=/opt/kafka/kafka-logs
/opt/kafka/bin/kafka-storage.sh format \
-t $KAFKA_CLUSTER_ID \
-c /opt/kafka/config/kraft/server.properties
/opt/kafka/bin/zookeeper-server-start.sh -daemon /opt/kafka/config/zookeeper.properties
/opt/kafka/bin/kafka-server-start.sh -daemon /opt/kafka/config/server.properties
/opt/kafka/bin/kafka-server-start.sh -daemon /opt/kafka/config/kraft/server.properties
/opt/kafka/bin/kafka-topics.sh \
--create --topic test \
--bootstrap-server localhost:9092 \
--partitions 1 --replication-factor 1
/opt/kafka/bin/kafka-topics.sh \
--list --bootstrap-server localhost:9092
sudo nano /etc/systemd/system/kafka.service
[Unit]
Description=Apache Kafka
After=network.target
[Service]
Type=simple
ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
ExecStop=/opt/kafka/bin/kafka-server-stop.sh
Restart=on-failure
[Install]
WantedBy=multi-user.target
启用:
sudo systemctl daemon-reload
sudo systemctl enable --now kafka
advertised.listeners 为公网/内网 IPlog.retention.hoursbroker.id-Xmx4G如果你愿意,我可以: