下面按从零开始的方式,说明如何在 Debian 上安装并配置 Apache Kafka(以常见稳定版本为例,如 Kafka 3.x)。
sudo apt update
sudo apt upgrade -y
Kafka 3.x 需要 Java 8 或以上:
sudo apt install -y openjdk-17-jdk
验证:
java -version
cd /opt
sudo wget https://downloads.apache.org/kafka/3.7.0/kafka_2.13-3.7.0.tgz
sudo tar -xzf kafka_2.13-3.7.0.tgz
sudo mv kafka_2.13-3.7.0 kafka
/opt/kafka
├── bin
├── config
├── libs
└── logs
sudo nano /opt/kafka/config/zookeeper.properties
常用配置:
dataDir=/opt/kafka/zookeeper-data
clientPort=2181
maxClientCnxns=0
创建数据目录:
sudo mkdir -p /opt/kafka/zookeeper-data
sudo nano /opt/kafka/config/server.properties
关键配置:
broker.id=0
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://<你的服务器IP>:9092
log.dirs=/opt/kafka/kafka-logs
zookeeper.connect=localhost:2181
创建日志目录:
sudo mkdir -p /opt/kafka/kafka-logs
/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
另开一个终端:
/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
/opt/kafka/bin/kafka-topics.sh \
--create \
--topic test \
--bootstrap-server localhost:9092 \
--partitions 1 \
--replication-factor 1
/opt/kafka/bin/kafka-console-producer.sh \
--topic test \
--bootstrap-server localhost:9092
/opt/kafka/bin/kafka-console-consumer.sh \
--topic test \
--from-beginning \
--bootstrap-server localhost:9092
sudo nano /etc/systemd/system/zookeeper.service
[Unit]
Description=Zookeeper
After=network.target
[Service]
ExecStart=/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
ExecStop=/opt/kafka/bin/zookeeper-server-stop.sh
Restart=on-abnormal
[Install]
WantedBy=multi-user.target
sudo nano /etc/systemd/system/kafka.service
[Unit]
Description=Apache Kafka
After=zookeeper.service
[Service]
ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
ExecStop=/opt/kafka/bin/kafka-server-stop.sh
Restart=on-abnormal
[Install]
WantedBy=multi-user.target
sudo systemctl daemon-reload
sudo systemctl enable zookeeper
sudo systemctl enable kafka
sudo systemctl start zookeeper
sudo systemctl start kafka
如果你使用的是 Kafka 3.3+,可不使用 Zookeeper:
/opt/kafka/bin/kafka-storage.sh random-uuid
/opt/kafka/bin/kafka-storage.sh format \
--config /opt/kafka/config/kraft/server.properties \
--cluster-id <UUID>
sudo ufw allow 9092
sudo ufw allow 2181
如果你需要:
可以直接告诉我你的使用场景。