下面给你一份在 Debian(10/11/12 均可参考)下配置 Kafka 的实战步骤,从环境准备到基本配置和启动,适合入门和生产前测试。
Kafka 3.x 推荐 Java 8 / 11 / 17
sudo apt update
sudo apt install -y openjdk-17-jdk
验证:
java -version
cd /opt
sudo wget https://downloads.apache.org/kafka/3.7.0/kafka_2.13-3.7.0.tgz
sudo tar -xzf kafka_2.13-3.7.0.tgz
sudo mv kafka_2.13-3.7.0 kafka
编辑配置文件:
sudo nano /opt/kafka/config/zookeeper.properties
示例:
dataDir=/var/lib/zookeeper
clientPort=2181
maxClientCnxns=0
创建数据目录:
sudo mkdir -p /var/lib/zookeeper
sudo nano /opt/kafka/config/server.properties
关键配置(单机示例):
broker.id=0
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://your-server-ip:9092
log.dirs=/var/lib/kafka-logs
num.partitions=3
default.replication.factor=1
zookeeper.connect=localhost:2181
创建日志目录:
sudo mkdir -p /var/lib/kafka-logs
/opt/kafka/bin/zookeeper-server-start.sh -daemon /opt/kafka/config/zookeeper.properties
/opt/kafka/bin/kafka-server-start.sh -daemon /opt/kafka/config/server.properties
查看日志:
tail -f /opt/kafka/logs/server.log
/opt/kafka/bin/kafka-topics.sh --create \
--topic test \
--bootstrap-server localhost:9092 \
--partitions 1 \
--replication-factor 1
/opt/kafka/bin/kafka-console-producer.sh \
--topic test \
--bootstrap-server localhost:9092
/opt/kafka/bin/kafka-console-consumer.sh \
--topic test \
--from-beginning \
--bootstrap-server localhost:9092
sudo nano /etc/systemd/system/zookeeper.service
[Unit]
Description=Zookeeper
After=network.target
[Service]
Type=simple
ExecStart=/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
ExecStop=/opt/kafka/bin/zookeeper-server-stop.sh
Restart=on-failure
[Install]
WantedBy=multi-user.target
sudo nano /etc/systemd/system/kafka.service
[Unit]
Description=Kafka
After=zookeeper.service
[Service]
Type=simple
ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
ExecStop=/opt/kafka/bin/kafka-server-stop.sh
Restart=on-failure
[Install]
WantedBy=multi-user.target
启用并启动:
sudo systemctl daemon-reload
sudo systemctl enable zookeeper kafka
sudo systemctl start zookeeper kafka
sudo ufw allow 9092
sudo ufw allow 2181
如果你愿意,我可以继续帮你:
你现在是学习测试还是生产部署?