温馨提示×

kafka在debian咋配置

小樊
36
2026-10-06 20:14:52
栏目: 智能运维

下面给你一份 在 Debian 上安装和配置 Kafka(以 Kafka 3.x + 自带 Zookeeper 为例) 的简明实操指南。


一、准备工作

1. 安装 Java

Kafka 需要 JVM(推荐 JDK 8 / 11 / 17)

sudo apt update
sudo apt install -y openjdk-17-jdk

java -version

2. 创建专用用户(可选但推荐)

sudo useradd -m -s /bin/bash kafka
sudo passwd kafka

二、下载并安装 Kafka

cd /opt
sudo wget https://downloads.apache.org/kafka/3.7.0/kafka_2.13-3.7.0.tgz
sudo tar -xzf kafka_2.13-3.7.0.tgz
sudo mv kafka_2.13-3.7.0 kafka
sudo chown -R kafka:kafka /opt/kafka

三、配置 Kafka

1. 配置 Zookeeper

sudo nano /opt/kafka/config/zookeeper.properties

常用配置:

dataDir=/var/lib/zookeeper
clientPort=2181

创建目录:

sudo mkdir -p /var/lib/zookeeper
sudo chown -R kafka:kafka /var/lib/zookeeper

2. 配置 Kafka

sudo nano /opt/kafka/config/server.properties

关键配置:

broker.id=0
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://<服务器IP>:9092
log.dirs=/var/lib/kafka-logs
zookeeper.connect=localhost:2181

创建日志目录:

sudo mkdir -p /var/lib/kafka-logs
sudo chown -R kafka:kafka /var/lib/kafka-logs

四、启动 Kafka(测试用)

启动 Zookeeper

/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties

启动 Kafka

/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties

五、配置 systemd(推荐)

1. Zookeeper

sudo nano /etc/systemd/system/zookeeper.service
[Unit]
Description=Apache Zookeeper
After=network.target

[Service]
Type=simple
User=kafka
ExecStart=/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
ExecStop=/opt/kafka/bin/zookeeper-server-stop.sh
Restart=on-failure

[Install]
WantedBy=multi-user.target

2. Kafka

sudo nano /etc/systemd/system/kafka.service
[Unit]
Description=Apache Kafka
After=zookeeper.service

[Service]
Type=simple
User=kafka
ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
ExecStop=/opt/kafka/bin/kafka-server-stop.sh
Restart=on-failure

[Install]
WantedBy=multi-user.target

3. 启动服务

sudo systemctl daemon-reload
sudo systemctl enable --now zookeeper
sudo systemctl enable --now kafka

六、基本测试

创建 Topic

/opt/kafka/bin/kafka-topics.sh \
  --create --topic test \
  --bootstrap-server localhost:9092 \
  --partitions 1 --replication-factor 1

生产消息

/opt/kafka/bin/kafka-console-producer.sh \
  --topic test --bootstrap-server localhost:9092

消费消息

/opt/kafka/bin/kafka-console-consumer.sh \
  --topic test --from-beginning --bootstrap-server localhost:9092

七、常见问题

  • 端口占用:检查 2181 / 9092
  • 外网无法连接:检查 advertised.listeners
  • Kafka 3.3+ 可用 KRaft(无 Zookeeper)

如果你需要:

  • ✅ KRaft 模式(无 Zookeeper)
  • ✅ 集群部署
  • ✅ Docker / Debian 12 特定版本

告诉我你的使用场景即可。

0 踩