温馨提示×

Kafka Debian咋配置

小樊
34
2026-10-03 21:51:05
栏目: 智能运维

下面给你一份在 Debian 上安装并配置 Apache Kafka的实用指南(以 Kafka 3.x + Java 17 为例,单机/伪分布式常见用法)。


一、环境准备

1. 安装 Java

Kafka 需要 JVM:

sudo apt update
sudo apt install -y openjdk-17-jdk

验证:

java -version

二、下载并安装 Kafka

cd /opt
sudo wget https://downloads.apache.org/kafka/3.7.0/kafka_2.13-3.7.0.tgz
sudo tar -xzf kafka_2.13-3.7.0.tgz
sudo mv kafka_2.13-3.7.0 kafka

三、基础配置(单节点)

1. Zookeeper 配置(Kafka 3.x 仍可用)

配置文件:

/opt/kafka/config/zookeeper.properties

常用配置:

dataDir=/var/lib/zookeeper
clientPort=2181

创建目录:

sudo mkdir -p /var/lib/zookeeper

2. Kafka Server 配置

配置文件:

/opt/kafka/config/server.properties

最小可用配置:

broker.id=0
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://localhost:9092
log.dirs=/var/lib/kafka-logs
zookeeper.connect=localhost:2181

创建目录:

sudo mkdir -p /var/lib/kafka-logs

四、启动 Kafka(手动方式)

1. 启动 Zookeeper

/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties

2. 启动 Kafka

/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties

五、系统服务方式(推荐)

1. Zookeeper systemd

sudo nano /etc/systemd/system/zookeeper.service
[Unit]
Description=Zookeeper
After=network.target

[Service]
Type=simple
ExecStart=/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
ExecStop=/opt/kafka/bin/zookeeper-server-stop.sh
Restart=on-failure

[Install]
WantedBy=multi-user.target

2. Kafka systemd

sudo nano /etc/systemd/system/kafka.service
[Unit]
Description=Apache Kafka
After=zookeeper.service

[Service]
Type=simple
ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
ExecStop=/opt/kafka/bin/kafka-server-stop.sh
Restart=on-failure

[Install]
WantedBy=multi-user.target

启用:

sudo systemctl daemon-reload
sudo systemctl enable --now zookeeper
sudo systemctl enable --now kafka

六、验证 Kafka

1. 创建 Topic

/opt/kafka/bin/kafka-topics.sh --create \
--topic test \
--bootstrap-server localhost:9092 \
--partitions 1 \
--replication-factor 1

2. 生产消息

/opt/kafka/bin/kafka-console-producer.sh \
--topic test \
--bootstrap-server localhost:9092

3. 消费消息

/opt/kafka/bin/kafka-console-consumer.sh \
--topic test \
--from-beginning \
--bootstrap-server localhost:9092

七、常见问题

  • 端口占用:检查 2181 / 9092
  • 无法远程连接:修改 advertised.listeners
  • Kafka 4.x:可不使用 Zookeeper(KRaft 模式)

如果你需要:

  • ✅ KRaft 模式(无 Zookeeper)
  • ✅ 集群配置
  • ✅ Debian 12 特定问题
  • ✅ Docker / Ansible 部署

告诉我你的使用场景即可。

0 踩