温馨提示×

kafka配置debian有何步骤

小樊
35
2026-09-25 04:19:41
栏目: 智能运维

在 Debian 上配置并运行 Apache Kafka,一般步骤如下(以 Kafka 3.x 为例,使用自带 Zookeeper 方式):


一、环境准备

1. 更新系统

sudo apt update
sudo apt upgrade -y

2. 安装 Java(Kafka 依赖 JVM)

sudo apt install -y default-jdk
java -version

二、下载并安装 Kafka

1. 创建目录并下载 Kafka

cd /opt
sudo wget https://downloads.apache.org/kafka/3.6.1/kafka_2.13-3.6.1.tgz
sudo tar -xzf kafka_2.13-3.6.1.tgz
sudo mv kafka_2.13-3.6.1 kafka

2. 设置权限(可选)

sudo chown -R $USER:$USER /opt/kafka

三、配置 Kafka

1. 配置 Zookeeper(默认即可)

/opt/kafka/config/zookeeper.properties

默认监听:

clientPort=2181

2. 配置 Kafka Server

nano /opt/kafka/config/server.properties

常见修改项:

broker.id=0
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://localhost:9092
log.dirs=/tmp/kafka-logs
zookeeper.connect=localhost:2181

如果是远程访问,把 localhost 改成服务器 IP


四、启动 Kafka

1. 启动 Zookeeper

/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties

2. 启动 Kafka

/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties

建议后台运行:

nohup ... > kafka.log 2>&1 &

五、测试 Kafka

1. 创建 Topic

/opt/kafka/bin/kafka-topics.sh --create \
--topic test --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1

2. 生产消息

/opt/kafka/bin/kafka-console-producer.sh \
--topic test --bootstrap-server localhost:9092

3. 消费消息

/opt/kafka/bin/kafka-console-consumer.sh \
--topic test --from-beginning --bootstrap-server localhost:9092

六、设置为系统服务(推荐)

1. Zookeeper service

sudo nano /etc/systemd/system/zookeeper.service
[Unit]
Description=Zookeeper
After=network.target

[Service]
ExecStart=/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
ExecStop=/opt/kafka/bin/zookeeper-server-stop.sh
Restart=on-failure

[Install]
WantedBy=multi-user.target

2. Kafka service

sudo nano /etc/systemd/system/kafka.service
[Unit]
Description=Kafka
After=zookeeper.service

[Service]
ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
ExecStop=/opt/kafka/bin/kafka-server-stop.sh
Restart=on-failure

[Install]
WantedBy=multi-user.target

3. 启动服务

sudo systemctl daemon-reload
sudo systemctl enable zookeeper kafka
sudo systemctl start zookeeper kafka

七、防火墙(如有)

sudo ufw allow 9092
sudo ufw allow 2181

如果你需要 Kafka + KRaft(无 Zookeeper) 或 集群配置,也可以告诉我,我可以给你专门步骤。

0 踩