下面给你一个**在 Debian 上配置 Kafka 主题(Topic)**的实用说明,从安装前准备到常见配置都覆盖。
Kafka 需要 JDK(推荐 JDK 8 / 11 / 17)
sudo apt update
sudo apt install openjdk-11-jdk -y
java -version
cd /opt
sudo wget https://downloads.apache.org/kafka/3.6.1/kafka_2.13-3.6.1.tgz
sudo tar -xzf kafka_2.13-3.6.1.tgz
sudo ln -s /opt/kafka_2.13-3.6.1 /opt/kafka
/opt/kafka/bin/zookeeper-server-start.sh -daemon /opt/kafka/config/zookeeper.properties
/opt/kafka/bin/kafka-server-start.sh -daemon /opt/kafka/config/server.properties
/opt/kafka/bin/kafka-topics.sh \
--create \
--bootstrap-server localhost:9092 \
--topic test-topic \
--partitions 3 \
--replication-factor 1
⚠️
replication-factor不能大于 broker 数量
/opt/kafka/bin/kafka-topics.sh \
--list \
--bootstrap-server localhost:9092
/opt/kafka/bin/kafka-topics.sh \
--describe \
--topic test-topic \
--bootstrap-server localhost:9092
创建时可加 --config:
/opt/kafka/bin/kafka-topics.sh \
--create \
--bootstrap-server localhost:9092 \
--topic user-log \
--partitions 6 \
--replication-factor 1 \
--config retention.ms=604800000 \
--config cleanup.policy=delete
| 参数 | 说明 |
|---|---|
| retention.ms | 消息保留时间 |
| retention.bytes | 分区最大大小 |
| cleanup.policy | delete / compact |
| max.message.bytes | 单条消息最大 |
/opt/kafka/bin/kafka-configs.sh \
--bootstrap-server localhost:9092 \
--entity-type topics \
--entity-name test-topic \
--alter \
--add-config retention.ms=259200000
/etc/systemd/system/kafka.service
[Unit]
Description=Apache Kafka
After=network.target
[Service]
ExecStart=/opt/kafka/bin/kafka-server-start.sh /opt/kafka/config/server.properties
User=root
Restart=on-failure
[Install]
WantedBy=multi-user.target
systemctl enable kafka
systemctl start kafka
检查:
netstat -tunlp | grep 9092
Error: replication factor: 3 larger than available brokers: 1
如果你愿意,我可以:
你现在是 单机测试还是生产环境?