KAFKA简单操作

1.创建一个topic,3个分区和两个副本
[redis@node1 kafka_2.12-2.2.0]$bin/kafka-topics.sh -create --zookeeper node1:2181 -replication-factor 2 --partitions 3 --topic test
2.查看topic详细信息:
[redis@node1 kafka_2.12-2.2.0]$ bin/kafka-topics.sh --zookeeper node1:2181 --topic test --describe
Topic:test         PartitionCount:3            ReplicationFactor:2      Configs:
Topic: test     Partition: 0  Leader: 1           Replicas: 1,2       Isr: 1,2
Topic: test     Partition: 1  Leader: 2           Replicas: 2,0         Isr: 2,0
Topic: test     Partition: 2  Leader: 0           Replicas: 0,1         Isr: 0,1
3.创建一个生产者
[redis@node1 kafka_2.12-2.2.0]$bin/kafka-console-producer.sh --broker-list node1:9092 --topic test
4.创建一个消费者
[redis@node2 kafka_2.12-2.2.0]$ bin/kafka-console-consumer.sh --bootstrap-server node1:9092 --topic test --from-beginning

--查看消费者的消费进度
1.查看所有组
[redis@node1 kafka_2.12-2.2.0]$bin/kafka-consumer-groups.sh --bootstrap-server node1:9092 --list


2.查看消费情况
[redis@node2 kafka_2.12-2.2.0]$bin/kafka-consumer-groups.sh --describe --bootstrap-server node1:9092 --group yjjbts.consumer
"Topic的名字"   "分区ID"   "当前已消费的条数"  "总条数"   "未消费条数"     "消费ID"                                          "主机ID"       "客户端ID"
TOPIC           PARTITION  CURRENT-OFFSET  LOG-END-OFFSET  LAG             CONSUMER-ID                                      HOST            CLIENT-ID


版权声明:本文为yanghuadong_1992原创文章,遵循CC 4.0 BY-SA版权协议,转载请附上原文出处链接和本声明。