确定哪个主题在Kafka consumer中有记录

Question

我一直在关注Kafka消费类课程。我可以将主题作为列表对象传递。我指的是下面的文章https://docs.confluent.io/current/clients/java.html，但我需要知道，一旦消费者类订阅了主题，我如何知道哪个主题中有记录。有没有办法找到答案？代码如下：

public abstract class ConsumeLoop implements Runnable {
  private final KafkaConsumer<K, V> consumer;
  private final List<String> topics;
  private final CountDownLatch shutdownLatch;

  public BasicConsumeLoop(KafkaConsumer<K, V> consumer, List<String> topics) {
    this.consumer = consumer;
    this.topics = topics;
    this.shutdownLatch = new CountDownLatch(1);
  }

  public abstract void process(ConsumerRecord<K, V> record);

  public void run() {
  try {
      consumer.subscribe(topics);  --> Consuming list of topics

      while (true) {
        ConsumerRecords<K, V> records = consumer.poll(Long.MAX_VALUE);  --> Which topic is returning the records?
        records.forEach(record -> process(record));    
     }  
   } catch (WakeupException e) {
     // ignore, we're closing
    } catch (Exception e) {
      log.error("Unexpected error", e);
    } finally {
       consumer.close();
      shutdownLatch.countDown();
    }
  } 
}

Answer 1

ConsumerRecords中的partitions（）方法将返回一组TopicPartitions：

分区-获取包含此记录集中的记录的分区。

然后，您可以迭代该集以获取主题（）名称和分区（）数字，这取决于您需要什么。例如：

   for (TopicPartition tp : records.partitions()) {
     System.out.println("Got " + records.records(tp).size() + " records "
       + "from topic:partition " + tp.topic() + ":" + tp.partition());
   }