Kafka多主题消费

Question

   consumer.subscribe(Pattern.compile(".*"),new ConsumerRebalanceListener() {
            @Override
            public void onPartitionsRevoked(Collection<TopicPartition> clctn) {

            }

            @Override
            public void onPartitionsAssigned(Collection<TopicPartition> clctn) {
            }            
        });

如何在apache/kafka中使用regex消费所有主题？我尝试了上面的代码，但不起作用。

Answer 1

对于正则表达式，请使用以下签名

KafkaConsumer.subscribe(Pattern pattern, ConsumerRebalanceListener listener)

例如。以下代码片段使消费者能够收听带有前缀my_topics_的所有主题

ConsumerRebalanceListener listener = new ConsumerRebalanceListener() {

  @Override
  public void onPartitionsRevoked(Collection<TopicPartition> arg0) {
    // Don't need it now.
  }

  @Override
  public void onPartitionsAssigned(Collection<TopicPartition> arg0) {
    // Don't need it now.
  }
};

pattern = Pattern.compile("my_topics_.*");
kafkaConsumer.subscribe(pattern, listener);