如何在没有kafka服务器的情况下运行springboot

Question

我有一个Spring boot项目，它有使用kafka进行日志记录的依赖项。我无法摆脱所述依赖项，因为我的逻辑需要来自该依赖项的代码

我已尝试禁用自动配置

spring.autoconfigure.exclude=org.springframework.boot.autoconfigure.kafka.KafkaAutoConfiguration

我尝试通过bean配置将missingTopicsFatal设置为false

@Bean(name = "kafkaListenerContainerFactory")
public ConcurrentKafkaListenerContainerFactory<?, ?> kafkaListenerContainerFactory(
    ConsumerFactory<Object, Object> kafkaConsumerFactor,
    ConcurrentKafkaListenerContainerFactoryConfigurer configurer) {

  ConcurrentKafkaListenerContainerFactory<Object, Object> factory =
      new ConcurrentKafkaListenerContainerFactory<>();
  configurer.configure(factory, kafkaConsumerFactor);

  ContainerProperties containerProperties = factory.getContainerProperties();
  containerProperties.setMissingTopicsFatal(false);

  ...
  return factory;
}

但很明显，设置已经是假的，因为我的应用程序运行时没有失败，只是tomcat不想打开侦听端口

应用程序启动，但spring拒绝打开侦听端口，并继续使用错误进行循环

Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available.

在本地运行kafka的情况下，应用程序运行得很好，但由于kafka的资源使用情况，现在仅仅输入操作就会变慢。请帮帮忙。

Answer 1

在我看来，您的主要问题是本地kafka安装的资源使用问题。也许先看一下它的配置和数据。也许从fresh开始，清除所有本地数据？

或者，您可以在进程内运行KafkaServer，在主类中运行如下所示：

    Properties kafkaProperties = new Properties();
    kafkaProperties.setProperty("broker.id", "1");
    kafkaProperties.setProperty("host.name", "localhost");
    kafkaProperties.setProperty("listeners", "PLAINTEXT://localhost:" + kafkaPort);
    kafkaProperties.setProperty("log.dir", Files.createTempDir().getAbsolutePath());
    KafkaConfig kafkaBrokerConfig = new KafkaConfig(kafkaBrokerConfig);
    KafkaServer kafkaServer = new KafkaServer(kafkaBrokerConfig, Time.SYSTEM);
    kafkaServer.startup();

或者你可以从Docker上运行Kafaka。例如，请参见docker-compose文件https://github.com/confluentinc/examples/tree/5.4.1-post/cp-all-in-one-community。

您可能只需要动物园管理员和经纪人：

docker-compose.yml：

version: '2'
services:
  zookeeper:
    image: confluentinc/cp-zookeeper:5.4.1
    hostname: zookeeper
    container_name: zookeeper
    ports:
      - "2181:2181"
    environment:
      ZOOKEEPER_CLIENT_PORT: 2181
      ZOOKEEPER_TICK_TIME: 2000

  broker:
    image: confluentinc/cp-kafka:5.4.1
    hostname: broker
    container_name: broker
    depends_on:
      - zookeeper
    ports:
      - "29092:29092"
      - "9092:9092"
    environment:
      KAFKA_BROKER_ID: 1
      KAFKA_ZOOKEEPER_CONNECT: 'zookeeper:2181'
      KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT
      KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://broker:29092,PLAINTEXT_HOST://localhost:9092
      KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
      KAFKA_GROUP_INITIAL_REBALANCE_DELAY_MS: 0