Kafka Metrics Kafka Streams App中的NullPointerExc0019

Question

我正在使用SpringBoot和Kafka流，尽管我没有使用SpringCloud流。

我确实使用了StreamsBuilderFactoryBean并将KafkaStreamsMicrometerListener设置为：

 @Bean
    public StreamsBuilderFactoryBean streamsApp() {
     
        StreamsConfig streamsConfig = new StreamsConfig(props);
        StreamsBuilderFactoryBean streamsBuilder = new StreamsBuilderFactoryBean(streamsConfig);
streamsBuilder.addListener(new KafkaStreamsMicrometerListener(meterRegistry,
                Collections.singletonList(new ImmutableTag("stream_app_id", streamingAppName))));
        return streamsBuilder;
    }

但当我启动应用程序时，我点击了以下NPE：

    java.util.ConcurrentModificationException: null\n\tat 
    java.util.HashMap$HashIterator.nextNode(Unknown Source)\n\tat 
    java.util.HashMap$ValueIterator.next(Unknown Source)\n\tat 
    org.apache.kafka.streams.processor.internals.ClientUtils.producerMetrics(ClientUtils.java:99)\n\tat 
    org.apache.kafka.streams.processor.internals.ActiveTaskCreator.producerMetrics(ActiveTaskCreator.java:282)\n\tat 
    org.apache.kafka.streams.processor.internals.Tasks.producerMetrics(Tasks.java:291)\n\tat 
    org.apache.kafka.streams.processor.internals.TaskManager.producerMetrics(TaskManager.java:1309)\n\tat 
    org.apache.kafka.streams.processor.internals.StreamThread.producerMetrics(StreamThread.java:1212)\n\tat 
    org.apache.kafka.streams.KafkaStreams.lambda$metrics$5(KafkaStreams.java:546)\n\tat 
    org.apache.kafka.streams.KafkaStreams.processStreamThread(KafkaStreams.java:1596)\n\tat org.apache.kafka.streams.KafkaStreams.metrics(KafkaStreams.java:545)\n\tat 
    io.micrometer.core.instrument.binder.kafka.KafkaMetrics.lambda$toMetricValue$4(KafkaMetrics.java:244)\n\tat
    io.micrometer.core.instrument.cumulative.CumulativeFunctionCounter.count(CumulativeFunctionCounter.java:39)\n\tat 
    io.micrometer.prometheus.PrometheusMeterRegistry.lambda$newFunctionCounter$10(PrometheusMeterRegistry.java:312)\n\tat 
    io.micrometer.prometheus.MicrometerCollector.collect(MicrometerCollector.java:70)\n\tat
    io.prometheus.client.CollectorRegistry$MetricFamilySamplesEnumeration.findNextElement(CollectorRegistry.java:207)\n\tat
    io.prometheus.client.CollectorRegistry$MetricFamilySamplesEnumeration.nextElement(CollectorRegistry.java:240)\n\tat 
    io.prometheus.client.CollectorRegistry$MetricFamilySamplesEnumeration.nextElement(CollectorRegistry.java:161)\n\tat 
    io.prometheus.client.exporter.common.TextFormat.write004(TextFormat.java:65)\n\tat 
    org.springframework.boot.actuate.metrics.export.prometheus.TextOutputFormat$2.write(TextOutputFormat.java:57)\n\tat 
    org.springframework.boot.actuate.metrics.export.prometheus.PrometheusScrapeEndpoint.scrape(PrometheusScrapeEndpoint.java:58)\n\tat 
    jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Unknown Source)\n\tat 
    jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)\n\tat 
    jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)\n\tat 
    java.lang.reflect.Method.invoke(Unknown Source)\n\tat 
    org.springframework.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:282)\n\tat 
    org.springframework.boot.actuate.endpoint.invoke.reflect.ReflectiveOperationInvoker.invoke(ReflectiveOperationInvoker.java:74)\n\tat 
    org.springframework.boot.actuate.endpoint.annotation.AbstractDiscoveredOperation.invoke(AbstractDiscoveredOperation.java:60)\n\tat 
    org.springframework.boot.actuate.endpoint.web.servlet.AbstractWebMvcEndpointHandlerMapping$ServletWebOperationAdapter.handle(AbstractWebMvcEndpointHandlerMapping.java:291)\n\tat 
    org.springframework.boot.actuate.endpoint.web.servlet.AbstractWebMvcEndpointHandlerMapping$OperationHandler.handle(AbstractWebMvcEndpointHandlerMapping.java:376)\n\tat 
    jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Unknown Source)\n\tat 
    jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)\n\tat 
    jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)\n\tat java.lang.reflect.Method.invoke(Unknown Source)\n\tat 
    org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)\n\tat 
    org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150)\n\tat 
    org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117)\n\tat 
    org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)\n\tat 
    org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)\n\tat 
    org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)\n\tat 
    org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1067)\n\tat 
    org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963)\n\tat 
    org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)\n\tat 
    org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)\n\tat 
    javax.servlet.http.HttpServlet.service(HttpServlet.java:655)\n\tat 
    org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)\n\tat 
    javax.servlet.http.HttpServlet.service(HttpServlet.java:764)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat 
    org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat 
    org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)\n\tat 
    org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat 
    org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)\n\tat 
    org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat 
    org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96)\n\tat 
    org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat 
    org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)\n\tat 
    org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)\n\tat 
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)\n\tat 
    org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197)\n\tat 
    org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)\n\tat 
    org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:540)\n\tat 
    org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135)\n\tat 
    org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)\n\tatorg.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)\n\tat org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:769)\n\tat org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:357)\n\tat org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:382)\n\tat org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)\n\tat org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:893)\n\tat org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1726)\n\tat org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)\n\tat org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)\n\tat org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)\n\tat org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)\n\tat java.lang.Thread.run(Unknown Source)\n"}

更新：

我使用以下依赖项：

• Spring靴2.5.5
• 千分尺1.7.4
• apache kafka streams 3.0.0

感谢您的帮助！谢谢

Answer 1

似乎org。阿帕奇。Kafka。溪流。Kafka斯特团队。metrics（KafkaStreams.java:545）调用失败，这似乎是Kafka客户端的问题，而不是Spring Boot/Prometheus/Millimer的问题。

你没有提到你使用的任何版本，但是从堆栈跟踪来看，我假设你的微米版本很旧了。由此，我假设您的Spring Boot和Kafka客户端也很旧，所以首先我会尝试升级依赖项，希望问题已经在Kafka客户端中得到解决。