kafka集群频繁报错
[2022-08-10 17:06:21,806] WARN [SocketServer brokerId=3] Unexpected error from /39.103.165.234; closing connection (org.apache.kafka.common.network.Selector)
org.apache.kafka.common.network.InvalidReceiveException: Invalid receive (size = 1212501072 larger than 419430400)
at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:104)
at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:424)
at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:385)
at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:651)
at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:572)
at org.apache.kafka.common.network.Selector.poll(Selector.java:483)
at kafka.network.Processor.poll(SocketServer.scala:890)
at kafka.network.Processor.run(SocketServer.scala:789)
官网说是异常访问http 导致报文过大 有个解决方案是重写kafka原生方法
重新方法操作性不太高 有没有操作性强的解决方案 (除了调大内存 [doge])
你把报错的代码发给我看一下 我
27950 root 20 0 3612172 369580 16756 S 0.0 19.6 2:22.15 java
27950 root 20 0 3612172 369580 16756 S 0.0 19.6 2:22.42 java
27950 root 20 0 3612172 369580 16756 S 0.0 19.6 2:22.67 java
27950 root 20 0 3612172 369580 16756 S 0.0 19.6 2:22.92 java
27950 root 20 0 3612172 369580 16756 S 0.0 19.6 2:23.16 java
27950 root 20 0 3838540 819072 13664 S 0.0 43.5 2:23.84 java
top命令输出的信息 突然内存被kafka占用到43.5%