kafka假死 & Direct buffer memory

ERROR Processor got uncaught exception. (kafka.network.Processor)
java.lang.OutOfMemoryError: Direct buffer memory
        at java.nio.Bits.reserveMemory(Bits.java:658)
        at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
        at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:306)
        at sun.nio.ch.Util.getTemporaryDirectBuffer(Util.java:174)
        at sun.nio.ch.IOUtil.read(IOUtil.java:195)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
        at org.apache.kafka.common.network.PlaintextTransportLayer.read(PlaintextTransportLayer.java:108)
        at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:97)
        at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71)
        at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:160)
        at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:141)
        at org.apache.kafka.common.network.Selector.poll(Selector.java:286)
        at kafka.network.Processor.run(SocketServer.scala:413)



查看kafka进程和监听端口情况,发现都是正常的:
ps -A |grep kafka      
netstat -nultp |grep 9092


杀掉进程重启
ps -ef |grep kafka |grep -v grep |awk '{print $2}'  | xargs kill -9 
bin/kafka-server-start.sh config/server.properties &


究其原因:NIO的时候direct buffer不够


解决办法:
/usr/local/kafka/binkafka-run-class.sh
-XX:MaxDirectMemorySize加大,该参数默认是64M,可以根据需求调大
并且检查JVM参数里面有无:-XX:+DisableExplicitGC,如果有就去掉.


版权声明:本文为zhanglh046原创文章,遵循CC 4.0 BY-SA版权协议,转载请附上原文出处链接和本声明。