druid - What kafka.common.OffsetOutOfRangeException means -
i'm trying load data through apache kafka , getting error:
kafka.common.offsetoutofrangeexception: offset 1003786 out of range @ kafka.log.log$.findrange(log.scala:46) @ kafka.log.log.read(log.scala:264) @ kafka.server.kafkarequesthandlers.kafka$server$kafkarequesthandlers$$readmessageset(kafkarequesthandlers.scala:112) @ kafka.server.kafkarequesthandlers$$anonfun$2.apply(kafkarequesthandlers.scala:101) @ kafka.server.kafkarequesthandlers$$anonfun$2.apply(kafkarequesthandlers.scala:100) @ scala.collection.traversablelike$$anonfun$map$1.apply(traversablelike.scala:206) @ scala.collection.traversablelike$$anonfun$map$1.apply(traversablelike.scala:206) @ scala.collection.indexedseqoptimized$class.foreach(indexedseqoptimized.scala:34) @ scala.collection.mutable.arrayops.foreach(arrayops.scala:34) @ scala.collection.traversablelike$class.map(traversablelike.scala:206) @ scala.collection.mutable.arrayops.map(arrayops.scala:34) @ kafka.server.kafkarequesthandlers.handlemultifetchrequest(kafkarequesthandlers.scala:100) @ kafka.server.kafkarequesthandlers$$anonfun$handlerfor$3.apply(kafkarequesthandlers.scala:40) @ kafka.server.kafkarequesthandlers$$anonfun$handlerfor$3.apply(kafkarequesthandlers.scala:40) @ kafka.network.processor.handle(socketserver.scala:296) @ kafka.network.processor.read(socketserver.scala:319) @ kafka.network.processor.run(socketserver.scala:214) @ java.lang.thread.run(thread.java:724)
what exception mean , how can fix it?
offsetoutofrangeexception
indicates client has requested range no longer available on server.
happen topic log not exists anymore based on retention policy in kafka setup.
if using simpleconsumer
need handle offsetoutofrange exception in code. ideally consumer should issue offsetrequest latest/earliest offset available on server, , use in fetchrequest (as parameter)
Comments
Post a Comment