druid - What kafka.common.OffsetOutOfRangeException means -


i'm trying load data through apache kafka , getting error:

kafka.common.offsetoutofrangeexception: offset 1003786 out of range @ kafka.log.log$.findrange(log.scala:46) @ kafka.log.log.read(log.scala:264) @ kafka.server.kafkarequesthandlers.kafka$server$kafkarequesthandlers$$readmessageset(kafkarequesthandlers.scala:112) @ kafka.server.kafkarequesthandlers$$anonfun$2.apply(kafkarequesthandlers.scala:101) @ kafka.server.kafkarequesthandlers$$anonfun$2.apply(kafkarequesthandlers.scala:100) @ scala.collection.traversablelike$$anonfun$map$1.apply(traversablelike.scala:206) @ scala.collection.traversablelike$$anonfun$map$1.apply(traversablelike.scala:206) @ scala.collection.indexedseqoptimized$class.foreach(indexedseqoptimized.scala:34) @ scala.collection.mutable.arrayops.foreach(arrayops.scala:34) @ scala.collection.traversablelike$class.map(traversablelike.scala:206) @ scala.collection.mutable.arrayops.map(arrayops.scala:34) @ kafka.server.kafkarequesthandlers.handlemultifetchrequest(kafkarequesthandlers.scala:100) @ kafka.server.kafkarequesthandlers$$anonfun$handlerfor$3.apply(kafkarequesthandlers.scala:40) @ kafka.server.kafkarequesthandlers$$anonfun$handlerfor$3.apply(kafkarequesthandlers.scala:40) @ kafka.network.processor.handle(socketserver.scala:296) @ kafka.network.processor.read(socketserver.scala:319) @ kafka.network.processor.run(socketserver.scala:214) @ java.lang.thread.run(thread.java:724)

what exception mean , how can fix it?

offsetoutofrangeexception indicates client has requested range no longer available on server.
happen topic log not exists anymore based on retention policy in kafka setup.
if using simpleconsumer need handle offsetoutofrange exception in code. ideally consumer should issue offsetrequest latest/earliest offset available on server, , use in fetchrequest (as parameter)


Comments

Popular posts from this blog

apache - Remove .php and add trailing slash in url using htaccess not loading css -

javascript - jQuery show full size image on click -