Kafka High Level Consumer Fetch All Messages From Topic Using Java API...
Good Morning, I am testing the Kafka High Level Consumer using the ConsumerGroupExample code from the Kafka site. I would like to retrieve all the existing messages on the topic called "test" that I...
View ArticleLinkedin Camus vs kafka-hadoop-loader vs hadoop-consumer
Hello, I've been studying different options to consume messages from kafka to hadoop(hdfs) and found three odds. Linkedin Camus - https://github.com/linkedin/camus kafka-hadoop-loader -...
View Articlebroker offline
Hi team, We have three brokers on our production cluster. I noticed two of them somehow got offline and then re-registered with zookeeper and got back online. It seems the issue was caused by some...
View ArticleZK 3.4.5 compatibility
Is anyone running 0.8 (or pre-0.8.1) with the latest Zookeeper? Any known compatibility issues? I didn't see any in JIRA but thought I'd give a shout.
View Articletrunk unit test failure
- LogOffsetTest <kafka.server.LogOffsetTest.html>. testEmptyLogsGetOffsets<kafka.server.LogOffsetTest.html#testEmptyLogsGetOffsets> - LogOffsetTest <kafka.server.LogOffsetTest.html>....
View ArticleError while fetching metadata for partition [my-topic,0]...
Hi, Kafka 8 is giving issues. I want to connect to kafka via python Below is the error I get in kafka and in python. I just dont get why kafka fails.......how do I resolve....how do I just reset...
View Articleoffset asked for broker is more than what broker has when does this happen -...
Hi, I have set up a clean kafka set up on three ec2 nodes. I have pushed in two messages into the set up. But i invoke the high level consumer, i get this error in the kafka broker. I ran the Consumer...
View ArticleERROR encountered while changing partition's state from New to Online
Hi I am getting the following errors state-change.log:[2014-02-16 10:23:20,708] ERROR Controller 0 epoch 2 encountered error while changing partition [request_trace,18]'s state from New to Online since...
View ArticlePartitions and Scale out
Hello Masters, I have 2 questions: 1. Whether all Topic's partitions include identical data or the Topic's messages spread among defined partitions and each partition includes subset of data? 2....
View ArticleHow to discover broker Addresses for Producer
Hi I am implementing a producer. * ZkClient zkClient = new ZkClient(zookeeperUrl, 40000, 60000, new BytesPushThroughSerializer());* * List<String> brokerIdList =...
View ArticleHow to set Group Id in SimpleConsumer
Hi, I just wonder how can I assign GroupId when I use SimpleConsumer ( https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example) for fetching data from Kafka. Is it the last...
View ArticleReplay messages
Hi, Is it possible to replay only specific message in Kafka? For example message offsets are 1,2,3,4,5,6 a) Is it possible to replay only message with offset 3? b) is it possible to replay messages...
View ArticleKafka SimpleConsumer not working
Hi, I am using kafka for the first time, and was running the sample from https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example However, I cannot read any data from kafka. The...
View Articleproducer not pushing the data into broker
hi, I am testing kafka 0.8 on my local machine. i have only one zookeeper and one kafka broker running. when i run the console producer i get this error: [2014-02-21 16:01:20,512] WARN Error while...
View ArticleUnexpected broker election
Hi all, This has happened a couple of times to me now in the past month, and I’m not entirely sure of the cause, although I have a suspicion. Early this morning (UTC), it looks like one of my two...
View ArticleDelayed Queue
Dear All, I am looking for a Delayed Queue implementation for my distributed system requirement. Would like to know if I can achieve the same using Kafka. Regards, Jagan
View ArticleHost resolution issue solution
Hi All, I have banged my head for nearly 3 hours trying to find out why my producer code did not enqueue the message. And later found a very simple issue. I dont want anyone else to waste their time in...
View Articlegetting Error name
Hi, everyone. I'm using Kafka 0.8 with Java API. Is there any Error Mapping class or constants? I found Kafka Protocol page in wiki. There is error code table, but I want to get error name by error...
View ArticleOffsetoutofRange Exception
Hi there, I am a newbie to Kafka. I am trying to use the ( https://github.com/endgameinc/elasticsearch-river-kafka) plugin to pull the messages from Kafka. When I start the ElasticSearch, the 1st...
View ArticleSimpleConsumer not consuming messages
package kafka.examples; //$Id: $ import java.net.InetAddress; import java.nio.ByteBuffer; import java.util.ArrayList; import java.util.HashMap; import java.util.List; import java.util.Map; import...
View Article