OffsetOutOfRangeException and getOffsetsBefore
Hi, We are currently using kafka-0.7.1 right now. I have two questions: 1. We use SimpleConsumer to aggregate messages to log files and there is no zookeeper. Sometimes we can see...
View Articlemultiple consumers on a topic
I am very new to kafka, so I'll apologize in advance for any stupid questions... That being said is it possible within kafka to have multiple consumers on a single topic? I had assumed the answer was...
View Articleis 0.8 stable?
Hi, Sorry if I missed the announcement, but is 0.8 stable/production worthy as of yet? Is anyone using it in the wild?
View ArticleMirrorMaker consumer does not use broker.list property
Hi, I'd like to bump this issue: https://mail-archives.apache.org/mod_mbox/kafka-users/201212.mbox/%3CFA0E8A0482D176408729D604142248F319D22CA7%40EXCHANGE14.actuate.com%3E as I'm encountering the same...
View ArticleDeadline Extension: 2013 Workshop on Middleware for HPC and Big Data Systems...
we apologize if you receive multiple copies of this message =================================================================== CALL FOR PAPERS 2013 Workshop on Middleware for HPC and Big Data Systems...
View Articleone consumerConnector or many?
In thinking about the design of consumption, we have in mind a generic consumer server which would consume from more than one message type. The handling of each type of message would be different. I...
View ArticleSimpleConsumer and message offsets
Hi, Iam using a program which reads data from a stream using SimpleConsumer. Is there a way for SimpleConsumer to remember the last offset read? I want the program to continue from the last offset read...
View ArticleInvalidMessageException
Hi, I am using kafka 0.7.2, do you see this exception? What's the possible reason? 2013/05/29 19:18:19.325 ERROR [KafkaRequestHandlers] [] Error processing ProduceRequest on gallery:0...
View Articlekafka.common.LeaderNotAvailableException: No leader for any partition
I am working on deploying Kafka 0.8 to our test cluster that consist of 2 kafka servers and 2 zookeper nodes. I created topic using the following command bin/kafka-topics.sh --create --topic...
View ArticleIssue during commitOffsets using SimpleConsumer
Hi, I get the following error on running SimpleConsumer.commitOffsets(). Could you tell me what is the issue? *java.io.EOFException*: Received -1 when reading from channel, socket has likely been...
View Articleasync producer and new ack levels
With 0.8, we now have ack levels when sending messages. I'm wondering how this applies when sending messages in async mode. Are there any guarantees at least that each async batch will wait for the...
View Articlequestion about usage of SimpleConsumer
In Kafka, the consumers are responsible for maintaining state information (offset) on what has been consumed (refer from kafka design page).high-level consumer api will store its consumption state in...
View ArticleWhat exactly happens if fetch size is smaller than the next batch (0.72 and...
Hello -- I'll try to look at the code, but I'm seeing something here and I want to be *sure* I'm correct. Say a batch sitting in a 0.72 partition is, say, 5MB in size. An instance of a high-level...
View ArticleSend multiple messages to multiple topics in one request
Version 7 of Kafka allowed to send messages to multiple topics within one request. I assume I can do samething in version 8, am I correct? Does my code piece look correct?...
View ArticleCode Example for createMessageStreams
Good evening. Would it be possible to get sample code where the api bellow is used in the consumer with sample of Decoder. public <K,V> Map<String, List<KafkaStream<K,V>>>...
View ArticleHelp with kafka-hadoop loader pipeline ???
Hi We were trying to use the kafka-hadoop loader for loading messages from kafka into the hadoop ecosystem https://github.com/michal-harish/kafka-hadoop-loader Our consumer is hadoop in this case. The...
View ArticleKafka Hadoop Consumer for multiple brokers
Hi, I was going through the hadoop-consumer in the contrib folder. There is property that asks for the kafka server URI. This might sound silly but from looking at it, it seems to be only for a single...
View Articlekafka 0.8
Hello, Just wanted to know where we are with the beta release for 0.8? More importantly, is 0.8 going to be publicly available from a maven repository? How about different versions of 0.8 built for...
View Articlefacing the same problem
http://mail-archives.apache.org/mod_mbox/kafka-users/201301.mbox/%3CCAAG86fpamV2XeB5=XX19XC81q1F93AvN9G3r3hYjqZ-LnxxSow [ at ] mail.gmail.com%3E Regards, Gaurang Jhawar USC...
View Articlesync and async
Hi What is the difference between an aync producer and a sync producer with request.required.acks=0? Is there any case where an sync producer with request.required.acks=0 is used? Thanks. Regards, Libo
View Article