found that the producer called localhost: 9092 in Kafka of Java client.
Hi， I'm using Kafka of Java client to send events to my data center, but found that the producer called localhost: 9092. Actually , my broker list doesn't include localhost. why ? Thanks. Best Regards,...
View Articleinvalid pom in maven central, for 0.8.0-beta1
I have been using a pom file for 0.8.0 that I hand-edited from the one generated with sbt make:pom. Now that there's a version up on maven central, I'm trying to use that. It looks like the pom file...
View ArticleMetrics: via Broker vs. Producer vs. Consumer
Hi, I was looking at https://cwiki.apache.org/confluence/display/KAFKA/Operations#Operations-Monitoring and noticed there is no information about which metrics are available in which process/JVM/JMX....
View ArticleKafka low-latency usage
Hi all, I'm considering to use the Kafka as a low-latency message system. I want to have a system, that is able to minimise the delay between sending from producer and reading from consumer. I created...
View Articlekafka 0.7 jar file
Hi, I have one application based on netty client which gets messages from my server. I want to send these messages to kafka. So I wrote my producer code along with application by importing kafka jar...
View Articlehow to force a consumer to start at the beginning
We are creating a consumer with properties and I did not see a property that screamed that it was to start at the beginning of a topic. Is there such a property? Thanks, rob [cid:image001.png [ at ]...
View ArticleSpring Integration Kafka support
Hello, Spring Integration extensions has a new module to support Kafka 0.8 integration. Currently, adapters for producer and the high level consumer are available. It is still in development. Here is...
View ArticlePartitions per topic per broker?
Hi guys, apologies in advance for the newb question: I am running a 3 broker setup, and I have a topic configured with 100 partitions in the broker config. But I've noticed that what seems to happen is...
View ArticleGeneral LinkedIn Question
Hi LinkedIn Guys and Girls, Out of curiosity do you guys use any other messaging systems within LinkedIn besides Kafka? For instance, are there any more complex messaging use cases requiring something...
View Articleproducer behavior when network is down
Hey guys, We decided to use Kafka in our new project, now I spend some time to research how Kafka producer behaves while network connectivity problems. I had 3 virtual machines(ubuntu 13.04, running on...
View ArticleFatal issue (was RE: 0.8 throwing exception "Failed to find leader" and...
This NOT a harmless race. Now my QA teammate is encountering this issue under load. The result of it is a background thread that is spinning in a loop that always hits a NullPointerException. I have...
View ArticleClient improvement discussion
I sent around a wiki a few weeks back proposing a set of client improvements that essentially amount to a rewrite of the producer and consumer java clients....
View Articlehigh level consumer usage question with auto topic creation
I am trying to write a junit test for working with an embedded Kafka 0.8 server where I send and receive messages just to verify my embedded server, producer and consumer wrappers work. Order of...
View Articlehow to downgrade the metrics jar from 3.x to 2.2.0
Hi, I am running kafka-0.7 but when running producer got error java.lang.NoSuchMethodError: com.yammer.metrics.core.TimerContext.stop()J. So I want to downgrade it to metrics 2.2.0 jar, So I replaced...
View Articlereprocessing messages in kafka
Hi , I just don't know which mail list is correct to post this question( storm or kafka)? Sorry for cross post. I just read the documentation which describe guaranteed message processing with storm -...
View ArticleUnable to consume data because of below issue
Can you guys help me on this ?.Getting below error on High Level consumer.But topic does exist. {2013-07-31 11:52:57,176} WARN [UNITTEST_MERD7-181710-1375293172238-5f1b0917-leader-finder-thread]...
View ArticleRE:class kafka.common.LeaderNotAvailableException...
I am running 0.8 beta version, I wrote a producer with auto.create.topics.enable = true & type async , When I run the producer class getting below [ProducerSendThread-] INFO Fetching metadata from...
View ArticleMoving raw logs from kafka into hadoop using camus
Good afternoon. I am new to camus and would like to use it to move raw data from kafka to hadoop. Do I have to pre-create avro schema in advance or it automatically created for me? What is the role of...
View ArticleRandom Broker/Partition for Producer
Hi, I want to randomly send my messages to a random broker and a random partition registered in Zookeeper. If, in my producer configuration, I only specify zk.connect and I don't specify any...
View ArticleKafka log4j appender infinite logging cycle question
Hi, I have the following scenario: - using the Kafka log4j appender (in fact its a variant on the OOTB appender) - configuring the appender for the root log4j category - appender is using the async...
View Article
