kafka & docker
Hi, Any one has dockerized kafka working? Should we specify the ip address? I expected everything working on just localhost but saw this "SEVERE: Producer connection to 172.17.0.3:9092 unsuccessful"....
View Article0.8.1.2 Release
Hi, I wanted to kick off a specific discussion on a 0.8.1.2 release. Here are the JIRAs I would like to propose to back port a patch (if not already done so) and apply them to the 0.8.1 branch for a...
View ArticleStill Stale TopicMetadata
Hi Kafka users, Was there ever a JIRA ticket filed for this? "Re: Stale TopicMetadata" http://mail-archives.apache.org/mod_mbox/kafka-users/201307.mbox/%3CE238B018F88C39429066FC8C4BFD0C2E019BED2D [ at...
View ArticleCreated topic by 2 partitions, only can use the one partition
Hi, Guys It is very weird, I created a topic with 2 partitions couple weeks ago, and I can only production the message to partition 0, not partition 1, but for now, I created a new topic again with 2...
View Articleprogrammatically get number of items in topic/partition
Hi, How can I programmatically get the number of items in a topic, pending for consumption? If no programmatic way is avail, what other method is available? Shlomi
View Articlemap reduce Outputformat KafkaOutputFormat
Hi All, After a map reduce computation I would like to send the results out to the a Kafka queue. Is there a bridge available that will let me publish the output to a Kafka queue. Similar to the...
View ArticleReassigning Partition Failing
Hi All, I had a 0.8.1.1 Kafka Broker go down, and I was trying to use the reassign partition script to move topics off that broker. When I describe the topics, I see the following: Topic:...
View Articlekafka producer performance test
Hi, All I built a 3-node kafka cluster, I want to make performance test, I found someone post following thread, that is exactly the problem I have: While testing kafka producer performance, I found 2...
View ArticleDifferent free space and log files between nodes
Hi, I've noticed an interesting behaviour which I hope someone can fully explain. I have 3 Kafka Node cluster with a setting of log.retention.hours=168 (7 days) and log.segment.bytes=536870912. I...
View Articlecan't run kafka example code
Hi, all Here I want to run example code associated with kafka package, I run as readme says: To run the demo using scripts: + 1. Start Zookeeper and the Kafka server + 2. For simple consumer demo, run...
View Articlecan't gradle
I git clone the latest kafka package, why can't I build the package gradle FAILURE: Build failed with an exception. * Where: Script '/home/ubuntu/kafka/gradle/license.gradle' line: 2 * What went wrong:...
View Articleauto topic creation not working for attempts to consume non-existing topic
Hello Apache Kafka community, auto.create.topics.enable configuration option docs state: "Enable auto creation of topic on the server. If this is set to true then attempts to produce, consume, or fetch...
View ArticleProblem determining consumer lag via jmx
Refering to the monitoring secton available on the kafka doc website I am unable to see kafka.consumer bean on the jconsole. Is this bean not exposed via jconsole ?...
View ArticleChanging number of partitions after topic creation tool
I was reading online that a tool was coming to change the number of partitions of a topic after it has been created. Is this tool available yet? {developer : Github...
View ArticleHL publishing, retries and potential race condition
Hello Apache Kafka community, When trying to publish (using high level sync producer) a message on a non-existing topic (with implicit topic creation enabled), with message.send.max.retries set to 1,...
View ArticleActive-active inter-cluster synchronization
Hi, I'm evaluating Kafka for an active-active inter-cluster synchronization scenario (with network partition tolerance). I've read most of what I could find about this and the section that I think sums...
View Articlemigrating log data to new locations
Hi, I have a Kafka 0.8.1.1 cluster consisting in 4 servers with several topics on it. The cluster was initially configured to store kafka log data in a single directory on each server (log.dirs =...
View ArticleNo process listening on advertised.port
Hello There, I have the following in my server.properties on a two node kafka test cluster …. port=6667 host.name=f-bcpc-vm3.bcpc.example.com advertised.host.name=f-bcpc-vm3.bcpc.example.com...
View Articlerate of producers writing to a topic?
Hi, Is there a way to monitor the rate of rates to a particular topic? I wish to monitor the frequency of incoming tuples in order to consume from the topic in particular ways depending on the incoming...
View Article