Property Name Changes in Different Versions of Kafka
Hi, I have two doubts for changes in different versions of Kafka available: *Doubt1:* I am using Kafka from the version kafka-0.7.1-incubating-src.tgz. The latest stable version is...
View Articlenode.js native bindings
Hi There, in case anyone is interested,we created a node.js binding using librdkafka [1]. Publish only so far, for kafka_2.8.0-0.8.0-beta1+ For more info, check out the github page [2], and for an...
View ArticleDuplicate records in Kafka 0.7
Hi, I would like to check to see if other people are seeing duplicate records with Kafka 0.7. I read the Jira's and I believe that duplicates are still possible when using message compression on Kafka...
View ArticleMutli Consumers
Hi, how many consumers can I connect to a kafka cluster? I am running a kafka server with a separate zookeeper server in my development box. For testing purpose I am now trying to create a a< large...
View Articlecustom kafka consumer - strangeness
Hi, I'm writing a custom consumer for kafka 0.8. Everything works except for the following: a. connect, send fetch, read all results b. send fetch c. send fetch d. send fetch e. via the console...
View ArticleVelocity on local machine
Hi, I am currently benchmarking Kafka against ActiveMQ and I got some results the surprised my quite a lot. ActiveMQ managed to deliver 4x more messages when running locally. But from all what I was...
View ArticleTopic not created if number of live brokers less than # replicas
Hi All, As kafka is known behavior is : number of live brokers can not be less than # replicas when creating a new topic. I raised a jira (https://issues.apache.org/jira/browse/KAFKA-1182) regarding...
View ArticleLooks like consumer fetchers get stopped we are not getting any data
Please let us know why we are not getting any data from Kafaka after this log from Kafka,can you guys lets us know. What could be causing all fetchers associated to be stooped why it is not doing...
View ArticleMirroring datacenters without vpn
Hi, I am trying to figure out best deployment plan and configuration with ops to ship new version of our system that will use kafka. Multiple geo-distributed datacenters are a given, and we are...
View ArticleConsumers can't connect while broker is under load
Hi, I have a cluster of 12 brokers receiving 10,000 msg/s from producers where each message is roughly 2.5KB. We also have 12 ZooKeepers and everything is on AWS. Under these conditions, top (the Linux...
View ArticleKafka with Docker - producer disconnecting
Hi everyone, I am attempting to run Zookeeper and Kafka in dockers. Both startup normally and Kafka connects ok. I think my containers are linked fine because I am able to list topics, and create...
View ArticleSpring Integration Kafka support
Hi, I was doing a poc using https://github.com/SpringSource/spring-integration-extensions/tree/master/spring-integration-kafka. I figured that code is expecting the brokerid=0 and ideally this will not...
View Articlerestoring broker node / zookeeper question
I have two questions: 1. We plan to initially run Kafka without partitioning or replication, simply having two single node Kafka (broker) servers in two geographically diverse locations. Using periodic...
View Articlebadversion exception and unable to recover
Hi all Because of badversion exception, the id 1 broker is not a leader. But the kafka thread on that server is already in work. The id 1 broker is only for replication. I want to recover the id 1...
View Articlev0.8.0 JMX Beans
Hi, I'm upgrading from version 0.7.2-incubating to 0.8.0, and I've noticed that the JMX beans have changed considerably. I'm trying to find equivalent values to the following (all were previously on...
View ArticleKafka Consumer connection issue
Hi, I keep getting the folllowing error in Kafka. 2014-01-14 10:46:55:073 SyncProducer [ERROR] Producer connection to <my ip address>:9092 unsuccessful...
View ArticleNeed help for kafka on windows
Hi All, I am new to apache kafka. Can you please any one help me to setup apache kafka (kafka_2.8.0-0.8.0). I have download and try to run batch file under bin/windows folder I am getting below error....
View ArticleKafka Authenication and Monitoring Tools
Hi, Which security implementation is imposed by Kafka? What type of authentication is required by Kafka? Which tools would best monitor the performance of Kafka clusters? Joseph Simmons Accenture LLC...
View Articlepurging a topic
Hi folks, I am writing a tool to "purge" the pending topics for a user. Assume the user has never consumed this topic previously. If I create all the nodes on the path...
View ArticleUpcoming Apache Samza talk in Seattle, January 22
Hey all- Anyone in the Seattle area interested in Apache Samza should come to Bellevue next week for the Seattle Scalability Meetup. I'll be presenting an overview of the project, how it works with...
View Article