Problem on re-adding a breakdown broker back
Hi guys and jun, We have a problem when adding a breakdown broker back to the cluster. Hope you guys have some solution for it. A cluster of 5 brokers(id=0~4) of kafka 0.8.0 was running for log...
View ArticleKafka rebalancing causes Zookeeper to fail
I have a basic Zookeeper/Kafka setup. I am still on Kafka 0.8 beta 1, and Zookeeper 3.4.5. The activity on this machine isn't massive...I would say the Kafka queues get a consistent 1 message every 2-3...
View ArticleKafka metrics. Issue with unclean leader election rate
Hi, I have a 3 node Kafka cluster. Iam monitoring the JMX metrics of these 3 nodes. All topics and partitions are distributed across all 3 nodes. But node1 is idle while node2 and node3 are actively...
View ArticleJava major.minor version error
Hi, I have kafka_2.10 version 0.8.0 in my maven dependency. I am trying to run a consumer. It is throwing major.minor version error. *java.lang.UnsupportedClassVersionError:...
View ArticleError in Kafka Producer
Hi all, I am a new user of Kafka. I tried Java example of it and it worked great. Now when I tried to write to a Producer (Java) and send ByteArray to it as a data, I get ClassCastException as below...
View ArticleKafka request.log size is increasing continuously
Hi I have created one node kafka cluster and one topic name test1. Then I started ConsoleProducer and ConsoleConsumer.Both started successfully.But what I see is in the /kafka/kafka_2.8.0-0.8.0/logs/...
View ArticleRegarding question Kafka metrics. Issue with unclean leader election rate
This is wrt question Kafka metrics. Issue with unclean leader election rate (http://www.marshut.com/inkitk/kafka-metrics-issue-with-unclean-leader-election-rate.html) We use Kafka 0.8.0
View Article--csv-reporter-enabled for kafka-consumer-performance.sh
Hi, I've been trying to add --csv-reporter-enabled option for kafka-consumer-performance.sh by going through he following steps, but unable to add it: (1) Added the code (copied from...
View Articlenum.partitions
Hi team, I believe num.partitions is for automatic topic creation. Is that right? The default number of partition for kafka-create-topic.sh is 1. So Will num.partitions impact kafka-create-topic.sh?...
View ArticleApache Samza talk in LA on Feb 18
Hi All, I would be giving a talk on Samza in LA on Feb 18th at 6:30 PM. The talk would cover Samza internals, how it works with Kafka and Yarn and use cases at Linkedin. The venue for the talk would be...
View ArticleNew Producer Public API
As mentioned in a previous email we are working on a re-implementation of the producer. I would like to use this email thread to discuss the details of the public API and the configuration. I would...
View ArticleCalcuate Consumer lag from JMX beans in Kafka 0.7.2
I would like to know what these attributes mean in my Kafka 0.7.2 brokers. I see the following in JConsole for my eventdata topic: kafka.logs.eventdata-0 Attributes Name // Name of partition Size //Is...
View ArticleHow to make an async producer with c++ libkafka?
Does libkafka (c++) allow one to make an async producer? If so, how? Client *client; client = new Client('127.0.0.1', 9092); client->sendProduceRequest(new ProduceRequest(correlationId, clientId,...
View ArticleUsing Kafka on Windows - file path problems
Hi, I have a problem going through start guide on Windows. Basically what I found are file path problems it seems: If I try to set Kafka log dir path in server.properties using Windows file separator,...
View ArticleShell scripts for Windows corrected
Hi, Is there some reason that shell scripts for Windows are separated into its own dir instead being placed in <kafka_dir>/bin with other Unix ones? Most of products out there have both types of...
View ArticleKakfa producer config using ZooKeeper
Hi, I'm new in Kafka, I want to use Producer api, and in config I want to connect to zookeeper, but as I see in the documentation and API , it was available before, and right now, we should configure a...
View Articlefinagle-kafka
Hi, all. I'm developing Kafka client in Netty and Twitter's Finagle from scratch. It enables us to handle Kafka more functional and composable way based on "Future" monad. We can also utilize many...
View Articlefinagle-kafka
Hi, all. I'm developing Kafka client in Netty and Twitter's Finagle from scratch. It enables us to handle Kafka more functional and composable way based on "Future" monad. We can also utilize many...
View ArticleReg Exception in Kafka
Hi, I have a remote server (EC2) setup with Kafka cluster setup. There are 3 brokers each running in the port 9092,9093,9094. The zookeeper is running in the port 2181. When I send message to the...
View Article