Apache Kafka Meetup => Strata Hadoop World => NYC
Hey folks, we are going to be kicking off our first ever Apache Kafka NYC meetup during Hadoop world (10/15/2014) http://www.meetup.com/Apache-Kafka-NYC/events/206001372/ starting @ 6pm. We already...
View Article--- Article Removed ---
*** *** *** RSSing Note: Article removed by member request. *** ***
View ArticleReplay Strategies
What are the best ways to replay a portion of a topic in the past? I'm using Kafka to process a real-time data stream. Suppose I discover that all data inside of a six-hour window one day ago was...
View ArticleJMX on Kafka 0.8.1
Hi I'm trying to get some JMX stats from a running Kafka instance, I can connect using jconsole and I can see various topic specific information, I can see the "..LogEndOffset" value changing as I add...
View ArticleConsumers don't get data when broker leader is down
Hi there, Zookeeper version: 3.4.6-1569965, built on 02/20/2014 09:09 GMT Kafka version: kafka_2.8.0-0.8.1.1 I have the following architecture/configuration staging2.mtl.shopmedia.com (broker.id=1)...
View ArticleConsumers don't get data when broker leader is down
Zookeeper version: 3.4.6-1569965, built on 02/20/2014 09:09 GMT Kafka version: kafka_2.8.0-0.8.1.1 I have the following architecture/configuration staging2.mtl.shopmedia.com (broker.id=1)...
View ArticleRead a specific number of messages using kafka
Hi, My requirement is to read a specific number of messages from kafka topic which contains data in json format and after reading number of messges, i need to write that in a file and then stop. How...
View ArticleConnection reset by peer
@Neha When you say this is an expected exception, does that imply there is no way of getting rid of those exceptions ? Thanks. — Aniket Kulkarni
View ArticleConnection reset by peer
Hello Neha, I am trying to run some tests which use Kafka 0.8.1.1. The tests do not fail but give out a warning messages which I am trying to get rid off such as : 2014-09-25 11:43:03,572...
View ArticleConsumers don't get any data if broker leader is down
Zookeeper version: 3.4.6-1569965, built on 02/20/2014 09:09 GMT Kafka version: kafka_2.8.0-0.8.1.1 I have the following architecture/configuration staging2.mtl.shopmedia.com (broker.id=1)...
View ArticleBytesOutPerSec is more than BytesInPerSec.
I have set up my kafka broker with as single producer and consumer. When I am plotting the graph for all topic bytes in/out per sec i could see that value of BytesOutPerSec is more than BytesInPerSec....
View ArticleFaster segment recovery after reboot - 0.8.1
Hi, Just got a lovely email a bunch of our EC2 instances will be rebooted in a few days. Some of them run our Kafka 0.8.1 brokers with a few hundred GBs of data in them. Last time Kafka brokers didn't...
View ArticleLeaderNotAvailableException, although leader elected
Hi, What does the exception mean in the following context? I've got two Kafka brokers out which the second one will be elected as leader: kafka2_1 | [2014-09-26 12:35:07,289] INFO [Kafka Server 2],...
View ArticleAutomatic preferred replica election
Hello, A while back, I saw mentioning about making preferred replica election automatic. It would be really nice to have cluster balance restoring automatically. Is this work on the roadmap? Any chance...
View ArticleAWS EC2 deployment best practices
We're planning a deploy to AWS EC2, and I was hoping to get some advice on best practices. I've seen the Loggly presentation [1], which has some good recommendations on instance types and EBS setup....
View Articlerebalance brokers
Hi, All We have some old kafka nodes that are still running 0.7. We disable the replica of topics there. Recently we added some node brokers to that cluster, I found new nodes won't got written or read...
View Articlemulti-node and multi-broker kafka cluster setup
Hi, I am kinda newbie to kafka, I plan to build a cluster with multiple nodes, and multiple brokers on each node, I can find tutorials for set multiple brokers cluster in single node, say...
View ArticleBroker don't get back in ISR when killed and restarted
Hi There, Zookeeper version: 3.4.6-1569965, built on 02/20/2014 09:09 GMT Kafka version: kafka_2.8.0-0.8.1.1 192.168.1.180 zookeeper:2181 broker:9092(broker.id=1) zookeeper.connect=localhost:2181...
View ArticleAfter creating a topic, broker gets dropped from ISR
Hi again, 192.168.1.180 Zk: 192.168.1.180:2181 Kafka: 9092 Broker.id = 1 zookeeper.connect=192.168.1.180:2181 192.168.1.190 Zk: 192.168.1.180:2181 Kafka: 9092 Broker.id = 2...
View Article