Javadoc errors in MetricName when building with Java 8
Is Java 8 supported for building Kafka? Or do you only support Java 7? I just noticed that the latest code on the 0.8.2 branch fails on the javadoc in the new MetricName class due to Java 8's javadoc...
View Articlekafka brokers going down within 24 hrs
Hello, I have configured kafka nodes to run via supervisord and see following exceptions and eventually brokers going out of memory. i have given enough memory and process 1 event/second. kafka goes...
View ArticleCurrent vote - 0.8.2.0-RC1 or 0.8.2.0?
Hello Apache Kafka community, Is currently active vote for 0.8.2.0-RC1 or 0.8.2.0? If the vote is for 0.8.2.0-RC1 why isn't that reflected in artifact metadata? Version should be 0.8.2.0-RC1, 0.8.2-RC1...
View ArticleBackups
Does anyone have any thoughts on Kafka broker backups? All of our topics have a replication factor of 3. However I just want to know if anyone does anything about traditional backups. My background is...
View ArticleDecrease the number of partitions for topic
Hi. Someone knows if with the new versions of Kafka will be posible decrease the number of partitions for one topic? thanks.
View Articlekafka cluster on aws
I can't seem to find much information to help me (being green to kafka) on setting up a cluster on aws. Does anyone have any sources? The question I have off the bat is, what methods have already been...
View ArticleBest Go Client Library
I’m looking at implementing Kafka consumers in Go. From the Kafka wiki, I see that there are two clients available. 1. https://github.com/Shopify/sarama 2. https://github.com/stealthly/go_kafka_client...
View ArticleProduction settings for JDK 7 + G1 GC
Greetings all We're expanding our Kafka cluster, and I thought this would be a good time to try the suggestions in http://www.slideshare.net/ToddPalino/enterprise-kafka-kafka-as-a-service slide #37...
View ArticleLeadership rebalance causing drop of incoming messages
Hello, We did a manual leadership rebalance (using PreferredReplicaLeaderElectionCommand) under heavy load and found that there is a significant drop of incoming messages to the broker cluster for more...
View Articleserializable kafka producer pool
Hi, Does anyone have a serializable kafka producer pool that uses the KafkaProducer.crateProducer() method? I'm trying to use the Spark borrow feature to cache the kafka producers. Thanks, Josh
View ArticleConfiguring location for server (log4j) logs
By default Kafka writes its server logs into a "logs" directory underneath the installation root. I'm trying to override this to get it to write logs to an external location so that I can separate all...
View Article"java.io.IOException: Too many open files" error
Hi, all We test our production kafka, and getting such error [2015-01-15 19:03:45,057] ERROR Error in acceptor (kafka.network.Acceptor) java.io.IOException: Too many open files at...
View ArticleQuery regarding Kafka publishing
Hi , I have a general query - As per the code in Kafka producer the serialization happens before partitioning , Is my understanding correct ? If yes whats the reason for it Regards, Liju John
View ArticleKOYA vs. Samza?
Hi, I was wondering if anyone can compare and contrast KOYA and Samza? Thanks, Otis
View ArticleConsumer questions
Hi, I am following this link: https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example for a consumer design using kafka_2.9.2 version 0.8.1.1 (what I can find in maven central)....
View ArticleSyslog Producer to Kafka
Hi, we just opened sourced a syslog producer to Kafka https://github.com/stealthly/go_kafka_client/tree/master/syslog. This server has a few features that folks might be interested in. Besides it...
View Articledumping JMX data
I appologize in advance for a noob question, just getting started with kafka, and trying to get JMX data from it. So, I had thought that running the JXMTool with no arguments would dump all the data,...
View ArticleQuestion on running Kafka Producer in Java environment
Hello Everyone, Thank you for the time and help. I had the Kafka Producer running, but am having some trouble now. 1) Using Maven, I wrote a Kafka Producer similar to the one found here:...
View ArticleCommand to list my brokers
Hi all, I just want a way to query all of my brokers to see if they're all connected and online, without creating a topic. Or is creating a topic the best way to verify all my brokers are up and...
View Article