Add Partition in 0.7.1
Hi, Is there a way to add a partition to an existing topic in 0.7.1? I could only find such scripts in 0.8.1. Thank you. SUREN HIRAMAN, VP TECHNOLOGY Velos Accelerating Machine Learning 440 NINTH...
View ArticleTo subscribe
Dear Apache Kafka, I have couple of questions on Kafka server cluster. I am working on Kafka project and maintaining Kafka brokers are too difficult due to continues failures. Please add me to...
View ArticleWhat information does FetchRequestAndResponseMetrics name contain?
Hello everyone, We are adding Kafka 0.8.x monitoring support to SPM <http://sematext.com/spm/> here at Sematex and I have one question about JMX Kafka beans: In Jconsole for my local setup I see:...
View ArticleHow to parse some of JMX Bean's names.
Hello everyone, We are adding Kafka 0.8.x monitoring support to SPM <http://sematext.com/spm/> here at Sematext. Unfortunately, we quickly hit an issue caused by the new bean naming convention...
View ArticleMetricId can be EMPTY in ProducerRequestMetrics
Hello everyone, We are adding Kafka 0.8.x monitoring support to SPM <http://sematext.com/spm/> here at Sematex and I have one question about JMX Kafka beans: In Jconsole for my local setup I see:...
View ArticleKafka Broker frequent shutdown with exception
Hi I am using kafka 0.8.1 version and facing frequent issue when *kafka broker* startup/restart such as: *1.Whenever Kafka Broker restarted it gets shutdown and throws following error in all Broker...
View Articlelog retention and rollover
This might be a bit unusual. We have a topic that we only need to keep last 5 minutes of msgs so that replay from beginning is fast. Although retention.ms has time unit of minute, segment.ms ONLY has...
View ArticleHow to delete Topic ?
I am using Kafka 0.8.1 and I tried to execute Topic delete command but still Topic list showing that specific Topic. Topic Delete commad which i used: *bin/kafka-topics.sh --zookeeper...
View ArticleHow to delete Topic in kafka 0.8.1 ?
I am using Kafka 0.8.1 and I tried to execute Topic delete command but still Topic list showing that specific Topic. Topic Delete commad which i used: *bin/kafka-topics.sh --zookeeper...
View ArticleKafka Security Specific Features
Hi,I wanted to re-ignite the discussion around Apache Kafka Security. This is a huge bottleneck (non-starter in some cases) for a lot of organizations (due to regulatory, compliance and other...
View Articleevent-shuttle
Thought Id post this here, as Ive seen questions here around "What do I do if kafka is down?" here is one possibility. https://github.com/sclasen/event-shuttle this is a go service meant to run as a...
View ArticleData loss detection
Hi, We are seeing less data on the brokers than we send form the producers: 84 GB to 58 GB. What is the best way to ensure / detect if all data has been send properly to the brokers from the producers....
View Articletopics load balancing within a consumer group
Hi, I have a question regarding load balancing within a consumer group. Say I have a consumer group of 4 consumers which subscribe to 4 topics , each of which have one partition. Will there be...
View ArticleNo partition metadata for topic due to kafka.common.LeaderNotAvailableException
Hi , I am using kafka 0.8.1 version and I am getting *LeaderNotAvailableException * frequently. All brokers are up and running well. Note: Recently I have delete a topic. after deleting topic i tried...
View Articledeleting topics
Hi all, Can anyone explain the current state of deleting topics? We've found delete.topic.enable config property and after setting it to true on 0.8.1.1 deletion seems to work ok. There is also a fix...
View ArticleHow to upgrade Kafka 0.8.1 to 0.8.1.1
I have planned to upgrade Kafka version from 0.8.1 to 0.8.1.1 due major bugs. Is there any procedure link to upgrade Kafka 0.8.1 to 0.8.1.1 ? Please share details to upgrade kafka 0.8.1.1. Thanks in...
View Articleare consumer offsets stored in a log?
I swear I read that Jay Kreps wrote somewhere that consumers now write their offsets in a logfile (not in zookeeper). Is this true or did I misread? Sorry I can't find the article I was reading.
View ArticleUnclean kafka shutdown
I've noticed that kafka frequently fails to shut down completely when running the shutdown script. After executing kafka-server-stop.sh, it outputs this and does not return to the prompt. Is this...
View ArticleRe-installation of Kafka cluster
Hi, We have Kafka version 0.8.1 cluster installed on our 11 servers. we would like to discard the entire cluster and do the re-installation. Please help me with the steps to achieve this exercise....
View ArticleUnable to build kafka.
I followed the readme for kafka-0.8.0. After I am getting the following warnings [info] Loading project definition from /home/abhishek/Project/kafka-0.8.0-src/project [warn] Multiple resolvers having...
View Article