Hi again,
192.168.1.180
Zk: 192.168.1.180:2181
Kafka: 9092
Broker.id = 1
zookeeper.connect=192.168.1.180:2181
192.168.1.190
Zk: 192.168.1.180:2181
Kafka: 9092
Broker.id = 2
zookeeper.connect=192.168.1.180:2181
I start both Kafka-server
I create a topic using the following command ( the command is launch on
192.168.1.180)
kafka-topics.sh --create --zookeeper 192.168.1.180:2181 --topic
hibe-test-12 --partitions 1 --replication-factor 2
*Stdout on broker.id <http://broker.id>=1*
[2014-09-30 05:51:01,586] INFO Created log for partition [hibe-test-12,0]
in /home/shopmedia/apps/kafka/log with properties {segment.index.bytes ->
10485760, file.delete.delay.ms -> 60000, segment.bytes -> 536870912,
flush.ms -> 9223372036854775807, delete.retention.ms -> 86400000,
index.interval.bytes -> 4096, retention.bytes -> -1, cleanup.policy ->
delete, segment.ms -> 604800000, max.message.bytes -> 1000012,
flush.messages -> 9223372036854775807, min.cleanable.dirty.ratio -> 0.5,
retention.ms -> 3600000}. (kafka.log.LogManager)
[2014-09-30 05:51:01,588] WARN Partition [hibe-test-12,0] on broker 1: No
checkpointed highwatermark is found for partition [hibe-test-12,0]
(kafka.cluster.Partition)
[2014-09-30 05:51:19,366] INFO Partition [hibe-test-12,0] on broker 1:
Shrinking ISR for partition [hibe-test-12,0] from 1,2 to 1
(kafka.cluster.Partition)
*Stdout on broker.id <http://broker.id>=2*
[2014-09-30 05:51:11,952] ERROR [ReplicaFetcherThread-0-1], Error for
partition [hibe-test-12,0] to broker 1:class kafka.common.UnknownException
(kafka.server.ReplicaFetcherThread)
[2014-09-30 05:51:11,954] ERROR [KafkaApi-2] error when handling request
Name: FetchRequest; Version: 0; CorrelationId: 2647; ClientId:
ReplicaFetcherThread-0-1; ReplicaId: 2; MaxWait: 500 ms; MinBytes: 1 bytes;
RequestInfo: [hibe-test-12,0] -> PartitionFetchInfo(0,1048576)
(kafka.server.KafkaApis)
kafka.common.KafkaException: Shouldn't set logEndOffset for replica 2
partition [hibe-test-12,0] since it's local
This error is high CPU usage, roughly 40% CPU usage until i kill
kafka-server
Please note that i have removed log fdata rom both server beforehand as
well as remove zk data using : zkCli.sh
rmr /brokers
Broker.id = 2 never gets in the ISR
Do you have an idea what is causing this error ?
192.168.1.180
Zk: 192.168.1.180:2181
Kafka: 9092
Broker.id = 1
zookeeper.connect=192.168.1.180:2181
192.168.1.190
Zk: 192.168.1.180:2181
Kafka: 9092
Broker.id = 2
zookeeper.connect=192.168.1.180:2181
I start both Kafka-server
I create a topic using the following command ( the command is launch on
192.168.1.180)
kafka-topics.sh --create --zookeeper 192.168.1.180:2181 --topic
hibe-test-12 --partitions 1 --replication-factor 2
*Stdout on broker.id <http://broker.id>=1*
[2014-09-30 05:51:01,586] INFO Created log for partition [hibe-test-12,0]
in /home/shopmedia/apps/kafka/log with properties {segment.index.bytes ->
10485760, file.delete.delay.ms -> 60000, segment.bytes -> 536870912,
flush.ms -> 9223372036854775807, delete.retention.ms -> 86400000,
index.interval.bytes -> 4096, retention.bytes -> -1, cleanup.policy ->
delete, segment.ms -> 604800000, max.message.bytes -> 1000012,
flush.messages -> 9223372036854775807, min.cleanable.dirty.ratio -> 0.5,
retention.ms -> 3600000}. (kafka.log.LogManager)
[2014-09-30 05:51:01,588] WARN Partition [hibe-test-12,0] on broker 1: No
checkpointed highwatermark is found for partition [hibe-test-12,0]
(kafka.cluster.Partition)
[2014-09-30 05:51:19,366] INFO Partition [hibe-test-12,0] on broker 1:
Shrinking ISR for partition [hibe-test-12,0] from 1,2 to 1
(kafka.cluster.Partition)
*Stdout on broker.id <http://broker.id>=2*
[2014-09-30 05:51:11,952] ERROR [ReplicaFetcherThread-0-1], Error for
partition [hibe-test-12,0] to broker 1:class kafka.common.UnknownException
(kafka.server.ReplicaFetcherThread)
[2014-09-30 05:51:11,954] ERROR [KafkaApi-2] error when handling request
Name: FetchRequest; Version: 0; CorrelationId: 2647; ClientId:
ReplicaFetcherThread-0-1; ReplicaId: 2; MaxWait: 500 ms; MinBytes: 1 bytes;
RequestInfo: [hibe-test-12,0] -> PartitionFetchInfo(0,1048576)
(kafka.server.KafkaApis)
kafka.common.KafkaException: Shouldn't set logEndOffset for replica 2
partition [hibe-test-12,0] since it's local
This error is high CPU usage, roughly 40% CPU usage until i kill
kafka-server
Please note that i have removed log fdata rom both server beforehand as
well as remove zk data using : zkCli.sh
rmr /brokers
Broker.id = 2 never gets in the ISR
Do you have an idea what is causing this error ?