Quantcast
Channel: Kafka Timeline
Viewing all articles
Browse latest Browse all 1519

How to Setup MirrorMaker in Generalized way

$
0
0
Hi,

I am going to setup Kafka clusters having 3 brokers in Datacenter 1. Topics
can be created time to time. Each topic can have varying partitions mostly
1,10 or 20. Each application might have different partitioning algorithm
that we don't know(let it be hidden from ops team).

We want to setup mirror maker tool in such a way so that, the exact
partitioned data should go to the same partition without knowing the Topics
partition logic and it should be *generalized*. [This should be common for
all Topics.]

*like partition 0 at DataCenter1 should be exact mirror of partition-0 in
Datacenter2*.

Please suggest me a solution for doing so. If MirrorMaker
<http://kafka.apache.org/documentation.html#basic_ops_mirror_maker> tool
provide any configurations which solve this use-case please let me know.

Regards,
Madhukar Bharti

Viewing all articles
Browse latest Browse all 1519

Trending Articles