Hi,
I would like to check to see if other people are seeing duplicate records with Kafka 0.7. I read the Jira's and I believe that duplicates are still possible when using message compression on Kafka 0.7. I'm seeing duplicate records from the range of 6-13%. Is this normal?
If you're using Kafka 0.7 with message compression enabled, can you please let me know any duplicate records and if so, what %?
Also, please let me know what sort of deduplication strategy you're using.
Thanks!
I would like to check to see if other people are seeing duplicate records with Kafka 0.7. I read the Jira's and I believe that duplicates are still possible when using message compression on Kafka 0.7. I'm seeing duplicate records from the range of 6-13%. Is this normal?
If you're using Kafka 0.7 with message compression enabled, can you please let me know any duplicate records and if so, what %?
Also, please let me know what sort of deduplication strategy you're using.
Thanks!