Don't Change the Partition Count for Kafka Topics!

Abstract

I’ll tell a story on how we’ve hunted down a Heisenbug in a system that should have prevented it by design in the very first place and finally fixed it. The story involves Kafka, Kafka Connect, Elasticsearch, optimistic concurrency control, data inconsistencies, and SRE with plenty of good intentions that in a series of unfortunate circumstances caused a nasty bug.

Date
May 12, 2021 6:00 PM — 6:45 PM
Location
Vinted Vilnius
Švitrigailos g. 13, Vilnius, 03228, Lithuania
Don't change the partition count for kafka topics! from Dainius Jocas

Related