Streaming Audio: a Confluent podcast about Apache Kafka

KIP-500: Apache Kafka Without ZooKeeper ft. Colin McCabe and Jason Gustafson

September 18, 2019 Season 1 Episode 55
Streaming Audio: a Confluent podcast about Apache Kafka
KIP-500: Apache Kafka Without ZooKeeper ft. Colin McCabe and Jason Gustafson
Chapters
Streaming Audio: a Confluent podcast about Apache Kafka
KIP-500: Apache Kafka Without ZooKeeper ft. Colin McCabe and Jason Gustafson
Sep 18, 2019 Season 1 Episode 55
Confluent, original creators of Apache Kafka®
Colin McCabe and Jason Gustafson discuss the history of Kafka, the creation of KIP-500, and the implications of removing ZooKeeper dependency and replacing it with a self-managed metadata quoroum.
Show Notes

Tim Berglund sits down with Colin McCabe and Jason Gustafson to talk about KIP-500. The pair, who work on the Kafka Core Engineering Team, discuss the history of Kafka, the creation of KIP-500, and what it will do for the community as a whole. They break down ZooKeeper's role in Kafka, the implications of removing ZooKeeper dependency, replacing it with a self-managed metadata quorum, and how they've been combatting security, stability, and compatibility issues. With pending improvements towards scalability and inter-broker communication, and now that KIP-500 has been adopted within the community—there's a lot covered in this episode that you won't want to miss!

EPISODE LINKS



×

Listen to this podcast on