Streaming Audio: Apache Kafka® & Real-Time Data

Load-Balanced Apache Kafka: Derivco’s Globally Distributed Gaming Business

Confluent, original creators of Apache Kafka® Season 1 Episode 30

Normally, an Apache Kafka® application lives close to its cluster, in the same datacenter or availability zone. It expects small latencies, and allows the Kafka client libraries to perform connection pool management and load balancing to the cluster through the regular Kafka partition management mechanisms. 

Life was not so simple for global gaming platform Derivco, who had to maintain central data infrastructure and application clusters in geographically diverse locations due to the heavily regulated nature of their business. In this episode, we talk about the challenges associated with that unusual but ingenious network architecture, along with other lessons they learned as they built their Kafka-centric gaming platform.