Streaming Audio: Apache Kafka® & Real-Time Data

Load-Balanced Apache Kafka: Derivco’s Globally Distributed Gaming Business

May 02, 2019 Confluent, original creators of Apache Kafka® Season 1 Episode 30
Load-Balanced Apache Kafka: Derivco’s Globally Distributed Gaming Business
Streaming Audio: Apache Kafka® & Real-Time Data
More Info
Streaming Audio: Apache Kafka® & Real-Time Data
Load-Balanced Apache Kafka: Derivco’s Globally Distributed Gaming Business
May 02, 2019 Season 1 Episode 30
Confluent, original creators of Apache Kafka®

Normally, an Apache Kafka® application lives close to its cluster, in the same datacenter or availability zone. It expects small latencies, and allows the Kafka client libraries to perform connection pool management and load balancing to the cluster through the regular Kafka partition management mechanisms. 

Life was not so simple for global gaming platform Derivco, who had to maintain central data infrastructure and application clusters in geographically diverse locations due to the heavily regulated nature of their business. In this episode, we talk about the challenges associated with that unusual but ingenious network architecture, along with other lessons they learned as they built their Kafka-centric gaming platform.

Show Notes

Normally, an Apache Kafka® application lives close to its cluster, in the same datacenter or availability zone. It expects small latencies, and allows the Kafka client libraries to perform connection pool management and load balancing to the cluster through the regular Kafka partition management mechanisms. 

Life was not so simple for global gaming platform Derivco, who had to maintain central data infrastructure and application clusters in geographically diverse locations due to the heavily regulated nature of their business. In this episode, we talk about the challenges associated with that unusual but ingenious network architecture, along with other lessons they learned as they built their Kafka-centric gaming platform.