guozhangwang / awesome-kafka-streams

A collection of examples of Kafka Streams being used in production. Contributions welcome!

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Kafka Streams in the wild

Here is a collection of known uses of Kafka Streams in production. This is based only on public information. If you have a use case you'd like to add, please contribute!

  • Salesforce uses Kafka Streams to generate real time insights which are used to score and rank emails for boosting sales efficency.
  • Deutsche Bahn uses Kafka Streams to make announcements of train arrivals at stations.
  • Walmart:
  • Blackrock uses Kafka Streams to power their liquidity management solutions.
  • Zalando uses Kafka Streams to rank fashion websites in real-time.
  • New York Times manages their entire article publishing pipeline using Kafka Streams.
  • Michelin uses Kafka Streams to power their in-house ERP system.
  • Airbnb uses Kafka Streams to power their actor-based merge queue with serializablle consistenty to manage merges in their large monolithic repositories.
  • Twilio's Enterprise Insights team uses Kafka Streams to power their alerting engine based on real-time metrics.
  • Imperva uses Kafka Streams to build a highly-available and fault-tolerant distributed data store for their microservices.
  • AVSystem uses Kafka Streams for real-time analytics on IoT data at scale.
  • LineCorp uses Kafka Streams to implement a task dispatching system and also for performing streaming operations on their Kafka topics.
  • Bloomberg:
  • Expedia built their real time conversations platform, which answers questions like "how long is my layover", etc., around Kafka Streams.
  • Indeed powers their microservices architecture with Kafka Streams.
  • Wise uses Kafka Streams to power the instant money movement features of their financial platform.
  • Lifull Connect uses Kafka Streams to power their platform for real estate listings.
  • Morgan Stanley has Kafka Streams powering their liquidity management platform.
  • Zopa Bank uses Kafka clients and Kafka Streams to power their backend event driven applications.
  • BigCommerce uses Kafka streams to power their real time data platform which serves insights to the merchants using their platform for ecommerce.
  • Twitter uses Kafka Streams extensively, including in their real time ML training pipeline which updates the model that ranks tweets for the 'For You' timeline.
  • New Relic uses Kafka Streams to do real time metric aggregations in their core data pipelines.
  • Intel uses Kafka Streams as part of their real time cyber intelligence platform.

About

A collection of examples of Kafka Streams being used in production. Contributions welcome!

License:Apache License 2.0