Here is a collection of known uses of Kafka Streams in production. This is based only on public information. If you have a use case you'd like to add, please contribute!
- Recursion Pharmaceutical uses Kafka Streams to power its data pipeline for its drug discovery efforts.
- Airbnb uses Kafka Streams to power their actor-based merge queue with serializablle consistenty to manage merges in their large monolithic repositories.
- Expedia built their real time conversations platform, which answers questions like "how long is my layover", etc., around Kafka Streams. Some more details of the use case can be found in this paper.
- Indeed powers their microservices architecture with Kafka Streams.
- ironSource uses Kafka Streams API to handle multiple real-time use cases, such as budget management, monitoring and alerting that run through their game growth platform.
- Pinterest used Kafka Streams for their real-time ads platform. Also more details can be found in this talk.
- Salesforce uses Kafka Streams to generate real time insights which are used to score and rank emails for boosting sales efficency.
- Trivago uses Kafka Streams for stream processing of application logs, such as data cleaning and enrichment, sessionization, etc.
- Twitter uses Kafka Streams extensively, including in their real time ML training pipeline which updates the model that ranks tweets for the 'For You' timeline.
- BigCommerce uses Kafka streams to power their real time data platform which serves insights to the merchants using their platform for ecommerce.
- Lifull Connect uses Kafka Streams to power their platform for real estate listings.
- Nuuly relies on Kafka Streams and Kafka Connect, coupled with data science and machine learning to provide in-the-moment business intelligence and to tailor a personalized rental experience for their customers.
- Walmart:
- Stubhub uses Kafka Streams for real time fraud detection: unfortunately there seems no presentation materials left, but it was primarily a remote call to other fact stores to check certain fraud indication rules (barely remember the details).
- Zalando uses Kafka Streams to rank fashion websites in real-time.
- Blackrock uses Kafka Streams to power their liquidity management solutions.
- Bloomberg:
- Real time adaptation of financial market events: Bloomberg reacts to changes in financial contracts in over the counter markets in real time using Kafka Streams
- Derived data team uses Kafka Streams to do algorithmically derived pricing.
- Some more details of the use case can be found in this paper, and this talk.
- Morgan Stanley has Kafka Streams powering their liquidity management platform.
- Rabobank builts its realtime Rabo Alerts service upon financial events using Kafka Streams.
- Wise uses Kafka Streams to power the instant money movement features of their financial platform.
- Zopa Bank uses Kafka clients and Kafka Streams to power their backend event driven applications.
- Altair Panopticon incorporates Kafka Streams framework into its stream processing engine provided to customers.
- Deutsche Bahn uses Kafka Streams to make announcements of train arrivals at stations.
- Intel uses Kafka Streams as part of their real time cyber intelligence platform.
- Michelin uses Kafka Streams to power their in-house ERP system.
- k2data, a data platform solution provider focused on industrial markets, uses Kafka Streams for their client's real-time scenarios, such as anomaly detection and data cleaning.
- New York Times manages their entire article publishing pipeline using Kafka Streams.
- AVSystem uses Kafka Streams for real-time analytics on IoT data at scale.
- LineCorp uses Kafka Streams to implement a task dispatching system and also for performing streaming operations on their Kafka topics.
- Twilio's Enterprise Insights team uses Kafka Streams to power their alerting engine based on real-time metrics.
- Imperva uses Kafka Streams to build a highly-available and fault-tolerant distributed data store for their microservices.