coderjolly / data-ingestion-pipeline

It is kubernetes microservice that ingests Steam data, deployed as a service using sQLite for storing processes followed by an event driven message queue controlled by RabbitMQ. This message queue is also deployed as a service with an interconnection with celery workers integrated with Elasticsearch and Redis for caching and ingestion.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

coderjolly/data-ingestion-pipeline Stargazers