adi611

Aditya Agarwal's repositories

The-CheatGPT

Python application that uses GPT-3 language model and Pinecone vector database to generate answers to questions based on provided context.

Language:PythonMIT3 20

ACTIVESEGMENTATION

Active Segmentation Project

Language:JavaNOASSERTION100

hal4500

Vision integrated to LLM

Language:Python010

Python-based tool designed to efficiently convert large JSON-based log files into columnar format. The tool processes incoming log data in a streaming manner and writes the transformed data to separate column files.

Language:Python010

yt-api

Flask project to fetch and store YouTube videos based on a specified search query.

Language:Python000

Data_Lake_ETL_Spark_AWS

Language:Python000

Data_Modelling_Postgres

Language:Jupyter Notebook000

Data_Warehouse_ETL_Redshift

Language:Python000

django-celery-stocks

Language:Python010

e2e-data-engineering

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

Language:Python000