AJEET PANDEY's repositories
Reading-And-Processing-Huge-Datasets-in-seconds--Using-Vaex-Python-Library
Vaex- Reading And Processing Huge Datasets in seconds by using Vaex library of python
A-Day-Full-of-Azure-Data-Factory
A full day of community training on Microsoft Azure Data Factory
adf-batch-sftp-zipped-csv-to-parquet
Transform Zipped CSV files from SFTP to Parquet with Azure Data Factory using Azure Batch custom activity, Azure Blob Storage and Azure Key Vault
HAKERRANK_MySQL
HAKERRANK SQL SOLUTION
adfv2_cdm_metadata
Azure Data Factory (ADFv2) copy pipeline adding metadata using Common Data Model (CDM) structure
apache-airflow-course
Public source code for the Udemy online course Apache Airflow: Complete Hands-On Beginner to Advanced Class.
Azure-Data-Factory-For-Data-Engineers---Project-on-Covid19
Built a data ingestion pipeline in Azure Data lake to Visualize Countries With Highest Corona Virus Hospital Admissions Using Azure Data Factory(ADF), Azure Data Studio, Azure Data Lake Storage Gen2, Azure SQL Database, Azure Blob Storage, Dataflow, Data Brick Transformation and Hd-insight
Azure-Data-Factory-REST-Lab
A lab for using ADF to pull in data from REST sources.
azure-data-lake-store-python
Microsoft Azure Data Lake Store Filesystem Library for Python
azure-sdk-for-python-storage-blob-upload-download
How to upload and download blobs from Azure Blob Storage with Python
AzureDataFactory
A collection of resources, projects, and snippets for use in Azure Data Factory
complete-python-course
A repository of code from my Complete Python Course on Udemy.
copy-azurestorage-awss3
Project using Data Factory and Durable Functions to copy data from azure storage to aws s3
Covid-Prediction-Reporting-Pipeline
Built a data ingestion pipeline in azure data lake to Visualize Countries With Highest Corona Virus Hospital Admissions Using Azure Data Factory, Azure Data Studio, Azure Data Lake Storage Gen2, Azure SQL Database, Azure Blob Storage, Dataflow, Data Brick Transformation and Hd-insight.
covid19
Resources for the Udemy Course - Azure Data Factory For Data Engineers - Project on Covid19
DataEngineering-SPARKguide
SPARK Definitive guide - dbc files
DataEngineeringProject
Example end to end data engineering project.
demopygit
GIT as Pycharm VCS
df_to_azure
Repository for Automatically creating pipelines with copy Activity from blob to SQL. The main functionality is for fast uploading pandas DataFrames to a SQL database, using Azure Data Factory.
practical-docker-with-python
Source Code for 'Practical Docker with Python' by Sathyajith Bhat
rest-api-sections
A small repository of projects built in my course, REST APIs with Flask and Python.
SOL_to_PANDAS
Basics commands to understand SQL vs Pandas Similarities
thinking-in-pandas
Source Code for 'Thinking in Pandas' by Hannah Stepanek
trading-data-factory
A Python Application that leverages the Azure Data Factory to store trading data.
trading-factory
My Azure Data Factory for managing my trading system.
udemy-REGEX
Lecture examples and code exercises for "Regular Expressions for Beginners and Beyond! With Exercises"
WebScrapping
WebScrapping