Amit Sangwan's repositories
Sales-and-Revenue-Analysis
The process of analyzing raw data to find trends and insights can be used to make decisions that benefit anyone. In data analysis, we perform various operations like obtaining raw data, organizing and cleaning it, storing it in an accessible place, modeling, and then analyzing data to extract insights that support decision-making.We had to perform data analysis and visualization and develop a dashboard to help make data-driven decisions to increase the company's sales and revenue to complete the project. The objective was to analyze the sales and revenue trend and identify major markets from a sales and revenue perspective.
HR-Employees-Analysis
HR plays a key role in developing, reinforcing, and changing the culture of an organization.Pay, performance management, training and development, recruitment and onboarding, and reinforcing the values of the business are all essential elements of business culture covered by HR. HR needs to stay up-to-date with all relevant information. The purpose of the project is to analyze the data and create a dashboard that can be used by HR to get useful insights related to departments and employees.
Snowflake-Incremental-Ingestion
This project demonstrates a data pipeline using Snowflake, Google Cloud Storage (GCS), and Pub/Sub for loading data incrementally into Snowflake tables. The pipeline is triggered by new files arriving in a specified GCS bucket, notifying Snowflake through Pub/Sub, and subsequently updating tables in Snowflake.
SnowSpark-Orchestration
This project orchestrates a data processing workflow using Apache Airflow, Spark, Google Cloud Storage (GCS), and Snowflake. The workflow is designed to handle daily data updates, filter completed orders, and update a Snowflake target table with the latest information. The project leverages Apache Airflow for workflow scheduling and management.
blogs_web
This project is a full-fledged web platform designed for managing blogs, posts, and comments.
CyberSecurityBreachAnalysis
A data breach is a security violation, in which sensitive, protected or confidential data is copied, transmitted, viewed, stolen or used by an individual unauthorized to do so.Cyber security refers to protecting systems connected to the internet from threats in cyberspace. It involves protecting software, data, and hardware and helps prevent cybercriminals from gaining access to devices or the networks.Data and Security Breaches have become a bigger problem for companies in this digital world. Cybersecurity plays an important role in tackling these issues. The objective of this project is to create a dashboard that can help in tracking breaches that happened in the past and events related to those breaches.
gcp-practice
In this project, I have explored the cloud function service of GCP and explored a few other GCP services.
learning-and-experiments
Welcome to the Learning and Experiments Hub—a dynamic repository capturing my journey of exploration and experimentation in the vast world of technology. This space serves as a digital canvas where I document my learning process, experiments, and discoveries.
mini-projects
Welcome to the MiniProjects Playground—an interactive space where learning meets doing! This repository is a collection of hands-on mini-projects that I've crafted after delving into various tech stacks and frameworks. From theory to application, each project is a testament to the practical side of coding.
NewsScrapping
Web scraping is an automated method used to extract large amounts of data from websites. ... Web scraping helps collect these unstructured data and store it in a structured form. There are different ways to scrape websites such as online Services, APIs or writing your own code.Here we are using coding method to scrape the data from various websites.
Product-review-scrapper
Product reviews are an essential part of an online store’s branding and marketing. The importance of product reviews can be understood by the fact that 90% of the consumers read online reviews before making a purchase and 72% of the consumers will be prompted to take an action after reading positive reviews. Online reviews from customers have created a new field in marketing and communication that bridges the gap between traditional word-of-mouth and a viral form of feedback that can influence consumer’s opinion, grab consumer’s attention and increase sales.
Review-Scrapper
Product reviews are an essential part of an online store’s branding and marketing. The importance of product reviews can be understood by the fact that 90% of the consumers read online reviews before making a purchase and 72% of the consumers will be prompted to take an action after reading positive reviews. Online reviews from customers have created a new field in marketing and communication that bridges the gap between traditional word-of-mouth and a viral form of feedback that can influence consumer’s opinion, grab consumer’s attention and increase sales.
sangwanamit621
Config files for my GitHub profile.
Python-ETL-with-Kafka
In this project, we will read data from a file and will produce and consume the data from kafka running on docker container. After consumption we will store the data in mongoDB.
sales_data_analysis
This project focuses on processing sales and customer data, rewarding top-performing employees and customers, and performing analytical queries using Google Cloud Storage (GCS), MySQL, and BigQuery. The system is designed to track and reward the top 3 sales employees and customers based on their performance.
sql-solutions-in-pyspark-dataframe-api-and-spark-sql
This repository contains my solutions to various SQL problems from LeetCode, implemented using PySpark DataFrame API and Spark SQL. The goal is to provide alternative solutions and insights for SQL enthusiasts who want to explore the power of PySpark and Spark SQL.