There are 3 repositories under big-query topic.
My personal project for data engineering zoomcamp
Automatically load data from Google Cloud Storage files into Big Query tables
This utilizes a static IP address in GCP to pull data from the Clash of Clans API, store it and serve it via data studio. There is also a API client with a sleep of functions you can use to pull, store, and view CoC facts and dimensions.
In this project, I am trying to predict traffic congestion, based on an aggregate measure of stopping distance and waiting times, at intersections in 4 major US cities: Atlanta, Boston, Chicago & Philadelphia.
Easy-to-use Python library for managing files and data in different environments
🍉 Repo for analytics engineering with dbt, transforming raw data into actionable insights.
Scripts used for analyzing GitHub commit locations to create a map visualization
Master of Applied Data Science - Milestone I Project (San Francisco Bike Sharing)
A platform for users to upload and share the responses from law enforcement agencies to their traffic violation reports in Taiwan. This system aims to increase transparency and public oversight of traffic law enforcement.
Explore efficient big data matching techniques
Analysed SEVIR and Storm Datasets and visualized the data using Big Query on Data Studio. Datasets: Sevir Data: The Storm EVent ImagRy (SEVIR) dataset is a collection of temporally and spatially aligned images containing weather events captured by satellite and radar. Visualized using Big Query and Data Studio.
Copy table from one dataset to another in google big query using bash script
Market Data Ingestion and BigQuery Integration project
A repo containing auto-triggered Airflow ETL activities for datasets located on GCP storage that flattens and creates analytical views on Big Query
Webscraping dos dados do site Mercado Livre. Esses dados são exportados para uma base de dados BigQuery e algumas informações relevantes são obtidas através de consultas SQL.
Repo for queries written to run on Big Query for a data analytics project.
Full-stack Marketing project, including a status quo exploration of sales, analytic, customer and inventory data using SQL.
Listing of sudden weather breakdowns in Poland in year 2000
Personal project for Data Engineering Zoomcamp
Designed conceptual data models using Entity Relation Diagrams wrt Business Rules. Implemented Data dictionary, CRUD, Views, Triggers, Stored Procedures and Privileges and analysed data using Plotly in Python and Google data set for dashboards
Scrape Premier League Data and load it into Google BigQuery
Data ingestion from Google BigQuery to PostgreSQL
Media sentiment analysis following the Israel-Hamas escalation in 2023
2023 April Dashboard for Canada content ideas using google trends
eCommerce Marketing Analytics using Google BigQuery
This project is about data exploration and analysis of Covid dataset using SQL queries in BigQuery and creating visualizations of the analyzed data in Tableau.
exploratory data analysis of an open-source COVID-19 dataset using BigQuery syntax
Data Engineering on GCP and Mage AI
Objective: Perform market analysis on Iowa liquor stores using State of Iowa alcoholic records, US census, US geological GIS data.
To do data analysis on Airbnb rating stats
WebApp to explore key data from the USA health public DataBase, the app have an intuitive interface to filter and visualize the data.
An example linear regression model I generated with Google BigQuery from the public data set 'Medicare'. Mostly a proof of concept, tools such as R would better fit this purpose.
Projeto responsável pelo processamento de dados utilizando serviços do GCP.
Using kafka streaming to implement the streaming ETL job, append data onto GCP Big Query after formatting.
Ranked as top-1 in Columbia EECS 6893 in Topics in Signal Processing: Big Data Analysis