shariff94 / Data-Modeling-with-Postgres

Data Modelling for a startup called Sparkify using a star schema

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Data Modeling for Sparkify

Introduction

A startup called Sparkify wants to analyze the data they've been collecting on songs and user activity on their new music streaming app. The analytics team is particularly interested in understanding what songs users are listening to. Currently, they don't have an easy way to query their data, which resides in a directory of JSON logs on user activity on the app, as well as a directory with JSON metadata on the songs in their app.

Goal

Create a Postgres database and ETL pipeline

Database & ETL pipeline

song and log datasets which were in json formate were use, created a star schema as shown below, which includes

  • one fact table: songplays
  • four dimension tables: users, songs, artists and time

drawing

Exmaples queries

  1. What is the most played song over different years?
  2. Who is the favorite artist for different locations?

About

Data Modelling for a startup called Sparkify using a star schema


Languages

Language:Jupyter Notebook 84.8%Language:Python 15.2%