mmdanas / ApacheSpark

This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer.

Introduction

This course is the first installment of databricks data engineering course. In this course you will learn basic SQL concept which include:

1. Create, Select, Update, Delete tables
2. Create database
3. Filtering data
4. Group by & aggregation
5. Ordering
6. SQL joins
7. Common table expression (CTE)
8. External tables
9. Sub queries
10. Views & temp views
11. UNION, INTERSECT, EXCEPT keywords

you can download all the notebook from our

github repo: https://github.com/martandsingh/ApacheSpark

facebook: https://www.facebook.com/codemakerz

email: [e-mail]

SETUP folder

you will see initial_setup & clean_up notebooks called in every notebooks. It is mandatory to run both the scripts in defined order. initial script will create all the mandatory tables & database for the demo. After you finish your notebook, execute clean up notebook, it will clean all the db objects.