๐๐๐ :
In this SQL Project for Data Analysis, We will learn to efficiently leverage various analytical features and functions accessible through SQL in Oracle Database.
๐ช๐ต๐ฎ๐ ๐ถ๐ ๐๐ต๐ฒ ๐๐ด๐ฒ๐ป๐ฑ๐ฎ ๐ผ๐ณ ๐๐ต๐ฒ ๐ฝ๐ฟ๐ผ๐ท๐ฒ๐ฐ๐?
The projectโs Agenda involves Analyzing the data using SQL on the Oracle Database Software. We first download the Oracle Database 21c edition from the Oracle website and understand the problem. Then tables are created in the database followed by data insertion into tables and exploration, i.e., noticing relationships between tables, walking through the columns, and seeing comments. And perform the following activties--
- Records are displayed in an ordered manner, handling NULL values, and selecting records based on patterns like Wildcard, Operators, etc. Then working on Data Manipulation commands(DML) for Data Analysis. Then taking Backup of the Table where migration is going on and use COMMIT and ROLLBACK commands.
- Understanding different types of Joins(Inner join, Left outer join, Right outer join, Full outer join, Self join), different types of Operators(Minus, Union, Union all, Intersect).
- data analysis using Sub-query, Group-by clause and Exists clause. It also consists of using inline view and aggregate functions(Min, Max, Count, Avg) to perform better analysis on data.
- data analysis using WITH clause, the difference between COUNT(*) and COUNT(column_name), Categorization using the CASE statement, and various real-life case studies/problem statements.
- data analysis using different SQL functions like ROW_NUMBER, RANK, DENSE_RANK, SUBSTR, INSTR, COALESCE and NVL. It also involves the use of some built-in functions like concat, upper, lower, initcap, rtrim, ltrim, length, lpad, rpad.
- introduction to Data Wrangling, operations on missing data, unwanted features and duplicated records. It also involves the use of the pivot and unpivot in SQL.
- understanding of the Online Shopping Database, and using this database to perform the following Data Wrangling activities-
a. Split full name into the first name and last name.
b. Correct phone numbers and emails which are not in a proper format and Correct contact number and remove full name.
c. Read BLOB column and fetch attribute details from the regular tag, nested columns.
d. Create separate tables for blob attributes.
e. Remove invalid records from order_items where shipment_id is not mapped.
f. Map missing first name and last name with email id credentials.
๐ช๐ต๐ฎ๐ ๐ถ๐ ๐๐ฎ๐๐ฎ๐๐ฒ๐ ๐๐ป๐ฎ๐น๐๐๐ถ๐?
Dataset Analysis is defined as manipulating or processing unstructured data or raw data to draw valuable insights and conclusions that will help derive critical decisions that will add some business value. The dataset analysis process is followed by organizing the dataset, transforming the dataset, visualizing the dataset, and finally modeling the dataset to derive predictions for solving the business problems, making informed decisions, and effectively planning for the future.
๐๐ฎ๐๐ฎ ๐ฃ๐ถ๐ฝ๐ฒ๐น๐ถ๐ป๐ฒ:
It refers to a system for moving data from one system to another. The data may or may not be transformed, and it may be processed in real-time (or streaming) instead of batches. A data pipeline is extracting or capturing data using various tools, storing raw data, cleaning, validating data, transforming data into a query-worthy format, visualization of KPIs including Orchestration of the above process is data pipeline.
๐ข๐ฟ๐ฎ๐ฐ๐น๐ฒ ๐ฆ๐ค๐ ๐๐ฒ๐๐ฒ๐น๐ผ๐ฝ๐ฒ๐ฟ: Oracle SQL Developer is a free IDE that makes it easy to develop and operate Oracle Database in both traditional and cloud environments. SQL Developer is a complete end-to-end development of PL/SQL jobs, worksheets for running queries and scripts,and comprehensive data modeling output.
๐ง๐ฒ๐ฐ๐ต ๐๐๐ฎ๐ฐ๐ธ:
โ SQL Programming language
โ Oracle SQL Developer
๐๐ฒ๐ ๐ง๐ฎ๐ธ๐ฒ๐ฎ๐๐ฎ๐๐:
โ Understanding the project and how to use Oracle Database 21c.
โ Understanding the basics of data analysis, SQL commands, and their application.
โ Working on DML commands and listing employee details based on complex nested conditions.
โ Introduction to Oracle SQL Developer.
โ Usage of Oracle SQL Developer and connecting it to Oracle Database.
โ Creating tables and Inserting data into them.
โ Listing Employees and Departments based on some conditions.
โ Displaying records in an ordered manner using DESC keyword and Handling NULL values.
โ Selecting records based on some patterns like operators etc and Working on DML commands for analysis.
โ Creating a backup of the table where migration is going on and Executing COMMIT and ROLLBACK commands.
โ Listing DISTINCT & Renaming the column records for analysis.
โ Listing down employee details based on complex nested conditions.
โ Understanding different types of joins and operators.
โ Understanding the difference between normal queries and ANSI queries.
โ Joining multiple tables & with ANSI queries.
โ Understanding the difference between UNION and UNION ALL operators.
โ Understanding ambiguously defined error and resolving column ambiguoty.
โ Understanding different types of aggregate functions(Min, Max, Count, Avg) & clauses.
โ Data analysis using Sub-query and its background process.
โ Understanding the inline view and Data analysis using Group-by clause.
โ Combine different aggregate results in a single row.
โ Understanding the difference between COUNT(*) and COUNT(column_name).
โ Data analysis using WITH clause and Simplify query with WITH clause and View.
โ Categorization using CASE statement and the use of the ROWNUM clause.
โ Understanding the ROW_NUMBER function and SUBSTR and INSTR functions.
โ Data analysis using the RANK function and Difference between RANK and DENSE_RANK functions.
โ Data analysis using the built-in functions. Deal with NULL values using the NVL function.
โ Understanding the use of COALESCE function. Change the date format.
โ Understanding the concept of Data Wrangling. Remove unwanted features from data using SQL queries.
โ Deal with missing data. How to remove missing data and how to impute missing data using SQL queries.
โ Understanding Pivot and Unpivot functions in SQL.
โ Pivoting rows to columns using SQL queries. Pivoting rows to columns with joins using SQL queries.
โ Understanding the concept of Data Wrangling and Online Shopping database.
โ Perform Data Wrangling activities on the data.
๐๐ป๐๐๐ฎ๐น๐น๐ฎ๐๐ถ๐ผ๐ป ๐๐๐ฒ๐ฝ๐ ๐ต๐ฒ๐ฟ๐ฒ:
https://github.com/Ajay026/Projects/tree/main/Installation%20%26%20Execution/Installation%20%26%20Execution
๐ฆ๐ผ๐น๐๐๐ถ๐ผ๐ป ๐๐ถ๐๐ต ๐ฆ๐ผ๐๐ฟ๐ฐ๐ฒ ๐๐ผ๐ฑ๐ฒ:
https://github.com/Ajay026/Projects/tree/main/Codes/momo1606-sql_basic_latest-2ed0938ee08d