Shakilgithub20 / Data_Analysis_with_Python

Data Analysis with Python

Lecture 01: Importing Data with Pandas

• challenges of reading a .csv file
• How to deal with UnicodeDecodeError?
• reading a csv file by changing the engine
• choose columns by name before reading a csv file
• choose columns by number before reading a csv file
• reading only the first n number of rows

Lecture 02: Data Preprocessing with Pandas

• reading a .txt (text) or an excel (.xlsx) file
• dealing with the UnicodeDecodeError?
• renaming column names
• creating a new DataFrame?
• concatenation of two dataframes
• column splitting
• creating a new column in a dataframe
• replace/removing a value from a pandas column
• removing a column from the dataframe

Lecture 03: HW review session

Lecture 04: Data Preproccessing with Pandas

• How to extract new information from a column?
• How to create a column based on a condition or function?
• Removing a string from a column
• Checking the unique values for each column
• performing calculation in dataframe columns
• dataframe sorting
• dataframe slicing

Lecture 05: Data Cleaning - Handling Missing Values

• performing data cleaning
• data visualization of missing values
• string to datetime conversion
• removing missing values
• replacing missing values by: 1. mean, 2. median, 3. constant, 4. interpolation, 5. forward imputation, 6. backward imputation

Lecture 6: Data Joining/Merging using Pandas

• inner join, outer join, left join, right join

Lecture 7: Data Aggregation/grouping and Pivot table using Pandas

• Data filtering
• Data preprocessing
• Data Aggregation/grouping
• Pivot table
• Data Visualization: Barplot

Lecture 8: Data Correlation and Categorical Variable Encoding

• Data Correlation
• Heatmap
• Dealing with categorical variables
• Label encoding
• One-hot encoding
• Categorical variable creation from the numeric variable