- Collecting data from Website.
- Data Cleaning, Transform.
- Data Visualization using Tableau.
- Find story from Tableau Dashboard.
Using the website several data can be collected such as Rank, Institute name, Count, Faculty, Faculty Name, Subject, Number of Publications, Number of Co-authors.
-
Install Python on your device from Here.
-
Click Zip_File to download all files.
-
Unzip file. You can change the folder name.
-
Create an environment where downloaded files are staying. To do this
Click Right Mouse Button
and Click onOpen in Terminal
and write code one by one :Set-ExecutionPlicy Unrestricted
pip install virtualenv or pip3 install virtualenv
virtualenv env
env\Scripts\Activate.ps1
pip install -r requirements.txt or pip3 install -r requirements.txt
cd scripts
python run.py
-
After finishing all the prompts, press enter, wait for 5 minutes. After 5 minutes, user will get 3 outputs in csv format
Uncleaned Data:
University_ranks.csv
Faculty_info.csv
Transformed Data:
CSRanking_Universities_Ai_Area.csv
If you did everything according to the above instructions then Data Transformation has already been done already. In the data transformation a few things were completed..
- Dropped Duplicate values.
- Created new columns/ features.
- Created a new Dataframe.
- Merge 2 DataFrames.
- Dropped 2 Columns.
- Using 'CSRanking_Universities_Ai_Area.csv' Dataset I've created This Dashboard
-
At Westlake University, each faculty published on average 59 papers which is the highest value.
-
At Carnegie Mellon University, faculties published the highest number of papers from 2000-2022.
-
In the fields of AI, ML, NLP, Vision, Peking University has published the most papers, including 35 papers on AI, 11 papers on ML, 16 on NLP, and 33 papers on computer vision.
-
An average of 107 papers are published from each department at Carnegie Mellon University which is the maximum.
-
In 2000-2022, the top 3 fields are AI(1520), ML(1124), NLP(737). Most of the papers in the world are related to these 3 areas.
-
Most faculties have published 2-18 research papers from their university. About 214 faculties published 4 papers which is the maximum.
-
About 5-7 minutes take to complete the whole process. It depends on your device performance.
-
Do not touch, minimize or close any pop up Google Chrome.
-
Data might be changed over time.
This entire project is for Data Analysis. It's suitable for beginners. This project can be executed by anyone.