Optimized for python 3.6
This project is aimed on creating personal assistants for replying messages about specifics issues.
.
├── data
│ └── dataset.csv
├── dependencies
│ └── chromedriver
├── src
│ ├── __init__.py
│ ├── crawler.py
│ └── lang_processing.py
├── src
├── .gitignore
├── README.md
└── requirements.txt- crawler: Class responsible for accessing internet.
- lang_processing: Class responsible for processing natural language.
In your python environment, run the following command:
pip install scikit-learn selenium requests pandas nltk bs4
or access the root directory (~/requirements.txt) and run the following command:
pip install -r requirements.txt
For running the script on terminal/cmd, access the project directory (~/src/) and run the following command:
python crawler.py
obs: you must be inside the scr directory.