davidadediji / news_scraper

A CLI application to get contents from news website

DevProjects - Web scraper to get news article content

Tech/framework used

Built with Python with those frameworks and packages :

1. scraping data => BS4, request
2. for process tasks => sys
3. Write csv => csv

How to Install and use

1. Clone the git project in your terminal
2. Install python3 and beautifulSoup4
3. Then run command in your terminal at project root

python3 main.py news_url

sample news url includes https://www.washingtonpost.com/technology/2020/09/25/privacy-check-blacklight/ https://www.washingtonpost.com/technology/2022/11/23/mars-rover-rock-samples/ https://www.washingtonpost.com/technology/2022/11/24/twitter-musk-reverses-suspensions/

License

No licence