jmyrberg / finscraper

Web scraping API for Finnish websites

https://finscraper.readthedocs.io

jmyrberg/finscraper Issues

More Spider-specific tests
Updated 2 years ago
Test pip installation in travis
Closed 2 years ago
Test only the spider of the current branch
Closed 2 years ago
Case where chrome not available
Closed 2 years ago
Fix oikotie spider
Closed 3 years ago
Spider level checks for daily build tests
Closed 4 years ago
Generic helper functions for handling text data
Closed 4 years ago1
Steps for adding a new spider
Closed 4 years ago
Add scraper for tori.fi
Closed 4 years ago
Add scraper for Suomi24
Closed 4 years ago
Add scraper for Demi
Closed 4 years ago
Add scraper for Vauva.fi
Closed 4 years ago
Spider parameters to limit the content to be scraped
Updated 4 years ago
Disabling and enabling log in jupyter will display progress bar
Updated 4 years ago
Add scraper for Yle News
Closed 4 years ago
Remove temp dir content if object destroyed and save not called
Closed 4 years ago
Make number of pages to fetch precise
Closed 4 years ago
More thorough documentation
Closed 4 years ago
Notebook tutorial: Basics
Closed 4 years ago
Notebook tutorial: Utilizing NLP models, e.g. FinBERT
Closed 4 years ago
Add README disclaimer about web scraping and good ethics
Closed 4 years ago1
Throw warning when desired number of items can't be fetched
Updated 4 years ago
Add logging level to scrape
Closed 4 years ago
Add progress bar to .scrape
Closed 4 years ago