genre_scraper.py only scraping a maximum of ~4000 pictures
toemm opened this issue · comments
I opened this issues here aswell because I don't know who maintains the scraper: robbiebarrat/art-DCGAN#18
Basically the scraper is only scraping 3000-4000 pictures of a genre even though it is supposed to have atleast 20k pictures in the case of the portrait and landscape genre.
I think it is because the site is only displaying max 3600 pictures right now online, as can be seen here:
https://www.wikiart.org/en/paintings-by-genre/portrait?select=featured#!#filterName:featured,viewType:masonry (scroll down to load more)
Is there a fix for this?