simon987 / od-database

Distributed crawler, database and web frontend for public directories indexing

simon987/od-database Issues

Has this project been abandoned?
Updated 4 years ago3
Bulk insert gives 500 error
Updated 5 years ago
Fix elasticsearch upgrade issues
Updated 5 years ago
GitHub Badge API
Updated 5 years ago
Use timestamps to crawl more intelligent
Updated 5 years ago1
Do not display 1970-01-01 in histogram
Updated 5 years ago1
Rework task tracking
Closed 5 years ago
Newest captcha has both 0 and O and they're difficult to distinguish
Closed 6 years ago2
/api call for crawler name
Closed 5 years ago1
/stats page takes long to load
Closed 6 years ago4
Difficult for a human (me) to read new captchas
Closed 6 years ago9
Typo on the banner "now longer" should be "no longer"
Closed 6 years ago1
Feature request: Select HTTP or FTP job
Closed 6 years ago1
Stats page: Nicer crawl stats table
Closed 6 years ago1
Is there a 404 check for links that are already in the database?
Closed 6 years ago1
High CPU usage in Safari due to incomplete recaptcha+CSP implementation
Closed 6 years ago25
Feature request: Do not display links that are 404
Closed 6 years ago3
Feature Request: Add functionality to crawl "Directory Lister" sites.
Closed 5 years ago6
FTP can't be crawled.
Closed 6 years ago1
NameError: name 'CrawlerProcess' is not defined
Closed 6 years ago1