Giters
seomoz
/
reppy
Modern robots.txt Parser for Python
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
184
Watchers:
114
Issues:
53
Forks:
40
seomoz/reppy Issues
GCC fails when trying to install reppy through pip
Updated
a year ago
Comments count
9
User-agent checking in robots.txt issue
Updated
3 years ago
python 3.9-dev getting an error
Updated
3 years ago
Comments count
7
Please update version on PyPi
Updated
3 years ago
User-agent: * should disallow everything
Closed
4 years ago
Comments count
2
robots.allowed returns false for other sites (and domains)
Updated
4 years ago
Comments count
2
ValueError on robots.txt file
Updated
4 years ago
Compilation errors on OSX Mojave 10.14
Closed
4 years ago
Comments count
1
https issue with robots.fetch()
Closed
4 years ago
Comments count
1
Missing files in sdist
Updated
4 years ago
Comments count
3
Reppy cache fetch error on
Updated
4 years ago
Comments count
2
Is reppy thread-safe?
Closed
5 years ago
Comments count
2
RobotsCache: Exceptions cannot be handled (not being re-thrown)
Closed
5 years ago
Comments count
2
Install break with new version of cachetools
Closed
5 years ago
Comments count
2
robots.sitemaps is a map object instead of a list
Updated
5 years ago
Comments count
2
Disallow: // shouldn't behave the same as Disallow: /
Updated
5 years ago
A bit cheeky, I know I should do a PR...
Closed
5 years ago
Comments count
1
brotli compression not supported?
Updated
5 years ago
Comments count
5
UnicodeDecodeError on install with pip
Updated
5 years ago
Comments count
1
collect2: error: ld returned 1 exit status & error: command 'g++' failed with exit status 1
Updated
5 years ago
Comments count
2
Incorrect result for mentioned URLs
Closed
6 years ago
Comments count
9
Missing c++ compiler requirement
Updated
6 years ago
Comments count
3
python 3.7 breakage
Closed
6 years ago
Comments count
6
Installation of reppy
Closed
6 years ago
Comments count
1
Cache is not working correctly
Closed
6 years ago
Comments count
6
Is it possible to add wheels to this package?
Closed
6 years ago
Comments count
1
www.bestbuy.com/robots.txt false negative
Closed
9 years ago
Comments count
8
Unable to install reppy on macosx-10.6 python 2.7
Closed
6 years ago
Comments count
3
disallow bug
Updated
6 years ago
Comments count
7
Suppress parsing errors
Closed
7 years ago
Comments count
4
reppy's cache doesn't handle redirects gracefully
Updated
7 years ago
tox.ini appears to be unusable
Closed
7 years ago
Failed installation via pip on Mac OS X Yosemite
Closed
7 years ago
Comments count
11
error while decompressing data: incorrect header check
Closed
7 years ago
Comments count
5
Can I access cache from multiple python scripts/threads
Closed
7 years ago
Comments count
1
Inconsistencies across different versions
Closed
7 years ago
Comments count
2
What arguments does Robots.parse() take?
Closed
7 years ago
Comments count
1
ImportError: No module named robots
Closed
7 years ago
Comments count
6
wrong implementation?
Closed
7 years ago
Comments count
11
Segmentation fault with not well formed urls
Closed
7 years ago
Comments count
6
Unscoped Crawl-delay is treated as parse error, and thus disallows all URLs
Closed
7 years ago
Comments count
8
Problem with pip installation
Closed
7 years ago
Comments count
2
ValueError : Need User Agent
Closed
7 years ago
Comments count
8
ValueError: Invalid time.
Closed
7 years ago
Comments count
6
Failed when installing by using pip
Closed
7 years ago
Comments count
4
Update Documentation
Closed
8 years ago
user-agent matching
Updated
8 years ago
Comments count
8
Option for disable redirects
Closed
8 years ago
Comments count
1
New release?
Closed
9 years ago
Comments count
3
Fails on untrusted SSL certificates
Closed
10 years ago
Comments count
4
Previous
Next