Bee4's repositories
robots.txt
This library allow to parse a Robots.txt file and then check for URL status according to defined rules.
useragent-classifier
Working with UserAgent detection and classification
activerecord
Mirror of the bee4/activerecord repository on Gitlab