VIP nytt's repositories
SitemapParser
XML Sitemap parser class compliant with the Sitemaps.org protocol.
RobotsTxtParser
An extensible robots.txt parser and client library, with full support for every directive and specification.
CleanParam-URL-filter
Clean-Param URL filtering class - Find and remove any duplicate URL
OPMLParser
OPML parser for PHP
RobotsTagParser
X-Robots-Tag HTTP header parser class
UserAgentParser
User-Agent parser for robots.txt, X-Robots-tag and Robots-meta-tag rule sets