seomoz / reppy

Modern robots.txt Parser for Python

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

A bit cheeky, I know I should do a PR...

cypherlou opened this issue · comments

but is there any chance of adding an iterator, or better still, a counter property to the robots.agent() object as I want to get the number of rules that apply to a given UA, in addition to all the other good functionality in there.

Thanks Dan, really appreciate it!