A parser for robots.txt written in erlang.
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool
An OTP library for parsing robots.txt files.
$ rebar3 compile
License:Apache License 2.0