Giters

michielvoo / robots.txt

PowerShell module for reading robots.txt files

Home Page:https://michielvoo.net/projects/robots.txt.html

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

robots-txtrobots-exclusion-protocol

robots.txt

PowerShell module for reading and writing robots.txt files

About

PowerShell module for reading robots.txt files

https://michielvoo.net/projects/robots.txt.html

robots-txtrobots-exclusion-protocol

License:MIT License

Languages

Language:C# 64.6%Language:PowerShell 35.4%