There are 0 repository under robots-txt-scanner topic.
A powerful, multi-threaded scanner designed for bug bounty hunters and penetration testers to detect exposed or sensitive paths hidden via robots.txt. Supports HTTP/2, advanced 401/403 bypass techniques, multiple HTTP methods, and outputs in JSON/CSV formats.
🕵️♂️ Advanced subdomain enumeration tool combining multiple data sources with intelligent robots.txt analysis. Features concurrent scanning, live validation, and comprehensive reporting.