Liodeus / Crawlmap

A python3 script to change your crawling logs to a mindmap

Introduction • Requirements • Installation • Usage • Examples • Wiki

_{Created by Liodeus}

Introduction

This tool is made to automate the process of creating a mindmap from crawling logs. This tool support logs from:

• Burp Suite (xml format)
• Gospider (json format)
• Zaproxy (har format)

Requirements

• python3 (sudo apt install python3)

Installation

pip install crawlmap

Usage

python3 crawlmap.py --help
 _____                    _                       
/  __ \                  | |                      
| /  \/_ __ __ ___      _| |_ __ ___   __ _ _ __  
| |   | '__/ _` \ \ /\ / / | '_ ` _ \ / _` | '_ \ 
| \__/\ | | (_| |\ V  V /| | | | | | | (_| | |_) |
 \____/_|  \__,_| \_/\_/ |_|_| |_| |_|\__,_| .__/ 
                                           | |    
                                           |_|
                                            By Liodeus
  
usage: crawlmap.py [-h] -u URL [-b BURP] [-g GOSPIDER] [-z ZAPROXY] [-o OUT] [--exclude EXCLUDE] [--nofiles] [--params]

optional arguments:
  -h, --help            show this help message and exit
  -u URL, --url URL     Base URL to filter on
  -b BURP, --burp BURP  Output from BurSuite (xml)
  -g GOSPIDER, --gospider GOSPIDER
                        Output from Gospider (json)
  -z ZAPROXY, --zaproxy ZAPROXY
                        Output from Zaproxy (har)
  -o OUT, --out OUT     Output file
  --exclude EXCLUDE     Exclude extensions (Example : "png,svg,css,ico")
  --nofiles             Don't print files, only folders
  --params              Print path with parameters if any
  --params-only         Only print path with parameters

Examples

Go to the wiki