rbSparky / Scraper

Cybersec Project

Web Scraper Utility

Hosted on replit, with code. Made with Flask, Jinja2 & Bootstrap.

Features

Extracting lists, tabular and data from all html tags

• All data is collected and stored in a JSON file.

Search result summarizer with NLP

Generating sitemap

• Ability to scrape the site till a certain depth to get the entire site architecture of any website.

Improvements to be made

TBD:

• Image scraping
• Batch Image Downloading
• JSON Download Feature