sitemap-url
There are 0 repository under sitemap-url topic.
oxffaa / gopher-parse-sitemap
A high effective golang library for parsing big-sized sitemaps and avoiding high memory usage. The sitemap parser was written on golang without external dependencies.
Language:Go 33- Language:PHP 24
ChrisWinters / multisite-robotstxt-manager
A Multisite Robots.txt Manager - Quickly and easily manage all robots.txt files on a WordPress Multisite Website Network.
Language:PHP 11- Language:Python 2
spacetab-io / prerender-go
Making static html pages of your SPA for search bots with storing results in S3 (or on local filesystem).
Language:Go 2daddiofaddio / sitemap-extract
Processes XML sitemaps and extracts URLs. Includes features such as support for both plain XML and compressed XML files, multiple input sources, protection against anti-bot measures, multi-threading, and automatic processing of nested sitemaps.
Language:Python 1DanRaiss / SitemapBashChecker
Are you tired of manually checking your website's sitemaps for updates? Do you want to be notified as soon as something is out of date? Look no further! Our powerful and efficient sitemap monitoring script is here to save the day.
Language:Shell 1- Language:Python 1
nicholasbergesen / RobotsParser
Parse robots.txt and traverse sitemaps.
Language:C# 1realaravinth / The-Place-You-Love
site map generator for websites that serve static content or auto-generated indexes from Nginx
Language:Shell 1Sannim1 / sitecrawler
A CLI utility for generating sitemaps given a particular URL
Language:PHP 1- Language:Go 0
StanNieuwmans / SitemapScanner
Just a scanner that checks if pages in your sitemap are available.
Language:C# 0jamesponddotco / sitred
[READ-ONLY] Redirect incoming requests to a random URL from a sitemap.
Language:Go
