schliesser / sitecrawler

TYPO3 sitemap crawler

schliesser/sitecrawler Issues

[TASK] Add support for gzip compressed sub-sitemaps
Updated 3 months ago
[TASK] Compatibility for TYPO3 13
Closed 3 months ago
[TASK] Setup page to test robots.txt resolving
Updated 3 months ago
Add option to return gathered url list instead of calling each url
Closed a year ago1
Support basic auth
Closed 2 years ago1
[question] workspace records crawled/included?
Closed 2 years ago3
[FEATURE] Read sitemaps from robots.txt file and process all
Closed 3 years ago1
Error ProgressBar::iterate() undefined in TYPO3 9.5 none-composer
Closed 3 years ago
Error on executing Scheduler Task
Closed 4 years ago4
Create Tests
Closed 4 years ago1
Integrate Github Actions
Closed 4 years ago1