Giters
TurnerSoftware
/
InfinityCrawler
A simple but powerful web crawler library for .NET
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
246
Watchers:
11
Issues:
13
Forks:
36
TurnerSoftware/InfinityCrawler Issues
Allow controlling which links are visited
Updated
2 years ago
Comments count
8
Build versioning failed. If this keeps happening, please report it on GitHub
Updated
2 years ago
Comments count
5
Exception thrown on none http/https scheme
Closed
3 years ago
Comments count
2
Switching to AngleSharp
Updated
3 years ago
Javascript Support
Closed
3 years ago
Comments count
3
Add support for wildcard HostAliases
Updated
3 years ago
Comments count
4
Getting "Method not found" error
Closed
4 years ago
Comments count
3
Update NuGet package
Closed
4 years ago
Comments count
2
IAsyncEnumerable support
Closed
5 years ago
Comments count
1
Performance Settings are tied to "TaskHandlerOptions"
Closed
5 years ago
Comments count
1
Add MaxNumberOfPages setting
Closed
5 years ago
Comments count
1
Better support for X-Robots-Tag header
Closed
5 years ago
Comments count
1
Limited settings around the content parser
Closed
5 years ago