Giters
Ziinc
/
crawldis-old
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
2
Watchers:
0
Issues:
15
Forks:
Ziinc/crawldis-old Issues
can see details for a job
Closed
6 months ago
able to restart a crawl job
Closed
6 months ago
requestor: retry request pipeline
Updated
2 years ago
request_queue: should use common Syncer module for node-level syncing
Updated
2 years ago
jobber: crawl jobs should hold config state across nodes
Closed
2 years ago
Comments count
1
requestor: fetcher can drop requests that have unexpected responses
Updated
2 years ago
requestor: add middleware piping logic
Updated
2 years ago
app/crawly: rename Crawly.ParsedItem to Crawly.Extracted
Updated
2 years ago
app/requestor: parse a response using a variable configuration.
Updated
2 years ago
app/crawly: remove splash support
Updated
2 years ago
app/requestor: Can receive a Request from Web and begin crawling
Closed
2 years ago
Comments count
1
web: can initialize immediate crawl jobs
Updated
2 years ago
Comments count
1
app/web: Can create a spider
Closed
2 years ago
Comments count
1
app/crawly: remove api functionality
Updated
2 years ago
app/crawly: Silence test logging
Updated
2 years ago