bbigcd / WebCrawler

Just a simple web crawler which return crawled links as IObservable using reactive extension and async await.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

WebCrawler

Build status NuGet version

Just a simple web crawler which return crawled links as IObservable using reactive extension and async await.

Install-Package MisterHex.WebCrawling

Usage

Crawler crawler = new Crawler();
IObservable observable = crawler.Crawl(new Uri("http://www.codinghorror.com/")); observable.Subscribe(onNext: Console.WriteLine, onCompleted: () => Console.WriteLine("Crawling completed"));

About

Just a simple web crawler which return crawled links as IObservable using reactive extension and async await.


Languages

Language:C# 100.0%