vigneshsarma / crawler

a parallel web crawler

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

#Crawlers

A crawler a well defined problem that is a good way to find the subtile powers of a language, and get yourself familirized with them. Especially languages that have councurancy as one of there major advantages. All functional languages seems to clame this, but there are many different ways thay differ.

In some languages there are more than one way to impliment concurrency as popular amoung there respective communities. In these cases these alternatives are also explored.

##Languages:

  • Python ** Twisted ** celery
  • Javascript(node) ** Javascript ** Coffee

##Todo:

  • Go
  • Haskell
  • Clojure
  • Common Lisp
  • Erlang
  • bash/zsh

About

a parallel web crawler


Languages

Language:Python 45.6%Language:Clojure 20.4%Language:Go 13.1%Language:JavaScript 11.2%Language:Common Lisp 5.0%Language:CoffeeScript 4.6%