techwhizbang / bluecollar

Bluecollar: a simple yet full featured distributed background processing solution written in Clojure.

bluecollar

What is it?

The aim of bluecollar is to provide a simple yet full featured distributed background processing solution written in Clojure.

Who is it for?

Any Clojure application that is tasked with lots of time and/or resource intensive operations that require reliability.

What does it do exactly?

bluecollar simply runs alongside or within any current Clojure application. It takes any set of functions that exist in your application and can run them asynchronously, reliably, and of course distribute the work to any number of bluecollar server instances. bluecollar is dependent on Redis as it's data structure store to perform both reliable queueing, and also stat tracking.

Is it production ready?

Yes! I'm currently running bluecollar in production for a mission critical application that processes millions of records every day.

Installation

bluecollar artifacts are released to Clojars.

If you are using Maven, add the following repository definition to your pom.xml:

<repository>
  <id>clojars.org</id>
  <url>http://clojars.org/repo</url>
</repository>

The Most Recent Release

With Leiningen:

[bluecollar/bluecollar "1.0.1"]

With Maven:

<dependency>
  <groupId>bluecollar</groupId>
  <artifactId>bluecollar</artifactId>
  <version>1.0.1</version>
</dependency>

Usage

Take a look at the Quick Start or peruse the Wiki to begin using bluecollar.

Example Application

Have a peek at the example_app if you'd like to see a more concrete example of how to use bluecollar.

Thanks

A special thanks to Ben Day for creating the bluecollar logo.

License

Copyright (c) 2013 Nick Zalabak

Distributed under the Eclipse Public License. http://www.eclipse.org/legal/epl-v10.html