An express inspired, event-driven framework for building real-time distributed apps with socket.io and redis.

The Server

var express = require('express');
var app = express();
app.use(express.static(__dirname+'/public'));
var server = require('http').Server(app).listen(3000);
var bus = require('bus.io')(server);

The Client

<script type="text/javascript" src="/socket.io/socket.io"></script>
<script type="text/javascript">
  var client = io.connect();
  client.on('connect', function () {
    client.emit('echo', 'Hello, World!');
  });
  client.on('echo', function (who, what) {
    console.log(what);
  });
</script>

How this works

Each socket is associated with one ore more actors. When a socket receives data, the data is encapsulated as a messsage and written to a queue. Since all of your app instances are connected to that queue, one of them will receive the message for processing. After the instance processes the message it can be delivered to the target. A target is just another actor, so if your actor is associated with multiple sockets. Each socket, regardless of which app instance it is connected to, will receive the data from the message.

Installation and Environment Setup

Install node.js (See download and install instructions here: http://nodejs.org/).

Install redis (See download and install instructions http://redis.io/topics/quickstart).

For using bus.io

> npm install bus.io

For developing bus.io

Clone this repository.

> git clone git@github.com:turbonetix/bus.io.git

cd into the directory and install the dependencies

> cd bus.io
> npm install && npm shrinkwrap --dev

Examples

##Getting a bus is simple.

Here we can use an already existing socket.io instance.

var io = require('socket.io')();
var bus = require('bus.io')();
bus.listen(io);

Or you can just listen to a port.

var bus = require('bus.io')();
bus.listen(3000);

You can listen to a server with express.

var app = require('express')();
var server = require('http').createServer(app).listen(3000, function (err) { });
var bus = require('bus.io')(server);

You can even sperate out express, socket.io, and bus.io.

var app = require('express')();
var server = require('http').createServer(app).listen(3000, function (err) { });
var io = require('socket.io')(server);
var bus = require('bus.io')(io);

You have the ability to control the underlying socket.io instance

bus.io().on('connection', function (socket) {
  socket.emit('hello');
});

You can quickly attach a connection listener.

bus.socket(function (socket) {
  socket.on('some thing', function () {
    socket.emit('some thing', new Date());
  });
});

Configuration

Setting the Actor

You can bind custom socket.io handlers to each socket when it is connected.

bus.socket(function (socket, bus) {
  socket.emit('hello socket.io', 'from bus.io');
});

The actor is the entity associated with a socket. Actors each have their own channel. Actors send messages to other actors. By default an actor is represented by the socket identifier. You can customize this behavior. Here we are using a username from a session.

bus.actor(function (socket, cb) {
  cb(null, socket.handshake.data.session.user);
});

You could write a middleware function to set the actor on the message too.

bus.in(function (message, socket, next) {
  // set actor
  message.actor(socket.user);
  next();
})

Setting the Target

The target also is an actor. The target can be pulled from the socket or the parameters from a message received on a socket. By default the target is the socket identifier.

bus.target(function (socket, params, cb) {
  cb(null, params.pop());
});

You can write a middleware function to set the target too.

bus.in(function (message, socket, next) {
  // set target
  message.target(message.content().pop());
  next();
});

If the client had done this:

The target will be "you"

socket.emit('say', 'hello', 'you');

Aliasing a Socket to an Actor

Set up an alias for your actor. When a message is sent to the alias the socket will receive the message.

bus.socket(function (socket, bus) {
  socket.get('user', function (err, user) {
    if (err) return socket.emit('err');
    if (!user) return socket.emit('login', 'You must login');
    bus.alias(socket, user.name);
  });
});

The bus instance has it's on method overridden. You can still add listeners by calling addListener('event', function() {}).

Handling Messages

Messages from the Socket going into the Bus

You can specify middleware functions to manipulate the messages incoming from the socket before going into the bus.

Here we are processing all messages.

bus.in(function (message, socket, next) {
  message.content()[0] += '!';
  next(); //you must call next or either message.deliver(), message.consume(), message.respond()

});

Here we are processing only chat messages.

bus.in('chat', function (message, socket, next) {
  message.content()[0] += '!!'; 
  message.deliver();
});

Messages on the Bus

Messages received can be propagated to their target by calling deliver.

Here we are writing out the message contents. After this handler is executed the message will continue to propagate.

Delivering messages

bus.on('some message', function (message) {
  message.deliver();
}).

You can also propagate a message to an additional target.

bus.on('some message', function (message) {
  message.deliver('some target');
});

Or propagate to many targets either passing in multiple recipients or calling deliver multiple times.

bus.on('some message', function (message) {
  message.deliver('b', 'c', 'd').deliver('e');
});

Consuming messages

It is possible to consume a message so it won't be delivered to the original recipient and then deliver it to other recipients.

bus.on('some message', function (message) {
  message.consume().deliver('some target').deliver('other', 'targets');
});

You can respond to messages too.

bus.on('some message', function (message) {
  message.respond({some:'some other content'});
});

Creating messages

Or even create new messages.

bus.on('some message', function (message) {
  bus.message({
    actor:'I',
    action:'say',
    content:'hello'
    target:'you',
  }).deliver();

  message.deliver();
});

A chain-able approach.

bus.on('some message', function (message) {
  bus.message()
    .actor('me')
    .action('say')
    .content('hello')
    .target('you')
    .deliver();
});

Simply put.

bus.on('some message', function (message) {
  bus.message()
    .i('me')
    .did('say')
    .what('hello')
    .to('you');
});

You can add a middleware function that all messages will go through.

bus.on(function (message, next) {
  message.content(message.content().toUpperCase());
  next();
});

Try adding middleware for specific events.

bus.on('some event', function (message, next) {
  message.content(message.content().toUpperCase());
  next();
});

Messages from the Bus going to the Socket

You can specify middleware functions to manipulate the messages incoming from the exchange before going to the socket.

bus.out(function (message, socket, next) {
  message.data.content[0] += '!';
  next(); //you must call next or either message.deliver(), message.consume(), message.respond()
});

Try adding middleware for specific events.

bus.out('chat', function (message, socket, next) {
  message.content()[0] += '!!'; 
  message.deliver();
});

API

Server

The Server connects the Messages instance to the `Exchange instance. It also provides ways to bind middleware functions to manipulate messages incomming from the client to the bus, messages processing on the bus, and finally messages outgoing from the bus to the client.

var Bus = require('bus.io');

Server.version

The current version of the software.

console.log(bus.version);

Server.Server

The Server exposes it self.

var bus = require('bus.io').Server(3000);

Server.Exchange

The Exchange class queues and propagates messages to your Server. See bus.io-exchange for more information.

var Exchange = require('bus.io').Exchange;

Server.Messages

The Messages class is the interface between the Server and the client. See bus.io-messages for more information.

var Messages = require('bus.io').Messages;

Server#()

var bus = require('bus.io')();

Server#(port:Number)

var bus = require('bus.io')(3000);

Server#(io:socket.io#Server)

var io = require('socket.io')();
var bus = require('bus.io')(io);

Server#(server:http#Server)

var server = require('http').createServer(function (req, res) {}).listen(function (err) {});
var bus = require('bus.io')(server)

Server#actor(fn:Function)

Sets the function that will grab the actor. The default implementation will use the socket.id. This method is called when the socket connection is established.

bus.actor(function (socket, cb) {
  cb(null, socket.id);
});

The callback cb takes two parameters err and actor.

You may pass an Error object for the first argument if you encounter an error or would like to trigger one.

bus.actor(function (socket, cb) {
  socket.get('user', function (err, user) {
    if (err) return cb(err);
    if (!user) return cb(new Error('Need to login'));
    return cb(null, user.name);
  });
});

Server#actor()

Gets the function that will grab the actor from a socket.

var actorFn = bus.actor();

Server#target(fn:Function)

Sets the function that will grab the target from the request. The default implementation will use the socket.id. This method is called for each request from the socket.

The client would emit this.

socket.emit('shout', 'hello', 'You');

We would like "You" to be the actor.

bus.target(function (socket, params, cb) {
  cb(null, params.pop());
});

If you encounter an error you can also pass one along.

bus.target(function (socket, params, cb) {
  if (params.length === 0) {
    cb(new Error('You are you talking to?!'));
  }
  else {
    cb(null, params.pop());
  }
});

You get to decide your own convention.

Server#target()

Gets the method that will grab the target from the request.

var targetFn = bus.target();

Server#socket(socket:Object)

This method will allow you to bind a function to the connection event that socket.io supports.

e.g.

We would like to tell the client "Hello" when they connect.

bus.socket(function (socket, bus) {
  socket.emit('greet', 'Hello');
});

Server#alias(socket:Object, name:String)

With alias your actor will receive messages whenever their alias receives one. This is useful if you want to associate a socket to a logged in user.

bus.alias(socket, 'nathan');

A good place to do this is when the client is connected to the server.

bus.socket(function (socket, bus) {
  socket.get('user', function (err, user) {
    if (err) return socket.emit('error', err);
    if (!user) return socket.emit('login', 'You must login');
    bus.alias(socket, user.name);
  });
});

Server#in(fn#Function,...)

The in method will use the passed function(s) when a message is received from the socket. This allows you to modify the message before it is sent to the exchange.

bus.in(function (message, socket, next) {
  message.content([message.content()[0].toLowerCase()]);
  next();
});

You can pass in multiple functions or arrays of functions.

bus.in(function (a,b,c) {...}, function (a,b,c) {...}, [function (a,b,c) {...}, function(a,b,c) {...}]);

You can set up handlers for specific messages.

bus.in('chat', function (message, socket, next) {
  // do something
  next();
});

If you bind multiple handlers they will be called in this order

bus.in('chat', function (message, socket, next) {
  message.content('A');
  next();
});

bus.in(function (message, socket, next) {
  message.content(message.content()+'B');
});

bus.in('chat', function (message, socket, next) {
  message.content(message.content()+'C');
  next();
});

// The output of message.content() will be 'ABC';

You can control propagation with consume(), deliver(), respond() as well.

bus.in(function (message, socket, next) {
  message.deliver();
});

bus.in(function (message, socket, next) {
  // will not be called because the message will delivered to the target as a result of calling deliver!!
});

bus.in(function (message, socket, next) {
  message.consume();
  // the message will just die here
});

Server#on(event:String, fn:Function)

The on method binds a handler to the queue. The handler will process each message and give you the ability to either deliver the message or discard it. That is up to your application requirements.

bus.on('some event', function (message) {
  message.deliver();
});

Or you can use the optional next parameter. You may eiter call next() to invoke the next handler. Or you may call message.deliver(), message.respond(), or message.consumed() to control the message's propagation.

bus.on('some event', function (message, next) {
  // do something!
  next();
});

Server#out(fn:Function,...)

The out method will use the passed function(s) when a message is received from the exchange. This allows you to modify the message before it is sent to the socket.

Here you could save the message to a mongo store using mongoose.

//assuming you have mongoose and a message model
var Message = monngose.model('Message');

bus.out(function (message, socket, next) {
  new Message(message.data).save(function (err) {
    if (err) return next(err);
    next();
  });
});

You can pass in multiple functions or arrays of functions.

bus.out(function (a,b,c) {...}, function (a,b,c) {...}, [function (a,b,c) {...}, function(a,b,c) {...}]);

You can set up handlers for specific messages.

bus.out('chat', function (message, socket, next) {
  // do something
  next();
});

If you bind multiple handlers they will be called in this order

bus.out('chat', function (message, socket, next) {
  message.content('A');
  next();
});

bus.out(function (message, socket, next) {
  message.content(message.content()+'B');
});

bus.out('chat', function (message, socket, next) {
  message.content(message.content()+'C');
  next();
});

assert.equal(message.content(), 'ABC');

You can control propagation with consume(), deliver(), respond() as well.

bus.out(function (message, socket, next) {
  message.deliver();
});

bus.out(function (message, socket, next) {
  // will not be called because the message will delivered to the target as a result of calling deliver!!
});

bus.out(function (message, socket, next) {
  message.consume();
  // the message will just die here
});

Server#listen(o:Mixed)

You can either pass a port, server, or socket.io instance.

bus.listen(3000);

bus.listen(require('http').createServer(function (req, res) { }));

bus.listen(require('socket.io')());

Server#message(data:Mixed)

This will create you an object for building a message that you can deliver. The data can either be an object or an instanceof of Message.

bus.message({
  actor:'I',
  action:'say',
  content:'hello'
  target:'you',
}).deliver();

A chain-able approach.

bus.message()
  .actor('me')
  .action('say')
  .content('hello')
  .target('you')
  .deliver();

Simply put.

bus.message()
  .i('me')
  .did('say')
  .what('hello')
  .to('you');

Server#exchange()

Gets the exchange the server uses to publish information.

See bus.io-exchange

var exchange = bus.exchange();

Server#exchange(exchange:Server.Exchange)

Sets the exchange the server uses to publish information.

See bus.io-exchange

for more information.

var exchange = require('bus.io').Exchange();
bus.exchange(exchange);

Server#queue()

Gets the Queue the Exchange uses.

var queue = exchange.queue();

Server#queue(queue:Server.Exchange.Queue)

Sets the Queue the Exchange uses.

See bus.io-exchange

var queue = require('bus.io').Exchange.Queue();
bus.queue(queue);

Server#pubsub()

Gets the PubSub the Exchange uses.

See bus.io-exchange

var pubsub = exchange.pubsub();

Server#pubsub(pubsub:Server.Exchange.PubSub)

Sets the PubSub the Exchange uses.

var pubsub = require('bus.io').Exchange.PubSub();
bus.pubsub(pubsub);

Server#autoPropagation(v:Boolean)

Instead of having to write a function to deliver a message like this.

bus.on('some message', function (message) {
  message.deliver();
});

We could call autoPropagate(true) so that any method we have not declared a handler for will automatically be propagated.

bus.autoPropagate(true);

Auto-propagation is on by default. You may turn it off to prevent unwanted messages from going into your bus.

Server#use(fn:Function)

This method will pass the bus instance into your function. Your function can then do whatever it needs to attach it self to your bus.

In this example we create a middleware that will emit an event whenever we handle a message going in(), on(), or out() of the bus.

function tracker (emitter) {
  return function (bus) {
    function handler (event) {
      return function (message, next) {
        emitter.emit('track', event, message);
        next();
      }
    }
    bus.in(handler('in'));
    bus.on(handler('on'));
    bus.on(handler('out'));
  }
}

var receiver = new require('events').EventEmitter();

report.on('track', function (point, message) {
  this.data = this.data || {};
  this.data[point] = this.data[point] || {};
  this.data[point][message.action()] = this.data[point][message.action()] || 0;
  this.data[point][message.action()] += 1;
});

report.on('report', function () {
  console.log(this.data);
});

setInterval(function () {
  report.emit('report');
}, 1000);

bus.use(tracker(report));

Core Components

bus.io is broken down into other components.

bus.io-common contains all the common code such as the Message, Builder, and Controller classes.
bus.io-exchange contains all the code that will be used to handle messages going into the Queue and propagation on the PubSub.
bus.io-messsages contains the code that handles listening to a socket.io Socket for an event and building that into a message.
bus.io-receiver contains the code that handles receiving messages in, on, and out the bus.

Testing

Test drive your apps with bus.io-driver.

bus.io-driver The driver helps you test driver bus.io in your apps.

Middleware

Middleware components you can use in your apps.

bus.io-monitor The monitor helps your bus.io apps report on the messages being processed.
bus.io-session The session is used to maintain state for socket connections and multiple servers.

Running Tests

Install coffee-script

> npm install coffee-script -g

Tests are run using grunt. You must first globally install the grunt-cli with npm.

> sudo npm install -g grunt-cli

Unit Tests

To run the tests, just run grunt

> grunt spec

Working Examples and Demos

You will need a redis server up and running to run the demos at this time

Examples

> node examples/echo.js

Demos

Demos are under the /demo directory. There is currently a basic chat program.

TODO

There are open issues ff you would like to contribute please fork and send me a pull request!

The Server

The Client

How this works

Installation and Environment Setup

For using bus.io

For developing bus.io

Examples

Configuration

Setting the Actor

Setting the Target

Aliasing a Socket to an Actor

Handling Messages

Messages from the Socket going into the Bus

Messages on the Bus

Delivering messages

Consuming messages

Creating messages

Messages from the Bus going to the Socket

API

Server

Server.version

Server.Server

Server.Exchange

Server.Messages

Server#()

Server#(port:Number)

Server#(io:socket.io#Server)

Server#(server:http#Server)

Server#actor(fn:Function)

Server#actor()

Server#target(fn:Function)

Server#target()

Server#socket(socket:Object)

Server#alias(socket:Object, name:String)

Server#in(fn#Function,...)

Server#on(event:String, fn:Function)

Server#out(fn:Function,...)

Server#listen(o:Mixed)

Server#message(data:Mixed)

Server#exchange()

Server#exchange(exchange:Server.Exchange)

Server#queue()

Server#queue(queue:Server.Exchange.Queue)

Server#pubsub()

Server#pubsub(pubsub:Server.Exchange.PubSub)

Server#autoPropagation(v:Boolean)

Server#use(fn:Function)

Core Components

Testing

Middleware

Running Tests

Unit Tests

Working Examples and Demos

Examples

Demos

TODO

About