Blowout

What is Blowout?

Blowout is a tool for receiving Bag-of-tasks (BoT) submissions, monitoring requests and interacting with a Infrastructure Provider to execute the received tasks in federated cloud resources. Blowout abstracts away a complex distributed infrastructure and allows the user to focus on the application requirements.

An example of Infrastructure Provider and Task Submitter for Blowout are, respectively, Fogbow Middleware and Iguassu.

The main Blowout features are:

Receive and Request: receive tasks submissions and request resources from the federated cloud for these tasks.
Associate and Execute: associate to a particular task a resource that match with the task requirements and request the execution of this task in the resource.
Monitor: monitor the task execution in the associated resource.

See the following topics to understand the Blowout architecture, how to deploy and configure it, and finally, how to use it to execute tasks.

Blowout Architecture

Blowout works similarly to a scheduler of tasks to computational resources dispersed among clouds that are managed by an Infrastructure Provider.

Blowout has six main components:

BlowoutPool: manages a pool of tasks and resources. It is through the BlowoutPool that the components have access to the received tasks and resources that were raised by the Infrastructure Provider.
Scheduler: associates and disassociates a task, that is ready to be executed, to an available resource. After associating or disassociating a resource to a task, the Scheduler delegates to Task Monitor the assignment of creating or terminating the task execution process in the resource.
Infrastructure Manager: requests and adds pending resources based on the demand of ready tasks and the availability and specifications of existing resources.
Infrastructure Provider: interacts with the physical resource provider, being responsible for executing the resource requests and making them available in the BlowoutPool.
Resource Monitor: monitors the state of resources that have already been allocated and are pending, managing the availability of these resources in the pool.
Task Monitor: creates and closes a process for a task that is ready to be executed, in addition, monitors the execution of tasks that are in running state.

Installation

Before Blowout installation is necessary to get a Blowout dependency, Fogbow Manager.

wget https://github.com/fogbow/fogbow-manager/archive/master.zip

Then, decompress it:

unzip master.zip

To get the latest stable version of Blowout source code, download it from our repository:

wget https://github.com/fogbow/blowout/archive/master.zip

Then, decompress it:

unzip master.zip

After that, get all projects JAR of Fogbow Manager and Blowout. To achieve that, maven must be installed in client's machine with commands:

apt-get install maven

And then, simply use the following command in each project directory:

mvn -e install -Dmaven.test.skip=true

After installation, you can add and import Blowout to your Task Submitter project.

Configuring Blowout

See an example of Blowout configuration file, change it and make your own Blowout configuration file. For more information see Blowout Configurations.

After set your Blowout configuration file, use Blowout with it.

Using Blowout

After installation and configuration, you can import and add Blowout into your federated cloud Task Submitter project. The following example illustrates the Blowout usage.

import org.fogbowcloud.blowout.core.BlowoutController;

public class TaskSubmitter {

	public TaskSubmitter(File blowoutConf) throws Exception {
		
		Properties properties = new Properties();
		properties.load(new FileInputStream(blowoutConf));
		
		boolean removePreviousResources = true;

		BlowoutController blowout = new BlowoutController(properties);

		blowout.start(removePreviousResources);

		blowout.stop();
	}
}

Submitting Tasks

A task in the Blowout is modeled as a Task object. See Job Description File and Arrebol code to know how construct a Task object from a job description file.

The example below illustrates how to submit a Task to Blowout:

public void submitTask(Task task) {
	
	blowout.addTask(task);
}

It's possible to submit a list of tasks, see the example below:

public void submitTaskList(List<Task> taskList) {
	
	blowout.addTaskList(taskList);
}

Removing Task

It's possible to remove a submitted task:

public void removeTask(Task task) {
	
	blowout.cleanTask(task);
}

Two Tasks are equal when they have the same ID and Specifications.

Monitoring Tasks

You can know the state of a Task that has been submitted to Blowout.

blowout.addTask(task);

TaskState taskState = blowout.getTaskState(task.getId());

System.out.println(taskState.getDesc());

The possible states of a Task are presented in the table below.

Task State	Description
Ready	The Task is ready to be executed
Running	The Task is running on the associated resource
Finished	The Task was finished with success
Completed	The Task was finished with success and was taken from the running tasks list
Not Created	The Task does not exist in Blowout
Timed out	The Task took timeout

Customizing Blowout Components

You can adapt some Blowout components to operate with your application needs. For more information see Customizing Blowout Components.

After customizations and configurations sets, you can use Blowout with your new Custom Components.

joivo / blowout