BhandariArpan / jumbune

Jumbune is an open-source project to optimize both Yarn (v2) and older (v1) Hadoop based solutions. It's a Linux based framework to assist in fault free analytic solution development, data quality validation and efficient cluster utilization. Jumbune can decoupled from the Hadoop cluster & run on a separate machine. Being a generic implementation, Jumbune can work with almost all major Hadoop distributions.

jumbune

Synopsis

Jumbune is an open-source product built for analyzing Hadoop cluster and MapReduce jobs. It provides development & administrative insights of Hadoop based analytical solutions. It enables user to Debug, Profile, Monitor & Validate analytical solutions hosted on decoupled clusters.

Website

http://jumbune.org

Issue Tracker

http://jumbune.org/jira/browse/JUM

Building

Jumbune can be build with maven

• To build for a Yarn Hadoop cluster

mvn clean install -P yarn

• To build for a non Yarn Hadoop cluster

mvn clean install

Installation

Detailed installation guide can be found at http://bit.ly/1kBG4Qo

Deployment Planning guide at http://bit.ly/1oiXGk2

• Deploying Jumbune

java -jar <location of the distribution build jar>

• Running Jumbune Agent

java -jar <jumbune agent jar> <port> <|verbose>

• Running Jumbune

./startWeb

or

./runCli

Code Examples

Code examples are packages inside the distribution,

• For Flow analyzer: BankDefaulters, ClickStreamAnalysis, USRegionPortouts
• For Profilng: MovieRating
• For Data Validation - script

Documentation

• Quick Start Guide: http://bit.ly/1mY9qWe
• Installation Guide: http://bit.ly/1kBG4Qo
• Release Notes: http://bit.ly/TkWSj8
• Architecture Guide: http://bit.ly/UgJayB
• Deployment Planning Guide: http://bit.ly/1oiXGk2
• Administration Guide: http://bit.ly/1uq5LVV
• Troubleshooting Guide: http://bit.ly/1pXEYOd
• Getting Involved Guide: http://bit.ly/1i7XjDn

License

Jumbune is licensed under LGPLv3 license