keedio / hue

Let’s Big Data. Hue is an open source Web interface for analyzing data with Hadoop and Spark. http://gethue.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

docs/images/hue_logo.png

Welcome to the repository for Hue

Hue is an open source Web interface for analyzing data with any Apache Hadoop: gethue.com

docs/images/hue-screen.png

It features:

  • SQL Editors for Hive, Impala, MySql, PostGres, Sqlite and Oracle
  • Dynamic search dashboards for Solr
  • Spark Notebooks
  • Browsers for YARN, HDFS, Hive table Metastore, HBase, ZooKeeper
  • Pig Editor, Sqoop2, Oozie workflows Editors and Dashboards
  • Wizards to import data into Hadoop

On top of that, a SDK is available for creating new apps integrated with Hadoop.

More user and developer documentation is available at http://gethue.com.

Getting Started

To build and get the development server running:

$ git clone https://github.com/cloudera/hue.git
$ cd hue
$ make apps
$ build/env/bin/hue runserver

Now Hue should be running on http://localhost:8000 !

The configuration in development mode is desktop/conf/pseudo-distributed.ini.

Note: to start the production server (but lose the automatic reloading after source modification):

$ build/env/bin/supervisor

To run the tests:

Install the mini cluster (only once):
$ ./tools/jenkins/jenkins.sh slow

Run all the tests:
$ build/env/bin/hue test all

Or just some parts of the tests, e.g.:
$ build/env/bin/hue test specific impala
$ build/env/bin/hue test specific impala.tests:TestMockedImpala
$ build/env/bin/hue test specific impala.tests:TestMockedImpala.test_basic_flow

Development Prerequisites

You'll need these library development packages and tools installed on your system:

Ubuntu:
  • ant
  • gcc
  • g++
  • libkrb5-dev
  • libmysqlclient-dev
  • libssl-dev
  • libsasl2-dev
  • libsasl2-modules-gssapi-mit
  • libsqlite3-dev
  • libtidy-0.99-0 (for unit tests only)
  • libxml2-dev
  • libxslt-dev
  • make
  • mvn (from maven package or maven3 tarball)
  • openldap-dev / libldap2-dev
  • python-dev
  • python-setuptools
  • libgmp3-dev
CentOS/RHEL:
  • ant
  • asciidoc
  • cyrus-sasl-devel
  • cyrus-sasl-gssapi
  • gcc
  • gcc-c++
  • krb5-devel
  • libtidy (for unit tests only)
  • libxml2-devel
  • libxslt-devel
  • make
  • mvn (from maven package or maven3 tarball)
  • mysql
  • mysql-devel
  • openldap-devel
  • python-devel
  • sqlite-devel
  • openssl-devel (for version 7+)
  • gmp-devel
MacOS:
  • Xcode command line tools
  • Oracle's JDK 1.7+
  • maven (Homebrew)
  • mysql (Homebrew)
  • gmp (Homebrew)

File Layout

The Hue "framework" is in desktop/core/ and contains the Web components. desktop/libs/ is the API for talking to various Hadoop services. The installable apps live in apps/. Please place third-party dependencies in the app's ext-py/ directory.

The typical directory structure for inside an application includes:

src/
for Python/Django code
models.py urls.py views.py forms.py settings.py
conf/
for configuration (.ini) files to be installed
static/
for static HTML/js resources and help doc
templates/
for data to be put through a template engine
locales/
for localizations in multiple languages

For the URLs within your application, you should make your own urls.py which will be automatically rooted at /yourappname/ in the global namespace. See apps/about/src/about/urls.py for an example.

Main Stack

Hue would not be possible without:

Community

License

Apache License, Version 2.0 http://www.apache.org/licenses/LICENSE-2.0

About

Let’s Big Data. Hue is an open source Web interface for analyzing data with Hadoop and Spark. http://gethue.com

License:Apache License 2.0


Languages

Language:Python 43.3%Language:HTML 29.4%Language:JavaScript 18.3%Language:C 3.1%Language:Mako 2.8%Language:CSS 1.0%Language:XSLT 0.5%Language:C++ 0.3%Language:Scala 0.2%Language:Perl 0.2%Language:Java 0.2%Language:TeX 0.2%Language:Makefile 0.2%Language:Thrift 0.1%Language:Shell 0.1%Language:Roff 0.0%Language:Batchfile 0.0%Language:PLSQL 0.0%Language:Emacs Lisp 0.0%Language:LiveScript 0.0%Language:Objective-C 0.0%Language:PLpgSQL 0.0%Language:Dockerfile 0.0%Language:R 0.0%Language:Nix 0.0%Language:LSL 0.0%Language:Liquid 0.0%Language:TypeScript 0.0%Language:Pascal 0.0%Language:M4 0.0%Language:ActionScript 0.0%Language:Groovy 0.0%Language:FreeMarker 0.0%Language:Lua 0.0%Language:Forth 0.0%Language:ABAP 0.0%Language:Genshi 0.0%Language:Visual Basic 0.0%Language:Myghty 0.0%Language:Tcl 0.0%Language:VHDL 0.0%Language:Clojure 0.0%Language:AutoHotkey 0.0%Language:Gherkin 0.0%Language:TSQL 0.0%Language:Elixir 0.0%Language:Go 0.0%Language:Common Lisp 0.0%Language:Mask 0.0%Language:Scheme 0.0%Language:OCaml 0.0%Language:Ruby 0.0%Language:G-code 0.0%Language:Cirru 0.0%Language:GLSL 0.0%Language:Haskell 0.0%Language:Assembly 0.0%Language:Rust 0.0%Language:Dart 0.0%Language:Elm 0.0%Language:Erlang 0.0%Language:Vala 0.0%Language:Haxe 0.0%Language:PowerShell 0.0%Language:CoffeeScript 0.0%Language:Eiffel 0.0%Language:PigLatin 0.0%Language:PHP 0.0%Language:OpenSCAD 0.0%Language:D 0.0%Language:Verilog 0.0%Language:Lean 0.0%Language:Julia 0.0%Language:MATLAB 0.0%Language:Io 0.0%Language:Smarty 0.0%Language:XQuery 0.0%Language:sed 0.0%Language:Ada 0.0%Language:ColdFusion 0.0%Language:C# 0.0%Language:COBOL 0.0%Language:JSONiq 0.0%