petro-rudenko

spark-glove

Global Vectors for Word Representation on spark

play-clojurescript

ClojureScript to JavaScript compiler for Play 2.2

rdma

rdma_perf

the-geek-in-the-corner

Sample code from thegeekinthecorner.com

ucx

Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group):

babar

Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.

clusterdock

disni

DiSNI: Direct Storage and Networking Interface

elastic4s

Scala client and DSL for elasticsearch

hadoopecosystemtable.github.io

This page is a summary to keep the track of Hadoop related projects, and relevant projects around Big Data scene focused on the open source, free software enviroment.

HiBench

HiBench is a big data benchmark suite.

hue

Let’s big data. Hue is a Web interface for analyzing data with Apache Hadoop. It supports a file and job browser, Hive, Pig, Impala, Spark, Oozie editors, Solr Search dashboards, HBase, Sqoop2, and more.

ironic

A service for managing and provisioning Bare Metal servers. Mirror of code maintained at opendev.org.

ironic-image

Container image to run OpenStack Ironic as part of Metal³

libibprof

verbs profiling library

misc

Misc helper development scripts

observatory

Observatory is an extensible Java framework for benchmarking InfiniBand verbs implementations.

prelude

Prelude is an enhanced Emacs 24 distribution that should make your experience with Emacs both more pleasant and more powerful.

rust-libs

A catalogue of Rust community's awesomeness!

spark

Mirror of Apache Spark

spark-csv

CSV data source for Spark SQL and DataFrames

spark-jobserver

REST job server for Apache Spark

spark-perf

Performance tests for Spark

spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

spark-terasort

Spark Terasort

sparkling-water

Sparkling Water provides H2O functionality inside Spark cluster

SparkRDMA

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

sparkucx

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

twister2

Twister2 Big Data Hosting Environment: A composable framework for high-performance data analytics