darkjh

scalaflow

Fluent Scala DSL for Google's Cloud Dataflow SDK

go-mapreduce

Simple map-reduce implementation in Golang

go-replicated-log

Simple paxos-based replicated log implementation for learning purpose

powerline-shell-scala

A re-implementation of powerline-shell in Scala

zeppelin-ammonium

akka-pagerank

Experimental page rank implementation in Akka

scala-exercises

Some interesting programs written in Scala

spark-dataflow

Provides a Spark backend for executing Dataflow pipelines.

spark-test

Some hands-on tests with Spark

SparkInternals

Notes talking about the design and implementation of Apache Spark

1brc

1️⃣🐝🏎️ The One Billion Row Challenge -- A fun exploration of how quickly 1B rows from a text file can be aggregated with Java

Algorithm

Algorithms and solutions to various programming questions

almond

A scala kernel for Jupyter

breeze

Breeze is a numerical processing library for Scala.

cluster-pack

A library on top of either pex or conda-pack to make your Python code easily available on a cluster

coursier

Pure Scala Artifact Fetching

dotfiles

My dotfiles

dpark

Python clone of Spark, a MapReduce alike framework in Python

emacs

my .emacs.d

FiloDB

Distributed. Columnar. Versioned. Streaming. SQL.

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

mini-lsm

A tutorial of building an LSM-Tree storage engine in a week!

pathy-dict

Python dictionary manipulations with paths

plotly-scala

Scala bindings for plotly.js

practical-reactor

Practical Project Reactor and reactive programing workshop

scalaz-task-intro

Introduction to Task, November 2014

simpleflow

Python library for dataflow programming.

spark

Mirror of Apache Spark

spark-jobserver

REST job server for Spark

tf-yarn

Train TensorFlow models on YARN in just a few lines of code!