shivaram

spark-ec2

Scripts used to setup a Spark cluster on EC2

cs537-sp23-discussion

Code snippets used during lecture and discussion

matrix-bench

Single machine matrix benchmarks to compare various implementations

shivaram.github.io

Repository for homepage

SparkR-pkg

R frontend for Spark

adam

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark and Parquet. Apache 2 licensed.

BigDL

BigDL: Distributed Deep Learning Library for Apache Spark

breeze

Breeze is a numerical processing library for Scala.

CNTK

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

factsheet-generator

keystone

The biggest, baddest pipelines around.

marius

Large scale embeddings on a single machine.

ml-matrix

Distributed Matrix Library

netlib-java

Mission-critical components for linear algebra systems, with Fortran performance.

parlearn

parallel SGD implementation

program-milestones

Repository for materials related to program milestone hackathon and evaluation events

pywren

Just how many threads do you need?

runtimes

spark-1

Mirror of Apache Spark

spark-ec2-1

Scripts used to setup a Spark cluster on EC2

spark-ml

proposal for the new interfaces

spark-perf

Performance tests for Spark, Shark, etc.

spark-perf-1

Performance tests for Spark

spark-pr-dashboard

Dashboard to aid in Spark pull request reviews

spark-utils

Various development utilities created when hacking on Spark

spark-website

Mirror of Apache Spark Website

streaming-benchmarks

Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, ...

succinct

Java/Scala Implementation of Succinct.

testthat

An R package to make testing fun

website