xiaojuntong / hdf5-and-spark

Example glue code for loading HDF5 data into Spark

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Exploring the integration between Thunder (Spark) and HDF5

This ipython notebook comes as a collaborative effort between Jeremy Freeman, Cyrille Rossant and Roman Valls to explore the idea exposed in a blog post written during the Neuroinformatics Without Borders event.

The idea is to invite the electrophysiology community to use high performance frameworks such as Thunder/Spark while using their already semi-stablished data format standards, such as KWIK.

About

Example glue code for loading HDF5 data into Spark