jmrozanec / pipeline

PipelineAI: End-to-End ML and AI Platform for Real-time Spark and Tensorflow Data Pipelines

Built with Love and Scale by ex-Netflix, Databricks, and Tensorflow Engineers

Videos

• Continuously Train & Deploy Spark ML and Tensorflow AI Models from Jupyter Notebook to Production (StartupML Conference Jan 2017)
• Recent Advancements in Data Science Workflows: From Jupyter-based Notebook to NetflixOSS-based Production (Big Data Spain Nov 2016)

Resources

Documentation

• Wiki

Workshops

Sign Up Now!

Quick Start

Local Laptop

Kubernetes Mini + PipelineIO Cluster for your Laptop

• PipelineIO Local (Local Laptop)

Kubernetes + PipelineIO Cluster on any Cloud or Data Center

• Pipeline on AWS

• Pipeline on Google

• PipelineIO on Azure

Global 24x7 Support for Everyone!

• Create a Ticket
• Email [e-mail]

Reference Architecture

Other Features

100% Open Source

100% Open Source using Kubernetes + Docker

PMML + Native C++/Java Code Generation for Optimized CPU/GPU Performance

Deploy directly from Jupyter Notebook to Hybrid-Cloud Microservices

NetflixOSS-based Microservices for High Scalability and Availability

Continuous Train/Deploy Spark ML and Tensorflow AI Pipelines to Production

KINESIS

Community

Global Advanced Spark and Tensorflow Meetup

Slideshare Slides

YouTube Videos

Docker Images