pipeline-framework

There are 19 repositories under pipeline-framework topic.

google-ai-edge / mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
mediapipe c-plus-plus computer-vision deep-learning android video-processing audio-processing mobile-development machine-learning inference graph-framework graph-based calculator framework pipeline-framework stream-processing perception
Language:C++ 27694
nextflow
nextflow-io / nextflow
A DSL for data-driven computational pipelines
aws bioinformatics cloud dataflow docker groovy hello hpc nextflow pipeline pipeline-framework reproducible-research reproducible-science sge singularity singularity-containers slurm workflow-engine
Language:Groovy 2774
yuanxiaosc / Entity-Relation-Extraction
Entity and Relation Extraction Based on TensorFlow and BERT. 基于TensorFlow和BERT的管道式实体及关系抽取，2019语言与智能技术竞赛信息抽取任务解决方案。Schema based Knowledge Extraction, SKE 2019
bert-model competition-code entity-extraction pipeline-framework relation-extraction tensorflow
Language:Python 1223
pipeless-ai / pipeless
An open-source computer vision framework to build and deploy apps in minutes
artificial-intelligence computer-vision multimedia multimedia-applications cloud deep-learning machine-learning object-detection video yolo ffmpeg gstreamer inference-server python vision-framework inference perception pipeline-framework stream-processing video-processing
Language:Rust 725
yzhao062 / combo
(AAAI' 20) A Python Toolbox for Machine Learning Model Combination
machine-learning data-mining data-science ensemble-learning python model-combination aggregation pipeline-framework machine-learning-pipelines
Language:Python 642
Neuraxle
Neuraxio / Neuraxle
The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.
deep-learning framework hyperparameter-optimization hyperparameter-search hyperparameter-tuning hyperparameters machine-learning neuraxle parallel pipeline pipeline-framework python-library scikit-learn
Language:Python 608
minerva-ml / open-solution-home-credit
Open solution to the Home Credit Default Risk challenge :house_with_garden:
competition credit-risk credit-scoring deep-learning feature-engineering kaggle lightgbm machine-learning neptune open-source pipeline pipeline-framework python python3 python35 reproducibility reproducible-experiments xgboost
Language:Python 452
CubicZebra / informatics
Framework of fast implementation data processing and operating pipelines
data-visualization machine-learning mathematical-statistics pipeline-framework scientific-computing
Language:Python 409
MegEngine / MegFlow
Efficient ML solution for long-tailed demands.
computer-vision deep-learning megengine megenginelite pipeline pipeline-framework python3 rust
Language:Rust 402
neptune-ai / open-solution-mapping-challenge
Open solution to the Mapping Challenge :earth_americas:
data-science machine-learning deep-learning kaggle python satellite-imagery data-science-learning lightgbm unet unet-image-segmentation unet-pytorch neptune machine-learning-lab mapping-challenge crowdai competition pipeline pipeline-framework
Language:Python 381
gokart
m3dev / gokart
Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.
gokart luigi machine-learning mlops pipeline-framework
Language:Python 318
thomhurst / ModularPipelines
Write your pipelines in C# !
build build-system build-tool build-tools csharp dotnet dotnet-core dotnetcore pipeline pipeline-deploy pipeline-framework pipelines
Language:C# 313
s8sg / faas-flow
Function Composition for OpenFaaS
openfaas openfaas-template faas function-chain serverless automation pipeline-framework faas-flow function-composition pipeline integration workflow-engine
Language:Go 258
pipefunc
pipefunc / pipefunc
Lightweight fast function pipeline (DAG) creation in pure Python for scientific workflows 🕸️🧪
dag hpc parallel-computing pipeline-framework pipelines reproducible-research slurm workflow-engine
Language:Python 216
analysiscenter / batchflow
BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.
python3 data-science machine-learning python pipeline-framework pipeline workflow workflow-engine
Language:Python 201
FluentMediator
ivanpaulovich / FluentMediator
:twisted_rightwards_arrows: FluentMediator is an unobtrusive library that allows developers to build custom pipelines for Commands, Queries and Events.
chain-methods chain-of-responsibility craftmanship csharp ddd-cqrs dotnet-core event-driven event-handlers event-sourcing fluent-design fluent-interface mediator-pattern message-bus pipeline-framework pipelines tdd
Language:C# 193
datajoint-python
datajoint / datajoint-python
Relational data pipelines for the science lab
cloud-computing data-analysis data-pipelines databases datajoint mysql pipeline-framework python relational-algebra relational-databases relational-model s3 scientific-computing workflow-management
Language:Python 169
whitaker-io / machine
Machine is a workflow/pipeline library for processing data
golang golang-library golang-package workflow workflow-engine pipeline pipeline-framework codespaces golangci-lint github-actions mit-license stream-processing streaming-data
Language:Go 158
neptune-ai / open-solution-salt-identification
Open solution to the TGS Salt Identification Challenge
deep-learning machine-learning data-science python python3 image-processing image-segmentation pytorch pipeline pipeline-framework neptune steppy steppy-toolkit unet unet-image-segmentation
Language:Python 120
pwwang / pipen
A pipeline framework for python
dot jinja2 pipeline pipeline-framework python workflow workflow-engine
Language:Python 103
AustralianSynchrotron / lightflow
A lightweight, distributed workflow system
celery networkx pipeline pipeline-framework python python3 workflow workflow-automation workflow-engine
Language:Python 101
maxim2266 / strit
Package strit introduces a new type of string iterator, along with a number of iterator constructors, wrappers and combinators.
fluent-interface function-composition golang iteration pipeline-framework string-processing
Language:Go 84
benfoster / Flo
Lightweight library for composing chain of responsibility pipelines
asp-net-core asp-net csharp pipeline-framework flow-based-programming
Language:C# 83
Geoweaver
ESIPFed / Geoweaver
boost data pipeline's tangibility, enhance research productivity, reduce work anxiety
ai earth-science esip-lab pipeline pipeline-framework productivity scientific-computing tangibility workflow workflow-engine workflow-management workflow-tool
Language:JavaScript 81
CyberReboot / vent
Vent is a light-weight platform built to automate network collection and analysis pipelines using a flexible set of popular open source tools and technologies. Vent is python-based, extensible, leverages docker containers, and provides both an API and CLI.
automation cli containers deployment docker elasticsearch gpu pipeline-framework pipelines processing prototyping rabbitmq redis scheduling syslog tui
Language:Python 76
marsggbo / torchline
Easy to use Pytorch
demo pipeline-framework pytorch pytorch-lightning torchline
Language:Python 71
houmo-ai / mediapipe_plus
The purpose of this project is to apply mediapipe to more AI chips.
blazeface c-plus-plus computer-vision deep-learning facedetect graph-framework inference jetson machine-learning mediapipe onnx opencv opengl pipeline-framework stream stream-processing tensorrt video-processing vision xavier
Language:C++ 51
Matts966 / alphasql
AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery
bigquery cycle-detection datawarehouse datawarehouseautomation dependency-analysis dependency-graph docker dot-language elt graphviz parallelization pipeline-framework typechecker workflow-automation workflow-tool zetasql
Language:C++ 50
bsc-wdc / compss
COMP Superscalar (COMPSs) is a framework which aims to ease the development and execution of applications for distributed infrastructures, such as Clusters, Grids and Clouds.
distributed-computing workflows java python c workflow-management-system pipeline-framework hpc docker singularity slurm
Language:Java 47
Cambricon / CNStream
CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/SolutionSDK/CNStream
c-plus-plus computer-vision inference pipeline-framework graph-framework machine-learning cambricon cambricon-cnstream mlu
Language:C++ 46
minerva-ml / open-solution-googleai-object-detection
Open solution to the Google AI Object Detection Challenge :maple_leaf:
challenge data-science deep-learning deep-neural-networks detection-network google-ai-challange machine-learning mask-rcnn object-detection pipeline pipeline-framework reproducibility reproducible-experiments reproducible-research retina-net
Language:Python 46
cginternals / gloperate
C++ library for defining and controlling modern GPU rendering/processing operations.
c-plus-plus c-plus-plus-11 framework opengl-framework pipeline-framework rendering-engine script-injection
Language:C++ 43
minerva-ml / open-solution-value-prediction
Open solution to the Santander Value Prediction Challenge :tropical_fish:
machine-learning deep-learning data-science reproducibility reproducible-experiments open-source education training python lightgbm xgboost sklearn pipeline-framework ensemble-model neptune santander competition banking-applications
Language:Python 39
MERlin
emanuega / MERlin
MERlin is an extensible analysis pipeline applied to decoding MERFISH data
pipeline-framework modular transcriptomics merfish cloud-computing image-processing segmentation
Language:Python 35
CMU-INF-DIVA / pyturbo
Pyturbo package: A pipeline system for efficient concurrent execution
pipeline-framework parallel
Language:Python 28
saantiaguilera / go-pipeline
Build, execute and represent pipelines (aka workflows / templates) in Go
pipeline pipeline-framework pipeline-processor flowframework faas-flow workflow flow flow-control template template-library
Language:Go 28