dataflow

There are 26 repositories under dataflow topic.

marimo-team / marimo
A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.
notebooks python data-science machine-learning artificial-intelligence data-visualization developer-tools reactive pipeline web-app dag dataflow
Language:Python 7920
Drawflow
jerosoler / Drawflow
Simple flow library 🖥️🖱️
dataflow dataflow-programming drawflow editor flow flow-based-programming flowchart graph-editor javascript javascript-library nodebased visual-programming vue
Language:JavaScript 4803
pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
batch-processing data-analytics data-pipelines data-processing dataflow etl etl-framework iot-analytics kafka machine-learning-algorithms pathway python real-time rust stream-processing streaming time-series-analysis
Language:Python 4327
umbrella
thi-ng / umbrella
⛱ Broadly scoped ecosystem & mono-repository of 199 TypeScript projects (and ~180 examples) for general purpose, functional, data driven development
color data-structures dataflow dsl functional-programming geometry html monorepo parser-combinators reactive-programming shadergraph streams transducers typescript ui vectors visualization webassembly webgl ziglang
Language:TypeScript 3402
nextflow
nextflow-io / nextflow
A DSL for data-driven computational pipelines
aws bioinformatics cloud dataflow docker groovy hello hpc nextflow pipeline pipeline-framework reproducible-research reproducible-science sge singularity singularity-containers slurm workflow-engine
Language:Groovy 2771
spotify / scio
A Scala API for Apache Beam and Google Cloud Dataflow.
batch beam bigquery data dataflow google-cloud ml scala scio streaming
Language:Scala 2557
python-security / pyt
A Static Analysis Tool for Detecting Security Vulnerabilities in Python Web Applications
abstract-syntax abstract-syntax-tree control-flow-graph dataflow dataflow-analysis fixed-point fixed-point-analysis flask program-analysis pyt python python3 security static-analysis static-code-analysis taint taint-analysis
Language:Python 2176
joern
joernio / joern
Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc
binary c code-analysis code-browser code-property-graph controlflow cpg cpp dataflow fuzzy-parsing ghidra graph java javabytecode javascript llvm query-language scala syntax-tree
Language:Scala 2110
bearer
Bearer / bearer
Code security scanning tool (SAST) to discover, filter and prioritize security and privacy risks.
appsec compliance devsecops devsecops-tools security security-tools dataflow gdpr privacy sast static-code-analysis vulnerability security-audit security-scanner vulnerabilities code-quality static-analysis security-automation owasp
Language:Go 2053
willcrichton / flowistry
Flowistry is an IDE plugin for Rust that helps you focus on relevant code.
dataflow rust static-analysis vscode
Language:Rust 1905
serverless / event-gateway
React to any event with serverless functions across clouds
event-driven dataflow pubsub functions-as-a-service serverless golang event-router
Language:Go 1650
trustmaster / goflow
Flow-based and dataflow programming library for Go (golang)
data-flow dataflow fbp go goflow
Language:Go 1619
baklavajs
newcat / baklavajs
Graph / node editor in the browser using VueJS
dataflow dataflow-programming editor flow flow-based-programming flow-control graph node node-editor vuejs
Language:TypeScript 1609
dora-rs / dora
DORA (Dataflow-Oriented Robotic Architecture) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.
dataflow embodied-ai low-latency robotics rust
Language:Rust 1573
bytewax / bytewax
Python Stream Processing
data-engineering data-processing data-science dataflow machine-learning python rust stream-processing streaming-data
Language:Python 1568
ipyflow / ipyflow
A reactive Python kernel for Jupyter notebooks.
dataflow developer-tools highlighting ipyflow jupyter jupyter-notebooks jupyterlab lineage nbsafety notebooks pypi python reactivity static-analysis static-code-analysis tracing
Language:Python 1149
scipipe / scipipe
Robust, flexible and resource-efficient pipelines using Go and the commandline
scientific-workflows bioinformatics-pipeline workflow go dataflow pipeline cheminformatics bioinformatics fbp scipipe workflow-engine golang
Language:Go 1076
RaftLib / RaftLib
The RaftLib C++ library, streaming/dataflow concurrency via C++ iostream-like operators
c-plus-plus cmake dataflow dataflow-programming dataflow-structure dataflows dsl hpc ipc machine opencv parallel pthreads qthread-library qthreads raftlib runtime streaming thread thread-library
Language:C++ 954
OWASP / pytm
A Pythonic framework for threat modeling
data-flow-diagram dataflow dfd diagram pythonic-framework secure-development sequence-diagram threat-modeling threat-modeling-from-code threats
Language:Python 923
composewell / streamly
High performance, concurrent functional programming abstractions
arrays async concurrency dataflow filesystem folds frp haskell logic-programming loops modular network non-determinism parsers pipes reactive-programming stream-fusion streaming unfolds unicode
Language:Haskell 867
nipy / nipype
Workflows and interfaces for neuroimaging packages
python workflow-engine brain-imaging big-data dataflow data-science dataflow-programming neuroimaging brainweb
Language:Python 750
Xilinx / finn
Dataflow compiler for QNN inference on FPGAs
dataflow quantization fpga compiler neural-network
Language:Python 750
lw-lin / streaming-readings
Streaming System 相关的论文读物
apache-spark dataflow drizzle flink heron millwheel s4 spark-streaming spe storm stream-processing stream-processing-engine streaming streaming-engine
728
jaystack / repatch
Dispatch reducers
reducer middleware async-actions redux redux-thunk thunk dispatch data-management dataflow react
Language:TypeScript 508
google / shenzhen-go
Experimental visual Go environment
visual graph flow flowchart dataflow go golang
Language:JavaScript 464
wotbrew / relic
Functional relational programming for Clojure(Script).
clojure dataflow incremental-view-maintenance logic relational-algebra relations sql
Language:Clojure 409
chigraph / chigraph
A visual systems language for beginners compiled using LLVM
language language-learning learn-to-code chigraph dataflow-programming dataflow llvm
Language:C++ 404
asg017 / dataflow
An experimental self-hosted Observable notebook editor, with support for FileAttachments, Secrets, custom standard libraries, and more!
observable-notebooks dataflow dataflow-notebooks observablehq
Language:JavaScript 400
pothosware / PothosCore
The Pothos data-flow framework
cpp11 dataflow flowframework networking parallel-computing pothos pothos-framework sdr
Language:C++ 305
spotify / pythonflow
:snake: Dataflow programming for python.
dataflow python machine-learning
Language:Python 285
ghostiam / vue-blocks
Vue2 dataflow graph editor
blocks blueprints dataflow editor graph visual-programming vuejs2 workflow
Language:Vue 281
meemooapp
meemoo / meemooapp
Creative apps to use, build, share, and hack in the browser.
vj dataflow visual-programming media web-art animation webapp
Language:JavaScript 258
Chaffelson / nipyapi
A convenient Python wrapper for Apache NiFi
python nifi api-wrapper automation dataflow
Language:Python 247
GoogleCloudPlatform / data-analytics-golden-demo
An end to end demo of Google's Cloud data and analytic stack.
bigdata bigquery composer dataflow dataproc gcp
Language:Jupyter Notebook 227
cross-platform / dspatch
The Refreshingly Simple Cross-Platform C++ Dataflow / Patching / Pipelining / Graph Processing / Stream Processing / Reactive Programming Framework
cpp cross-platform data-driven data-flow dataflow dataflow-programming fbp flow-based-programming graph-processing header-only patching pipelines pipelining reactive-programming stream-processing
Language:C++ 223
azure-services-map
nnmer / azure-services-map
A visual representation and reference to Azure services
azure azure-services interconnection service-data-flow dataflow
Language:JavaScript 218