dags

There are 0 repository under dags topic.

• ajbosco / dag-factory

  Dynamically generate Apache Airflow DAGs from YAML configuration files

  airflowapache-airflowpythondags
  Language:Python 1081

• DAGWorks-Inc / burr

  Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.

  burrdagsgraphsllmopsllmsmlopspersistent-data-structurestate-machinestate-managementvisibilityaichatbot-frameworkgenerative-ai
  Language:Python 463

• astronomer / astro-sdk

  Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

  pythonsqlpandasairflowsqlitebigquerypostgressnowflakegcss3etleltdagsworkflowsdata-analysisdata-scienceapache-airflow
  Language:Python 323

• kaxil / airflowctl

  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

  airflowapache-airflowclidagspython
  Language:Python 170

• kevinsbello / dagma

  A Python 3 package for learning Bayesian Networks (DAGs) from data. Official implementation of the paper "DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterization"

  structure-learningcausal-discoverygraphical-modelsneurips-2022bayesian-networksdags
  Language:Python 76
• causact

  flyaflya / causact

  causact: R package to accelerate computational Bayesian inference workflows in R through interactive visualization of models and their output.

  bayesian-inferencedagsposterior-probabilityprobabilistic-graphical-modelsprobabilistic-programmingrstats-package
  Language:R 42

• integrated-inferences / CausalQueries

  Bayesian inference from binary causal models

  bayesstandagscausalmixedmethods
  Language:R 24

• astronomer / astro-provider-databricks

  Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows

  airflowairflow-dagsapacheapache-airflowdagsdatabricksdatabricks-notebookspythonworkflows
  Language:Python 20

• andrewheiss / closing-backdoors-dags

  Use regression, inverse probability weighting, and matching to close confounding backdoors and find causation in observational data

  dagscausal-inferenceinverse-probability-weightsmatchingdo-calculus
  12

• chayansraj / Python-ETL-pipeline-using-Airflow-on-AWS

  This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow orchestration tool on AWS EC2 instance.

  airflowairflow-dagautomationawsaws-ec2dagsdata-engineeringetl-pipelinepython3ssh-servervirtual-machinevisual-studio-codeartificial-intelligencedatadatabaseeltreverse-etltransformation
  Language:Python 12

• badal-io / gcp-airflow-foundations

  Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse

  airflowbigqueryetl-pipelineapache-airflowdagsdata-pipelinedata-engineering
  Language:Python 11

• theeye-io-team / theeye-supervisor

  TheEye supervisor

  airflowdagsgraphrest-apiworkflow-automationworkflow-enginedags-automation
  Language:JavaScript 11

• AnthonyByansi / Airflow-Data-Pipeline-Automation

  Automate your data pipelines using Apache Airflow with this ready-to-use DAG for data integration, ETL and workflow automation.

  airflowairflow-dagsapache-airflowdagsdata-engineeringdata-integrationdata-pipelinesdata-warehouseetlpython
  Language:Python 8
• udacity-dend-capstone

  kudeh / udacity-dend-capstone

  Udacity Data Engineering Nanodegree Capstone Project

  udacityudacity-nanodegreeudacity-data-engineer-nanodegreeudacity-capstonepsycopg2pandaspysparkairflowjupyter-notebookdags
  Language:Jupyter Notebook 8

• ThomWright / balamb

  🌱 Concurrently run a set of dependent, asynchronous tasks with type-safe dependencies

  dataseedingseeddagdagsdidependency-injectiondata-seedingconcurrenttasks
  Language:TypeScript 8

• gzilles / airflow_etl

  Projeto final de conclusão do Bootcamp IGTI 2021/1

  airflowdata-lakedagsdockermysqletl
  Language:Python 6

• Joffreybvn / airflow-dag-builder

  Airflow plugin to create/edit Dags via drag-and-drop on a convenient UI

  airflowairflow-pluginairflow-pluginsdagsdrag-and-dropui
  Language:JavaScript 6

• badubizzle / ex_dag

  Experimental implementation of Airflow DAGs in Elixir

  elixirdagsairflow
  Language:Elixir 5

• Elkinmt19 / airflow-master

  This a repo that was created to learn more about Airflow and develop awesome data engineering projects. 🚀🚀

  airflowdagsdata-engineeringdata-pipelinesorchestrationml-pipelinesdockerpython
  Language:Python 5

• adaszko / roaring-graphs

  Graph data structure backed by roaring bitmaps

  dagdirected-acyclic-graphgraphsproptestrandom-dagrandom-treedags
  Language:Rust 4

• remlapmot / mrdags

  Code to draw DAG and SWIG figures for Mendelian randomization studies

  dagsdirected-acyclic-graphmendelian-randomisationmendelian-randomizationmendelianrandomisationrsingle-world-intervention-graphswig
  Language:RMarkdown 4

• ScopeLift / kaspa-wallet

  👝 A web wallet for the Kaspa blockchain network

  kaspadagsblockchaincryptocryptocurrency
  Language:JavaScript 4

• Polidea / dag-checks

  The dag-checks consist of checks that can help you in maintaining your Apache Airflow instance.

  airflowci-cddagsdebuggingmaintenance
  Language:Python 3

• ischenkx / kantoku

  Distributed Computations Platform

  computationsdistributedpipelinedagskantoku
  Language:Go 2

• rohan472000 / covid-data-fetch-bigquery-airflow

  This repo consist of codes to fetch covid data and store them into bigquery, scheduled by apache-airflow.

  automationbigquerycicdcovid-19dagsgcpgithub-actionsgoogle-cloudpython
  Language:Python 2

• 3amory99 / Podcust-Summary-Data-Pipeline-Using-Airflow

  Creating a data pipeline using Airflow. The pipeline will download podcast episodes and automatically transcribe them using speech recognition. We'll store our results in a SQLite database that we can easily query.

  airflowdagssqlite3
  Language:Python 1

• DigitalCausalityLab / d-separation

  Repo for the case study: d-separation

  case-studycausal-inferencecausalityd-separationdagsdata-productdigital-causality-lab
  Language:HTML 1

• enigma0503 / bikewise

  apache-airflowpysparkhdfspython3big-datadags
  Language:Python 1

• judeleonard / Data-Engineering

  This is a repo to keep track of all my projects related to data engineering

  airflow-dockeramazon-s3apache-airflowazure-storagedockerkafkapostgresqlpysparksnowflakesqldagsdata-warehousedbtbi-dashboards
  Language:Python 1

• katarzynajanicka / the-complete-hands-on-course-to-master-apache-airflow

  Apache Airflow exercises :rocket: https://www.udemy.com/course/the-complete-hands-on-course-to-master-apache-airflow/

  dagspythonbatch-processingdata-pipelinesapache-airflow
  Language:Python 1

• KirillZhul / de-project-sprint-6

  Vertica, Data Vault

  verticaairflowdagssqlpythondatavault
  Language:Python 1

• muhesh-kumar / curriculum-schedular

  An automated Curriculum Schedular which prepares a schedule as per your needs. A great tool for any self-learning student!

  dagsnextjsreactjstailwindcsstypescriptgraphical-user-interfacegraphsreact-flowtopological-sortzustand
  Language:TypeScript 1

• nick-roberson / comp-blocks

  Computation as Composable Blocks, can be extended to run on remote pipeline frameworks if necessary.

  airflowairflow-dagsdagspython
  Language:Python 1

• omar-elmaria / airflow_at_delivery_hero

  This repo contains a readme.md file that explains how to use Airflow at Delivery Hero

  airflowautomationdagsorchestrationpythondelivery-heroetl-pipelineinstallation-guide
  1

• robitalec / statistical-rethinking-colearning-2024

  :memo: Statistical Rethinking colearning 2024

  bayesianbrmscausal-inferencedagsrstanstatistical-rethinking
  Language:R 1

• thaddeuscleo / airflow-docker-compose

  repository is designed to facilitate the development of Apache Airflow DAGs

  airflowapache-airflowdagsdockerdocker-composemakefile
  Language:Makefile 1