prefect

There are 2 repositories under prefect topic.

• DataTalksClub / data-engineering-zoomcamp

  Free Data Engineering course!

  data-engineeringdbtdockerkafkaprefectspark
  Language:Jupyter Notebook 22865

• PrefectHQ / prefect

  Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

  pythonworkflowdata-engineeringdata-scienceworkflow-engineprefectinfrastructureml-opsdata-opsautomationorchestrationdataobservabilitypipeline
  Language:Python 14826

• bansalkanav / Machine_Learning_and_Deep_Learning

  awscnndata-analysisdata-sciencedeep-learning-algorithmsflaskmachine-learningmlflowmlopsmongodbpandas-pythonprefectpython3sklearn-librarysqlstatisticsstreamlittutorial-codevisualizationsearch-engine
  Language:Jupyter Notebook 676

• PrefectHQ / server

  The Prefect API and backend

  prefectworkflowworkflow-engineautomationorchestration
  Language:Python 226

• Hamagistral / de-zoomcamp-ui

  🎨 UI for the Free Data Engineering Zoomcamp Course provided by DataTalksClub

  coursedata-engineeringdbtdockergoogle-cloudkafkaprefectsparkmageai
  Language:Python 205

• PrefectHQ / ui

  The home of the Prefect 1 UI

  vueprefectworkflowdata-engineeringautomationhacktoberfestprefect-uiprefect-server
  Language:Vue 176

• digitalghost-dev / premier-league

  A Data Engineering project. Repository for backend infrastructure and Streamlit app files for a Premier League Dashboard.

  pythongogoogle-cloudstreamlitdata-visualizationbigquerycloud-rundockerdata-engineerdata-pipelineprefectfirestore
  Language:Python 158

• flavienbwk / prefect-docker-compose

  A simple guide to understand Prefect and make it work with your own docker-compose configuration.

  prefectguidetutorialworkflow-managementpython3s3dockerdocker-compose
  Language:Python 156

• anna-geller / dataflow-ops

  Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate

  automationawsdatafloworchestrationprefectserverlessanalyticsanalytics-engineeringcicddatadata-engineeringdata-scienceinfrastructure-as-codeobservabilitypipelinepythondataflow-opsdata-engineering-infrastructuredata-engineering-pipeline
  Language:Python 108

• PrefectHQ / langchain-prefect

  Tools for using Langchain with Prefect

  langchainlarge-language-modelsprefectpython
  Language:Python 97

• anna-geller / prefect-deployment-patterns

  Code examples showing flow deployment to various types of infrastructure

  automationawsdatadata-engineeringdata-engineering-pipelinedata-engineering-teamdata-sciencedatafloworchestrationpipelineprefectpythonserverlessserverless-frameworkdataflow-opsdata-productsdata-engineering-infrastructure
  Language:Python 94

• PrefectHQ / prefect-aws

  Prefect integrations with AWS.

  awsprefect
  Language:Python 84

• anna-geller / prefect-dataplatform

  Example repository showing how to build a data platform with Prefect, dbt and Snowflake

  analyticsanalytics-engineeringautomationdata-engineeringdata-platformdbtpythonsnowflakesqldata-warehousingdataflowdataflow-opsorchestrationprefect
  Language:Python 81

• PrefectHQ / prefect-dbt

  Collection of Prefect integrations for working with dbt with your Prefect flows.

  dbtprefectpython
  Language:Python 81

• PrefectHQ / prefect-collection-template

  Template to quickly bootstrap a Prefect Collection

  prefectcollectioncookiecuttercrufttemplate
  Language:Python 64

• PrefectHQ / prefect-ray

  Prefect integrations with Ray

  prefectrayparallelpython
  Language:Python 63

• PrefectHQ / prefect-gcp

  Prefect integrations with Google Cloud Platform.

  prefectgcp
  Language:Python 58

• PrefectHQ / prefect-shell

  Prefect tasks and subflows for interacting with shell commands.

  prefectprefect-collectionshell
  Language:Python 53

• PrefectHQ / prefect-databricks

  Prefect integrations for interacting with Databricks.

  databricksprefectpython
  Language:Python 42

• PrefectHQ / prefect-docker

  Prefect integrations for working with Docker

  dockerprefectpython
  Language:Python 42

• PrefectHQ / prefect-airbyte

  airbyteprefect
  Language:Python 39

• anna-geller / prefect-streaming

  Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0

  automationawsdatadata-engineeringdataflowdataflow-opsecs-fargateengineeringprefectreal-timeserverlessstreamingdata-pipelinedata-sciencedata-warehouseevent-drivenmlopsmodern-data-stackorchestrationpython
  Language:Python 38

• VincenzoGalante / magic-the-gathering

  A complete pipeline to pull data from Scryfall's "Magic: The Gathering"-API, via Prefect orchestration and dbt transformation.

  card-gamemagic-the-gatheringpythonbigquerydbtgoogle-cloudlooker-studioprefectapiscryfall-apigcpgoogle-cloud-platform
  Language:Python 38

• Pocket / data-flows

  Pocket data flows orchestrated using Prefect

  cdktfprefect
  Language:Python 37

• PrefectHQ / prefect-snowflake

  Prefect integrations for orchestrating Snowflake.

  prefectpythonsnowflake
  Language:Python 37

• fugue-project / prefect-fugue

  Fugue collections for Prefect 2.0

  fugueprefect
  Language:Python 36

• Peco602 / maternal-health-risk

  Maternal Health Risk prediction MLOps pipeline

  evidentlyflaskgrafanahealth-riskmachine-learningminiomlfowmlopsprefectprometheus
  Language:Python 36

• PrefectHQ / prefect-openai

  Prefect integrations for working with OpenAI.

  openaiprefectpython
  Language:Python 36

• PrefectHQ / prefect-azure

  Prefect integrations with Microsoft Azure

  azureprefect
  Language:Python 35

• Fozan-Talat / divvy-bikeshare-de-project

  An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using dbt and finally , a dashboard to visualize the data using looker studio, the pipeline is orchestrated using prefect

  bigquerydbtdivvy-bikesgcpgcs-bucketgoogle-cloud-platformgoogle-cloud-storagelooker-studioprefectpythonterrafromdata-engineeringdata-modelingdata-pipelinedata-visualizationdata-warehouseelt-pipelineorchestrationdezoomcamp
  Language:Python 34
• real-time-technical-indicators

  Paulescu / real-time-technical-indicators

  Learn to build a modular real-time feature pipeline, so you avoid Offline-Online Feature Skew, and your deployed ML models work as expected.

  bytewaxfeature-engineeringhopsworksmlprefectreal-time
  Language:Python 33

• PrefectHQ / prefect-email

  Prefect tasks and subflows for interacting with email

  emailprefect
  Language:Python 33

• MTES-MCT / monitorfish

  🎣 Improve control and monitoring of fishing vessels activities.

  kotlindockerreactopenlayersprefectpostgiscontrolfishingfishing-vesselsmonitoring
  Language:JavaScript 32

• PrefectHQ / prefect-github

  Prefect integrations for interacting with GitHub

  collectiongithubprefectgraphqlschema
  Language:Python 31

• softrams / prefect-auth-proxy

  Prefect API Authentication/Authorization Proxy for on-premises deployments

  prefectnodejsproxyauthenticationauthorization
  Language:JavaScript 31

• basedosdados / pipelines

  🔀 Orquestrador de fluxos de captura, ingestão e tratamento de dados da BD

  prefectopendataopensourcepythonhacktoberfesthacktoberfest2022
  Language:Python 30