dataflow-ops

There are 2 repositories under dataflow-ops topic.

• anna-geller / dataflow-ops

  Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate

  analyticsanalytics-engineeringautomationawscicddatadata-engineeringdata-engineering-infrastructuredata-engineering-pipelinedata-sciencedataflowdataflow-opsinfrastructure-as-codeobservabilityorchestrationpipelineprefectpythonserverless
  Language:Python 108

• anna-geller / prefect-deployment-patterns

  Code examples showing flow deployment to various types of infrastructure

  automationawsdatadata-engineeringdata-engineering-infrastructuredata-engineering-pipelinedata-engineering-teamdata-productsdata-sciencedataflowdataflow-opsorchestrationpipelineprefectpythonserverlessserverless-framework
  Language:Python 94

• anna-geller / prefect-dataplatform

  Example repository showing how to build a data platform with Prefect, dbt and Snowflake

  analyticsanalytics-engineeringautomationdata-engineeringdata-platformdbtpythonsnowflakesqldata-warehousingdataflowdataflow-opsorchestrationprefect
  Language:Python 81

• anna-geller / prefect-streaming

  Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0

  automationawsdatadata-engineeringdataflowdataflow-opsecs-fargateengineeringprefectreal-timeserverlessstreamingdata-pipelinedata-sciencedata-warehouseevent-drivenmlopsmodern-data-stackorchestrationpython
  Language:Python 38

• anna-geller / prefect-aws-lambda

  Deploy a Prefect flow to serverless AWS Lambda function

  awsaws-lambdadata-engineeringdata-engineering-infrastructuredata-engineering-pipelinedataflowdataflow-opsevent-drivenevent-driven-architecturelambdapythonserverlessserverless-frameworkautomationcicddata-sciencepipeline
  Language:Python 34

• anna-geller / dataflow-ops-aws-eks

  Project demonstrating how to automate Prefect 2.0 deployments to AWS EKS

  automationawsdataekseks-clustereksctlkarpenterkuberneteskubernetes-deploymentkubernetes-setuppythonserverlesscicddata-engineeringdata-engineering-pipelinedata-productsdataflowdataflow-opsdata-engineering-infrastructure
  Language:Python 8

• anna-geller / prefect-getting-started

  Get started with Prefect by scheduling your Prefect flows with GitHub Actions

  analytics-engineeringautomationcicddatadata-engineeringdata-engineering-infrastructuredata-engineering-pipelinedata-pipelinedata-sciencedataflowdataflow-opsgithub-actionsorchestrationpipelineprefectpythonschedulingserverless
  Language:Python 7