Giters
allegro
/
bigflow
A Python framework for data processing on GCP.
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
115
Watchers:
10
Issues:
86
Forks:
23
allegro/bigflow Issues
`SpawnIsolateMixin` makes underlying errors not visible in traceback
Updated
5 months ago
Generating Airflow 2.0 compatible DAGs
Closed
2 years ago
Comments count
2
Moving example workflows from the e2e tutorial to the scaffold
Closed
2 years ago
Comments count
1
Publish docker images via registry (no real images inside .image)
Closed
2 years ago
Comments count
2
Propagate 'bf_env' to beam workers
Closed
2 years ago
Comments count
2
Add namespace to generated dag files (reuse gcp project)
Updated
2 years ago
Docker image check
Closed
2 years ago
Comments count
2
Pass custom ad-hoc options to a workflow
Updated
2 years ago
Comments count
1
Fail 'bigflow build-dags' when BF can't import module
Updated
3 years ago
Comments count
1
Safe DAGs generation and deployment
Updated
3 years ago
Check Dataflow FlexRs performance/costs
Updated
3 years ago
Switch to 'pytest' as a runner for unit tests
Updated
3 years ago
BeamJob timeout validation
Updated
3 years ago
Handling BeamJob timeout
Updated
3 years ago
Airflow operator to run bigflow jobs (via bf-specific Docker image)
Updated
3 years ago
Python installation guide
Updated
3 years ago
Comments count
1
UTC datetime as default runtime
Updated
3 years ago
Resolving internal_tables to full tables references
Updated
3 years ago
BeamJob DirectRunner error
Closed
3 years ago
Comments count
1
Fix pyarrow / obsolete beam problem
Closed
3 years ago
Errors by migrating to new version 1.1.3
Closed
3 years ago
Comments count
1
Pass dict instead of 'PipelineOptions' to 'BeamJob'
Closed
3 years ago
Comments count
1
BeamJob can't infer project path when running test (1.3.0.dev6)
Closed
3 years ago
Comments count
1
BeamJob overrides pipeline options (1.3.0.dev6)
Closed
3 years ago
bf install
Updated
3 years ago
Comments count
1
Broken bf deploy-image (>=1.3.0.dev8)
Closed
3 years ago
More granular build logs
Updated
3 years ago
Unconditionally enable logging/monitoring for all workflows
Updated
3 years ago
Move 'walk_modules' out of 'bigflow.cli' module
Updated
3 years ago
Metadata storage for jobs/workflows
Updated
3 years ago
Non-deterministic get_version function
Closed
3 years ago
Comments count
1
Moving Cloud Composer to Artifact Registry
Closed
3 years ago
Comments count
1
Dataflow environment - versions
Closed
3 years ago
Speedup docker image generation
Closed
3 years ago
public_api decorator and initial public api setup
Closed
3 years ago
DAGs ttl
Updated
3 years ago
Add information about beam temp/staging ttl
Updated
3 years ago
Comments count
1
Create EndToEndTest class
Updated
3 years ago
Comments count
1
Handle "no workflows found" case
Updated
3 years ago
Many envs tutorial
Updated
3 years ago
Deprecation policy
Updated
3 years ago
Add more labels to metrics
Updated
3 years ago
Using dev pypi for testing purposes
Updated
3 years ago
Create DatasetManager based on generic `bigflow.Config`
Updated
3 years ago
Comments count
1
Ask about instructions for migration to new version
Updated
3 years ago
Allow to pass all arguments/options to scaffold via command line
Updated
3 years ago
Broken retry_count and delay
Closed
3 years ago
Consider using `timdelta` for all duration-like parameters
Updated
3 years ago
Move requirements out of `resources` directory
Updated
3 years ago
Better Docker integration
Updated
3 years ago
Previous
Next