jayhack / prefect

The easiest way to coordinate your dataflow

Home Page:https://prefect.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Option to log progess and duration estimations

jayhack opened this issue · comments

First check

  • I added a descriptive title to this issue.
  • I used the GitHub search to find a similar request and didn't find it.
  • I searched the Prefect documentation for this feature.

Prefect Version

2.x

Describe the current behavior

Some long running tasks have a clear estimation of their progess as well as their remaining duration. Curretnly the only way to track this is to conntect the logger to say tqdm. This tends to spam the logs, as long as one doesn't throttle the logging.

Describe the proposed behavior

It would be great if the progess could be logged to prefect so the gui could show how long the current task will still take.

@task
def foo():
    logger =  get_run_progress_logger()
    for i in logger(range(100), total=100):
        sleep(1)

Example Use

No response

Additional context

No response