Giters

Azure / azure-sdk-for-python

This repository is for active development of the Azure SDK for Python. For consumers of the SDK we recommend visiting our public developer docs at https://learn.microsoft.com/python/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-python.

Repository from Github https://github.comAzure/azure-sdk-for-pythonRepository from Github https://github.comAzure/azure-sdk-for-python

Allow for timeout via SDK/API when experiencing long response times

MatthewTafazoli opened this issue · comments

commented

Is your feature request related to a problem? Please describe.
When issuing requests to Azure's Computer Vision, occasionally there is a lot of latency in the response.

Describe the solution you'd like
In the case of long response times, we would like to use the SDK to issue a timeout for the request.

Describe alternatives you've considered
Unsure about other possible solutions regarding this issue

Additional context
I have attached graphs of both our VisionAPI Latency and Computer Vision Latency at an instance where the Latency spikes ( To clarify: the graphs shifts as time passes, so the spike being located at the beginning of the graph is not associated with a cold start)

The following graphs were generated via Datadog for reference

Image

Also, I should note that we are executing the requests as laid out in the following documentaiton:
https://learn.microsoft.com/ja-jp/azure/ai-services/computer-vision/how-to/call-analyze-image-40?pivots=programming-language-python

commented

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @ryogok @tburns10 @TFR258.

commented

Hello! I was just wondering if there was any feedback or movement on this topic? I know everyone is very busy, so I understand it might be hard to get to this