Exception: Failure to create client

Question

Exception: Failure to create client

stagnoman opened this issue 2 years ago · comments

Hi there,

I have always successfully used YahooFinanceApi. Today I am getting the following exception using "GetHistoricalAsync": Exception: Failure to create client. Could you kindly tell me what I can do to resolve the exception?

Many Thks for your help
Regards

LUCA

DavidS · Answer 1 · Fri Apr 29 2022 11:51:13 GMT+0800 (China Standard Time)

I suggest you try: https://github.com/dshe/YahooQuotesApi

sebduu · Answer 2 · Fri Apr 29 2022 18:03:45 GMT+0800 (China Standard Time)

Same problem for me....

sebduu · Answer 3 · Fri Apr 29 2022 18:12:47 GMT+0800 (China Standard Time)

I suggest you try: https://github.com/dshe/YahooQuotesApi

My program is in VB.net, can I use a C# Api with?

giorgiovaccarino · Answer 4 · Fri Apr 29 2022 18:26:58 GMT+0800 (China Standard Time)

"I suggest you try: https://github.com/dshe/YahooQuotesApi"

give me this problem:

YahooHistory: failure to reset HttpClient.
in YahooQuotesApi.YahooHistoryRequester.d__9.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\History\YahooHistoryRequester.cs: riga 98
in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
in System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult() in YahooQuotesApi.YahooHistoryRequester.<Reset>d__8.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\History\YahooHistoryRequester.cs: riga 67 in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in YahooQuotesApi.YahooHistoryRequester.<Request>d__7.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\History\YahooHistoryRequester.cs: riga 35 in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult()
in YahooQuotesApi.YahooHistory.d__71.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\History\YahooHistory.cs: riga 65 in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task) in System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult()
in YahooQuotesApi.ParallelProducerCache2.<Get>d__4.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\Utilities\ParallelProducerCache.cs: riga 34 in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task) in System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult()
in YahooQuotesApi.YahooHistory.d__61.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\History\YahooHistory.cs: riga 36 in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task) in System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult()
in YahooQuotesApi.YahooQuotes.<b__12_0>d.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\YahooQuotes.cs: riga 142
in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
in System.Runtime.CompilerServices.ValueTaskAwaiter.GetResult()
in System.Threading.Tasks.Parallel.<>c__501.<<ForEachAsync>b__50_0>d.MoveNext() in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in YahooQuotesApi.YahooQuotes.<AddHistoryToSecurities>d__12.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\YahooQuotes.cs: riga 157 in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in YahooQuotesApi.YahooQuotes.<GetSecuritiesAsync>d__10.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\YahooQuotes.cs: riga 93 in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult()
in YahooQuotesApi.YahooQuotes.d__9.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\YahooQuotes.cs: riga 68
in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
in System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult() in YahooQuotesApi.YahooQuotes.<GetAsync>d__7.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\YahooQuotes.cs: riga 45 in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult()
in YahooQuotesApi.YahooQuotes.d__6.MoveNext() in C:\projects\yahooquotesapi\YahooQuotesApi\YahooQuotes.cs: riga 29
in System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
in System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
in System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
in System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
in Ts.Core.MarketData.YahooConnector2.<>c__DisplayClass6_0.<b__0>d.MoveNext() in C:\Users\giorg\source\repos\TS\Ts.Core\MarketData\YahooConnector2.cs: riga 34

stagnoman · Answer 5 · Fri Apr 29 2022 23:39:12 GMT+0800 (China Standard Time)

Hi all,
thks a lot
in case YahooFinanceApi doesn't work anymore, I will switch to yfinance

DonWM · Answer 6 · Sun May 01 2022 01:11:43 GMT+0800 (China Standard Time)

I had same problem getting history data from Yahoo on both YahooFinanceAPI and YahooQuotesAPI. Did yahoo change something to break the code? Did windows have an update that broke the code?

Both work to get current quotes - just not the history.

I can get yahoo history data using python's pandas_datareader without a problem but I need it from C#,

stagnoman · Answer 7 · Sun May 01 2022 03:40:20 GMT+0800 (China Standard Time)

honestly speaking, I had no time to deeply investigate the problem yet. I believe it is protocol http client request vs yahoo server but I am not sure. (maybe ... HTTP2 vs HTTP1)
For the time being, I solved the problem using yfinance that is widely supported and used in the community. It is easy to wrap into a C# project without any performance loss.

DonWM · Answer 8 · Sun May 01 2022 12:12:18 GMT+0800 (China Standard Time)

For some reason, pandas datareader still works to get Yahoo data. And I had code to get data from Tiingo though it has data limits. I normally use Norgate data for most of what I do but need Yahoo for mutual fund data. From: stagnoman ***@***.***> Sent: Saturday, April 30, 2022 12:41 PM To: karlwancl/YahooFinanceApi ***@***.***> Cc: DonWM ***@***.***>; Comment ***@***.***> Subject: Re: [karlwancl/YahooFinanceApi] Exception: Failure to create client (Issue #52) honestly speaking, I had no time to deeply investigate the problem yet. I believe it is protocol http client request vs yahoo server but I am not sure. (maybe ... HTTP2 vs HTTP1) For the time being, I solved the problem using yfinance that is widely supported and used in the community. It is easy to wrap into a C# project without any performance loss. — Reply to this email directly, view it on GitHub <#52 (comment)> , or unsubscribe <https://github.com/notifications/unsubscribe-auth/AHQQC4NRZF6KABZNUBAUPELVHWEC5ANCNFSM5UT2IF3A> . You are receiving this because you commented. <https://github.com/notifications/beacon/AHQQC4L4CZ7OTSVRZLSW7C3VHWEC5A5CNFSM5UT2IF3KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOIJTPGLQ.gif> Message ID: ***@***.*** ***@***.***> >

fancyplot · Answer 9 · Tue May 03 2022 19:16:15 GMT+0800 (China Standard Time)

Hi, I looked into the code. The problem is that now cookies are empty in response from yahoo finance and that's why it doesn't pass the check that cookies shouldn't be empty. This is the code where it fails https://github.com/karlwancl/YahooFinanceApi/blob/master/YahooFinanceApi/YahooClientFactory.cs. I removed that check and also modified the code for retrieving a crumb. For me now it works fine. I'd push the branch but seems I don't have access rights on doing this.

stagnoman · Answer 10 · Tue May 03 2022 20:30:44 GMT+0800 (China Standard Time)

Great thks! I modified the dll removing check too, It works perfectly!

sebduu · Answer 11 · Wed May 04 2022 04:46:30 GMT+0800 (China Standard Time)

good news ! Can someone explain how to remove the check? I'm not familiar with this kind of programation.

stagnoman · Answer 12 · Wed May 04 2022 05:12:32 GMT+0800 (China Standard Time)

good news ! Can someone explain how to remove the check? I'm not familiar with this kind of programation.

hi,
1\ open your program in visual studio
2\ go in references, remove existing YahooFinanceApi.dll,
2\ unzip attached dll. Then in references: right mouse button, add reference and use YahooFinanceApi.dll unzipped
3\ rebuild solution

stagnoman · Answer 13 · Wed May 04 2022 19:37:49 GMT+0800 (China Standard Time)

good news ! Can someone explain how to remove the check? I'm not familiar with this kind of programation.

Hi pls disregard the previous dll attached. It doesn't work.
I am working on it.
I will send you late afternoon
Ciao

stagnoman · Answer 14 · Wed May 04 2022 20:52:56 GMT+0800 (China Standard Time)

good news ! Can someone explain how to remove the check? I'm not familiar with this kind of programation.

Pls replace your old YahooFinanceApi.dll with this attached below.
YahooFinanceApi.zip

Ciaoooo

DonWM · Answer 15 · Thu May 05 2022 01:56:41 GMT+0800 (China Standard Time)

Is this YahooFinanceApi.dll now ok? Will there be a normal upgrade through NuGet for this - a new version 2.1.3? There is also an a 3.0.0-beta3 but is has lots of changes and isn’t very compatible with 2.1.2. I’ve avoided using this so far since it is so different. Thanks, Don From: stagnoman ***@***.***> Sent: Wednesday, May 4, 2022 5:53 AM To: karlwancl/YahooFinanceApi ***@***.***> Cc: DonWM ***@***.***>; Comment ***@***.***> Subject: Re: [karlwancl/YahooFinanceApi] Exception: Failure to create client (Issue #52) good news ! Can someone explain how to remove the check? I'm not familiar with this kind of programation. Pls replace your old YahooFinanceApi.dll with this attached below. YahooFinanceApi.zip <https://github.com/karlwancl/YahooFinanceApi/files/8620456/YahooFinanceApi.zip> Ciaoooo — Reply to this email directly, view it on GitHub <#52 (comment)> , or unsubscribe <https://github.com/notifications/unsubscribe-auth/AHQQC4L2CZPWVLFLPXIM54LVIJXLHANCNFSM5UT2IF3A> . You are receiving this because you commented. <https://github.com/notifications/beacon/AHQQC4JDI2ERAV42MDS7KBDVIJXLHA5CNFSM5UT2IF3KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOIKME4DQ.gif> Message ID: ***@***.*** ***@***.***> >

sebduu · Answer 16 · Thu May 05 2022 02:06:41 GMT+0800 (China Standard Time)

good news ! Can someone explain how to remove the check? I'm not familiar with this kind of programation.

Pls replace your old YahooFinanceApi.dll with this attached below. YahooFinanceApi.zip

Ciaoooo

Yes it works again, thank you !!

stagnoman · Answer 17 · Thu May 05 2022 02:16:48 GMT+0800 (China Standard Time)

Is this YahooFinanceApi.dll now ok? Will there be a normal upgrade through NuGet for this - a new version 2.1.3? There is also an a 3.0.0-beta3 but is has lots of changes and isn’t very compatible with 2.1.2. I’ve avoided using this so far since it is so different. Thanks, Don From: stagnoman @.> Sent: Wednesday, May 4, 2022 5:53 AM To: karlwancl/YahooFinanceApi @.> Cc: DonWM @.>; Comment @.> Subject: Re: [karlwancl/YahooFinanceApi] Exception: Failure to create client (Issue #52) good news ! Can someone explain how to remove the check? I'm not familiar with this kind of programation. Pls replace your old YahooFinanceApi.dll with this attached below. YahooFinanceApi.zip https://github.com/karlwancl/YahooFinanceApi/files/8620456/YahooFinanceApi.zip Ciaoooo — Reply to this email directly, view it on GitHub <#52 (comment)> , or unsubscribe https://github.com/notifications/unsubscribe-auth/AHQQC4L2CZPWVLFLPXIM54LVIJXLHANCNFSM5UT2IF3A . You are receiving this because you commented. https://github.com/notifications/beacon/AHQQC4JDI2ERAV42MDS7KBDVIJXLHA5CNFSM5UT2IF3KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOIKME4DQ.gif Message ID: @.*** @.***> >

Is this YahooFinanceApi.dll now ok? Yes, it works.
Will there be a normal upgrade through NuGet for this - a new version 2.1.3? No, in Nuget there is the old one. You have to replace the old dll with mine attached above manually in VS, build the program then.

There is also an a 3.0.0-beta3 but is has lots of changes and isn’t very compatible with 2.1.2. I’ve avoided using this so far since it is so different. Dll above is still net 2.0

emrahsumer · Answer 18 · Sat May 07 2022 20:35:43 GMT+0800 (China Standard Time)

For me it does'nt work after 5-6 querry it responds with 401 error

stagnoman · Answer 19 · Sat May 07 2022 22:21:42 GMT+0800 (China Standard Time)

The 401 error was also happening with old dll. Yahoo has implemented some kind of time out defense against sever overloading and potential ddos attacks by tracking the number / frequency of requests from a specific ip address.
A 401 error code means the user is unauthorised.

To avoid the error, the method must be synchronous. I use a Thread.Sleep pause of 500 ms,/1s between requests.
Avoid any parallelism.

emrahsumer · Answer 20 · Fri May 13 2022 02:22:21 GMT+0800 (China Standard Time)

Using synchronous calls and 1 second delay has solved the problem.

brutm · Answer 21 · Fri May 13 2022 23:42:58 GMT+0800 (China Standard Time)

@lucastagnitta thanks for your dll but i have a problem. Assembly errors with Flurl

stagnoman · Answer 22 · Sat May 14 2022 04:59:37 GMT+0800 (China Standard Time)

@lucastagnitta thanks for your dll but i have a problem. Assembly errors with Flurl

In the past, I got some troubles as well, I am using the following version, installed manually
Flurl 2.5.2
Flurl.Http 2.1.0

DavidS · Answer 23 · Sun May 15 2022 18:03:28 GMT+0800 (China Standard Time)

I suggest you try the new version (5.1): https://github.com/dshe/YahooQuotesApi

kyi87 · Answer 24 · Tue May 17 2022 05:56:01 GMT+0800 (China Standard Time)

Hi, I looked into the code. The problem is that now cookies are empty in response from yahoo finance and that's why it doesn't pass the check that cookies shouldn't be empty. This is the code where it fails https://github.com/karlwancl/YahooFinanceApi/blob/master/YahooFinanceApi/YahooClientFactory.cs. I removed that check and also modified the code for retrieving a crumb. For me now it works fine. I'd push the branch but seems I don't have access rights on doing this.

Could you please show your exact changes in "YahooClientFactory.cs"? Would be very helpful. Thank you!

fancyplot · Answer 25 · Wed May 18 2022 01:00:55 GMT+0800 (China Standard Time)

YahooFinanceApi.zip
This are my changes that I made to the code in master branch. Just replace files in original solution with files from archive and than rebuild.

kyi87 · Answer 26 · Tue May 24 2022 22:25:19 GMT+0800 (China Standard Time)

YahooFinanceApi.zip This are my changes that I made to the code in master branch. Just replace files in original solution with files from archive and than rebuild.

Thanks for the Code. Now i experience errors after the change and after several requests:

"Call failed with status code 401 (Unauthorized)"

Do you experienced the same problem?

stagnoman · Answer 27 · Tue May 24 2022 22:29:18 GMT+0800 (China Standard Time)

YahooFinanceApi.zip This are my changes that I made to the code in master branch. Just replace files in original solution with files from archive and than rebuild.

Thanks for the Code. Now i experience errors after the change and after several requests:

"Call failed with status code 401 (Unauthorized)"

Do you experienced the same problem?

yes, the 401 error was also happening with old dll. Yahoo has implemented some kind of time out defense against sever overloading and potential ddos attacks by tracking the number / frequency of requests from a specific ip address.
A 401 error code means the user is unauthorised.

To avoid the error, the method must be synchronous. I use a Thread.Sleep pause of 500 ms,/1s between requests.
Avoid any parallelism.