Bot framework REST API calls getting timeouts
penguinsource opened this issue · comments
Describe the bug
I am sending POST requests to https://smba.trafficmanager.net/amer
and receiving timeouts on my remote server (google cloud, app engine) - the same is not happening locally when using ngrok.
Nothing has changed on our code's behalf and it all started failing yesterday (June 14th).
Expected behavior
Our platform proactively sends messages to an existing conversation (through the REST url) and then continues the conversation through a bot-builder
implementation.
Screenshots
![image](https://private-user-images.githubusercontent.com/2596623/246168604-68e4e28e-7ec6-40b3-85a8-858c8860ff47.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTI5NDMyMjAsIm5iZiI6MTcxMjk0MjkyMCwicGF0aCI6Ii8yNTk2NjIzLzI0NjE2ODYwNC02OGU0ZTI4ZS03ZWM2LTQwYjMtODVhOC04NThjODg2MGZmNDcucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDQxMiUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA0MTJUMTcyODQwWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9Njk3NzJiYTRiNWYxYmVjMDA0MjNkNjMxMGM5OGU4MGQ4NTAzM2QyMmViMWM2MmQ1YmFiZThmN2ZkYWI2MjIyNSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.JsWCHB3KWboY8NxSC9llsAa87IV9tXkzQ1fdPu7GPhg)
![image](https://private-user-images.githubusercontent.com/2596623/246168651-8dbe0fde-9d61-4155-8ed7-7c77a64fe7d0.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTI5NDMyMjAsIm5iZiI6MTcxMjk0MjkyMCwicGF0aCI6Ii8yNTk2NjIzLzI0NjE2ODY1MS04ZGJlMGZkZS05ZDYxLTQxNTUtOGVkNy03Yzc3YTY0ZmU3ZDAucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDQxMiUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA0MTJUMTcyODQwWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9ZGZhZDIwYTA0NGFjZTk1M2FlODZkNWVlNTc1YTA4NWJkYWIyMDhkY2MyNTBjNTkzODM0ZWI4M2RhZmU0YTE3NiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.KuRZo2iJofb0_zB2Rz5ftlDR9kOqJjhZYx8YPd3CSj0)
Additional context
- Issue does not occur in ngrok, but it does occur on app engine instances
- Bot has been working fine for the past 2 years, but all of a sudden, something must have happened and it's now getting all these timeouts
error: FetchError: request to https://smba.trafficmanager.net/amer/v3/conversations/a:17cILmBogFKvwOhSb3Qb8s8s8Mvi8-v28V74WaXT2do5qpcvX2iWx7u9TIFKgjUZCbC2Sbuy3LltGjgAxKHPhYDjwOaEarjchGEhQOtN2Rax4hMDG8YjSjl_rpBR-2yaD/activities/ failed, reason: connect ETIMEDOUT 52.114.142.186:443
at ClientRequest.<anonymous> (/workspace/node_modules/node-fetch/lib/index.js:1491:11)
at ClientRequest.emit (events.js:400:28)
at TLSSocket.socketErrorListener (_http_client.js:475:9)
at TLSSocket.emit (events.js:400:28)
at emitErrorNT (internal/streams/destroy.js:106:8)
at emitErrorCloseNT (internal/streams/destroy.js:74:3)
at processTicksAndRejections (internal/process/task_queues.js:82:21) {
type: 'system',
errno: 'ETIMEDOUT',
code: 'ETIMEDOUT'
},
Hi @penguinsource What channel(s) is this bot using? Teams, Direct Line, etc?