httpcore dependency issue with httpx 0.25.0 [AttributeError: 'AsyncLock' object has no attribute '_anyio_lock']
chamikabm opened this issue · comments
The starting point for issues should usually be a discussion...
I've use the following requirements with my project:
requirements.txt
aiohttp==3.8.1 aiohttp-cors==0.7.0 aiohttp-graphql==1.1.0 aiopg==1.3.3 aioredis==2.0.1 aioredis-cluster==2.5.0 aiosignal==1.2.0 alembic==1.7.5 aniso8601==7.0.0 area==1.1.1 asgiref==3.2.7 asn1crypto==1.5.1 async-timeout==4.0.2 asyncstdlib==3.10.3 attrs==19.3.0 autobahn==20.12.3 Automat==20.2.0 bcrypt==3.2.2 boto3==1.20.46 botocore==1.23.46 cffi==1.15.1 channels==2.4.0 chardet==3.0.4 charset-normalizer==2.0.11 colorama==0.4.4 constantly==15.1.0 cryptography==39.0.1 daphne==2.5.0 decorator==5.1.1 deeputil==0.2.10 Deprecated==1.2.13 Django==4.1.9 docutils==0.18.1 frozenlist==1.3.0 GeoAlchemy2==0.13.2 geojson==3.0.1 graphene==2.1.9 graphene-django==2.15.0 graphene-pynamodb==2.3.0 graphene-sqlalchemy==2.2.2 graphene-sqlalchemy-filter==1.13.0 graphene-subscriptions==1.0.2 graphql-core==2.3.2 graphql-relay==2.0.1 graphql-server-core==1.2.0 graphql-ws==0.3.1 greenlet==1.1.2 gunicorn==20.1.0 h11~=0.14.0 h2==3.2.0 h3==3.7.3 hpack==3.0.0 http3==0.6.7 hyperframe==5.2.0 hyperlink==21.0.0 incremental==21.3.0 jmespath==0.10.0 jwcrypto==1.4 Mako==1.2.2 MarkupSafe==2.0.1 multidict==4.7.6 numpy==1.22.2 packaging==21.3 pandas==1.3.4 paramiko==2.11.0 prometheus-client==0.13.1 promise==2.3 psycopg2-binary==2.9.1 pyasn1==0.4.8 pyasn1-modules==0.2.8 pycparser==2.21 PyHamcrest==2.0.3 PyJWT==2.4.0 PyNaCl==1.5.0 pynamodb==5.0.0 pyOpenSSL==23.0.0 pyparsing==3.0.7 pytest-runner==5.3.1 python-dateutil==2.8.2 python-editor==1.0.4 pytz==2021.3 PyYAML==6.0 redis==4.5.5 redshift-connector==2.0.907 repoze.lru==0.7 requests==2.27.1 requests-async==0.6.2 rfc3986==1.5.0 Rx==1.6.1 Rx3==3.0.1 s3transfer==0.5.0 scipy==1.8.0 scramp==1.4.1 service-identity==21.1.0 Shapely==1.8.0 singledispatch==3.7.0 six==1.16.0 SQLAlchemy==1.4.44 SQLAlchemy-bulk-lazy-loader==0.10.0 sqlalchemy-redshift==0.8.11 sqlparse==0.4.4 sshtunnel==0.4.0 structlog==21.5.0 text-unidecode==1.3 trafaret==2.1.0 trafaret-config==2.0.2 Twisted==22.4.0 txaio==21.2.1 typing==3.7.4.3 typing_extensions==4.0.1 ujson==5.4.0 Unidecode==1.3.2 urllib3==1.26.17 Werkzeug==2.2.3 wrapt==1.13.3 yarl==1.7.2 zope.interface==5.4.0 pytest~=5.4.1 httpx==0.25.0 sniffio==1.3.0 certifi==2023.7.22 idna==3.4 httpcore==0.18.0 anyio>=3.0,<5.0
Relevant Code:
`
async def async_http_request(self, http_method: Callable, *args, **kwargs) -> any:
"""
Generic method for async HTTP calls, includes error handling.
Parameters
----------
http_method: Callable
HTTP function, e.g., httpx.get or httpx.post.
args:
Any positional arguments for the async HTTP function.
kwargs:
Any keyword arguments for the async HTTP function. Optionally provide
timeout argument, defaults to 10 seconds.
Returns
-------
any
Usually a response type object from the provided async HTTP function.
"""
if 'timeout' not in kwargs:
kwargs['timeout'] = 10
try:
async with httpx.AsyncClient() as client:
if http_method is httpx.get:
httpx_client = client.get
elif http_method is httpx.post:
httpx_client = client.post
else:
raise ValueError("Unsupported HTTP method")
resp = await httpx_client(*args, **kwargs)
except httpx.TimeoutException:
raise GraphQLError(
f"Timeout while connecting to '{kwargs.get('url')}'.",
extensions=GraphQLException.REQUEST_TIMED_OUT.value
)
except self.HTTPX_EXCEPTIONS:
raise GraphQLError(
f"The '{kwargs.get('url')}' endpoint could not be reached.",
extensions=GraphQLException.REQUEST_FAILED.value
)
if resp.status_code != 200:
raise GraphQLError(
resp.text, extensions=GraphQLException.REQUEST_FAILED.value
)
return resp
async def async_get_request(self, url: str, params=None, timeout=10, **kwargs):
"""Sends an async GET request and returns response if successful."""
return await self.async_http_request(httpx.get, url=url, params=params, timeout=timeout, **kwargs)
async def async_post_request(self, url: str, data_payload=None, json_payload=None, timeout=10, **kwargs):
"""Sends an async POST request and returns response if successful."""
return await self.async_http_request(httpx.post, url=url, data=data_payload, json=json_payload, timeout=timeout,
**kwargs)`
This happens only when we use the dockerized version of the app, locally with PyCharm it works without an issue. It seems like with docker it is unable to load anyio package through httpcore.
Error:
graphql-async-test-service | ERROR:graphql_service.components.location_reference_service.queries.location_reference_service:>>> THREAD 281473214135600 - PID 22 - ERROR: 'LrsQuery.resolve_getLocationReferenceDataForGeodetic graphql-async-test-service | Traceback (most recent call last): graphql-async-test-service | File "/app/graphql_service/manager_libraries/base.py", line 119, in async_http_request graphql-async-test-service | resp = await httpx_client(*args, **kwargs) graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1848, in post graphql-async-test-service | return await self.request( graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1530, in request graphql-async-test-service | return await self.send(request, auth=auth, follow_redirects=follow_redirects) graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1617, in send graphql-async-test-service | response = await self._send_handling_auth( graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1645, in _send_handling_auth graphql-async-test-service | response = await self._send_handling_redirects( graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1682, in _send_handling_redirects graphql-async-test-service | response = await self._send_single_request(request) graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1719, in _send_single_request graphql-async-test-service | response = await transport.handle_async_request(request) graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpx/_transports/default.py", line 366, in handle_async_request graphql-async-test-service | resp = await self._pool.handle_async_request(req) graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpcore/_async/connection_pool.py", line 224, in handle_async_request graphql-async-test-service | async with self._pool_lock: graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpcore/_synchronization.py", line 48, in __aenter__ graphql-async-test-service | self.setup() graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpcore/_synchronization.py", line 41, in setup graphql-async-test-service | raise RuntimeError( graphql-async-test-service | RuntimeError: Running under asyncio requires the 'anyio' package to be installed. graphql-async-test-service | graphql-async-test-service | During handling of the above exception, another exception occurred: graphql-async-test-service | graphql-async-test-service | Traceback (most recent call last): graphql-async-test-service | File "/app/graphql_service/utilities/threading_decorators.py", line 127, in add_traceback graphql-async-test-service | return await coro(*args, **kwargs) graphql-async-test-service | File "/app/graphql_service/components/location_reference_service/queries/location_reference_service.py", line 75, in resolve_getLocationReferenceDataForGeodetic graphql-async-test-service | return await location_reference_service_manager.get_lrs_data( graphql-async-test-service | File "/app/graphql_service/manager_libraries/location_reference_service.py", line 71, in get_lrs_data graphql-async-test-service | resp = await self.async_post_request(url=self.get_lrs_data_endpoint, json_payload=payload, timeout=30) graphql-async-test-service | File "/app/graphql_service/manager_libraries/base.py", line 144, in async_post_request graphql-async-test-service | return await self.async_http_request(httpx.post, url=url, data=data_payload, json=json_payload, timeout=timeout, graphql-async-test-service | File "/app/graphql_service/manager_libraries/base.py", line 119, in async_http_request graphql-async-test-service | resp = await httpx_client(*args, **kwargs) graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 2003, in __aexit__ graphql-async-test-service | await self._transport.__aexit__(exc_type, exc_value, traceback) graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpx/_transports/default.py", line 345, in __aexit__ graphql-async-test-service | await self._pool.__aexit__(exc_type, exc_value, traceback) graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpcore/_async/connection_pool.py", line 327, in __aexit__ graphql-async-test-service | await self.aclose() graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpcore/_async/connection_pool.py", line 312, in aclose graphql-async-test-service | async with self._pool_lock: graphql-async-test-service | File "/usr/local/lib/python3.9/site-packages/httpcore/_synchronization.py", line 53, in __aenter__ graphql-async-test-service | await self._anyio_lock.acquire() graphql-async-test-service | AttributeError: 'AsyncLock' object has no attribute '_anyio_lock'
If needed, I can provide the dockerized application to test.