jina-ai / langchain-serve

⚡ Langchain apps in production using Jina & FastAPI

Home Page:https://cloud.jina.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

lc-serve deploy local - Doesn't work on Windows 10

prek-prek opened this issue · comments

commented

I've tried deploying an api.py app on Windows 10 and keep getting the same error. Script works fine on WSL through PowerShell.

Here are my logs:

(myenv) C:\Users\Użytkownik\Desktop\chatpdf>lc-serve deploy local api
⠙ Waiting gateway... ---------------------------------------- 0/1 0:00:04DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html (raised from C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\hubble\executor\requirements.py:7)
DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages (raised from C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\pkg_resources\__init__.py:2871)
DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages (raised from C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\pkg_resources\__init__.py:2871)
DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages (raised from C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\pkg_resources\__init__.py:2350)
⠹ Waiting gateway... ---------------------------------------- 0/1 0:00:04DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('mpl_toolkits')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages (raised from C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\pkg_resources\__init__.py:2871)
DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages (raised from C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\pkg_resources\__init__.py:2871)
⠹ Waiting gateway... ---------------------------------------- 0/1 0:00:08ERROR  gateway/rep-0@13296 FileNotFoundError('can not find                                           [08/03/23 19:12:18]
       C:\\Users\\Użytkownik\\AppData\\Local\\Programs\\Python\\Python39\\\nlib\\site-packages\\lcs…
       during 'GatewayRuntime' initialization
        add "--quiet-error" to suppress the exception details
       Traceback (most recent call last):
         File
       "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\serve\exe…
       line 140, in run
           runtime = AsyncNewLoopRuntime(
         File
       "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\serve\run…
       line 90, in __init__
           self._loop.run_until_complete(self.async_setup())
         File
       "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\nest_asyncio.p…
       line 99, in run_until_complete
           return f.result()
         File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\asyncio\futures.py",
       line 201, in result
           raise self._exception
         File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\asyncio\tasks.py",
       line 256, in __step
           result = coro.send(None)
         File
       "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\serve\run…
       line 270, in async_setup
           self.server = self._get_server()
         File
       "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\serve\run…
       line 168, in _get_server
           server = BaseGateway.load_config(
         File
       "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\jaml\__in…
       line 695, in load_config
           stream, s_path = parse_config_source(
         File
       "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\jaml\help…
       line 191, in parse_config_source
           PathImporter.add_modules(module_name)
         File
       "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\importer.…
       line 161, in add_modules
           _path_import(complete_path(m))
         File
       "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\jaml\help…
       line 229, in complete_path
           raise FileNotFoundError(f'can not find {path}')
       FileNotFoundError: can not find C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\
       lib\site-packages\lcserve\servinggateway_config
ERROR  Flow@24540 An exception occurred:                                                            [08/03/23 19:12:18]
ERROR  Flow@24540 Flow is aborted due to ['gateway'] can not be started.
Traceback (most recent call last):
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\Scripts\lc-serve.exe\__main__.py", line 7, in <module>
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\click\core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\lcserve\__main__.py", line 660, in local
    serve_locally(module_str=module_str, fastapi_app_str=app, port=port, env=env)
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\lcserve\__main__.py", line 51, in serve_locally
    with Flow.load_config(f_yaml) as f:
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\orchestrate\orchestrator.py", line 14, in __enter__
    return self.start()
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\orchestrate\flow\builder.py", line 33, in arg_wrapper
    return func(self, *args, **kwargs)
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\orchestrate\flow\base.py", line 1843, in start
    self._wait_until_all_ready()
  File "C:\Users\Użytkownik\AppData\Local\Programs\Python\Python39\lib\site-packages\jina\orchestrate\flow\base.py", line 2009, in _wait_until_all_ready
    raise RuntimeFailToStart
jina.excepts.RuntimeFailToStart

This is not windows specific. I also have the same error using Ubuntu 22.04 using Python 3.11.5.

Error message:

AttributeError('pydantic_parent_namespace') during 'GatewayRuntime' initialization
Flow@49194 Flow is aborted due to ['gateway'] can not be started.
jina.excepts.RuntimeFailToStart

Full error log
ai-service git:(main) ✗ lc-serve deploy local app                                              
⠙ Waiting gateway... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0/1 0:00:00INFO   gateway/rep-0@49279 Registering HTTP route: ask                                                                                                                  [09/02/23 11:28:26]
ERROR  gateway/rep-0@49279 AttributeError('__pydantic_parent_namespace__') during 'GatewayRuntime' initialization                                                                          
        add "--quiet-error" to suppress the exception details                                                                                                                              
       Traceback (most recent call last):                                                                                                                                                  
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/orchestrate/pods/__init__.py", line 89, in run                                          
           runtime = AsyncNewLoopRuntime(                                                                                                                                                  
                     ^^^^^^^^^^^^^^^^^^^^                                                                                                                                                  
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/serve/runtimes/asyncio.py", line 81, in __init__                                        
           self._loop.run_until_complete(self.async_setup())                                                                                                                               
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/nest_asyncio.py", line 99, in run_until_complete                                             
           return f.result()                                                                                                                                                               
                  ^^^^^^^^^^                                                                                                                                                               
         File "/home/sina/.pyenv/versions/3.11.5/lib/python3.11/asyncio/futures.py", line 203, in result                                                                                   
           raise self._exception.with_traceback(self._exception_tb)                                                                                                                        
         File "/home/sina/.pyenv/versions/3.11.5/lib/python3.11/asyncio/tasks.py", line 267, in __step                                                                                     
           result = coro.send(None)                                                                                                                                                        
                    ^^^^^^^^^^^^^^^                                                                                                                                                        
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/serve/runtimes/asyncio.py", line 257, in async_setup                                    
           await self.server.setup_server()                                                                                                                                                
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/serve/runtimes/servers/http.py", line 119, in setup_server                              
           _install_health_check(app, self.logger)                                                                                                                                         
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/serve/runtimes/servers/http.py", line 200, in _install_health_check                     
           from jina.serve.runtimes.gateway.models import JinaHealthModel                                                                                                                  
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/serve/runtimes/gateway/models.py", line 214, in <module>                                
           protobuf_to_pydantic_model(proto)                                                                                                                                               
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/serve/runtimes/gateway/models.py", line 173, in                                         
       protobuf_to_pydantic_model                                                                                                                                                          
           field_type = protobuf_to_pydantic_model(f.message_type)                                                                                                                         
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^                                                                                                                         
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/serve/runtimes/gateway/models.py", line 173, in                                         
       protobuf_to_pydantic_model                                                                                                                                                          
           field_type = protobuf_to_pydantic_model(f.message_type)                                                                                                                         
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^                                                                                                                         
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/serve/runtimes/gateway/models.py", line 207, in                                         
       protobuf_to_pydantic_model                                                                                                                                                          
           model.update_forward_refs()                                                                                                                                                     
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/typing_extensions.py", line 2562, in wrapper                                                 
           return __arg(*args, **kwargs)                                                                                                                                                   
                  ^^^^^^^^^^^^^^^^^^^^^^                                                                                                                                                   
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/pydantic/main.py", line 1211, in update_forward_refs                                         
           cls.model_rebuild(force=True)                                                                                                                                                   
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/pydantic/main.py", line 458, in model_rebuild                                                
           _model_construction.unpack_lenient_weakvaluedict(cls.__pydantic_parent_namespace__) or {}                                                                                       
                                                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^                                                                                              
         File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/pydantic/_internal/_model_construction.py", line 210, in __getattr__                         
           raise AttributeError(item)                                                                                                                                                      
       AttributeError: __pydantic_parent_namespace__                                                                                                                                       
ERROR  Flow@49194 Flow is aborted due to ['gateway'] can not be started.                                                                                                [09/02/23 11:28:26]
Traceback (most recent call last):
  File "/home/sina/.pyenv/versions/ai-service/bin/lc-serve", line 8, in <module>
    sys.exit(serve())
             ^^^^^^^
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/lcserve/__main__.py", line 664, in local
    serve_locally(module_str=module_str, fastapi_app_str=app, port=port, env=env)
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/lcserve/__main__.py", line 57, in serve_locally
    with Flow.load_config(f_yaml) as f:
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/orchestrate/orchestrator.py", line 14, in __enter__
    return self.start()
           ^^^^^^^^^^^^
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/orchestrate/flow/builder.py", line 33, in arg_wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/orchestrate/flow/base.py", line 1832, in start
    self._wait_until_all_ready()
  File "/home/sina/.pyenv/versions/3.11.5/envs/ai-service/lib/python3.11/site-packages/jina/orchestrate/flow/base.py", line 1975, in _wait_until_all_ready
    raise RuntimeFailToStart
jina.excepts.RuntimeFailToStart

I am also having the same error with 3.8.18