binux / pyspider

A Powerful Spider(Web Crawler) System in Python.

Home Page:http://docs.pyspider.org/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

At python 3.6.8, can't run,

epver opened this issue · comments

commented
  • python version :3.6.8
  • pyspider version: 0.3.10
  • Operating system: windows 10
  • Start up command: pyspider

Expected behavior

I already switch the python to 3.6.x, but, can't run.

Actual behavior

can't run.

How to reproduce

(penv) C:\Users\Administrator\Desktop\spider>pyspider
C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\pyspider\libs\utils.py:196: FutureWarning: timeout is not supported on your platform.
  warnings.warn("timeout is not supported on your platform.", FutureWarning)
[W 200222 16:38:15 run:413] phantomjs not found, continue running without it.
[I 200222 16:38:17 result_worker:49] result_worker starting...
[I 200222 16:38:17 processor:211] processor starting...
[I 200222 16:38:17 scheduler:647] scheduler starting...
[I 200222 16:38:17 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 200222 16:38:18 tornado_fetcher:638] fetcher starting...
[I 200222 16:38:18 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 200222 16:38:18 app:84] webui exiting...
[I 200222 16:38:18 tornado_fetcher:671] fetcher exiting...
[I 200222 16:38:18 scheduler:663] scheduler exiting...
[I 200222 16:38:18 processor:229] processor exiting...
[I 200222 16:38:19 result_worker:66] result_worker exiting...
Traceback (most recent call last):
  File "C:\Users\Administrator\Desktop\spider\penv\Scripts\pyspider-script.py", line 11, in <module>
    load_entry_point('pyspider==0.3.10', 'console_scripts', 'pyspider')()
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\pyspider\run.py", line 754, in main
    cli()
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\click\core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\click\core.py", line 717, in main
    rv = self.invoke(ctx)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\click\core.py", line 1114, in invoke
    return Command.invoke(self, ctx)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\click\core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\click\core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\click\decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\pyspider\run.py", line 165, in cli
    ctx.invoke(all)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\click\core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\click\decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\pyspider\run.py", line 497, in all
    ctx.invoke(webui, **webui_config)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\click\core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\click\decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\pyspider\run.py", line 384, in webui
    app.run(host=host, port=port)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\pyspider\webui\app.py", line 59, in run
    from .webdav import dav_app
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\pyspider\webui\webdav.py", line 216, in <module>
    dav_app = WsgiDAVApp(config)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\wsgidav\wsgidav_app.py", line 134, in __init__
    _check_config(config)
  File "C:\Users\Administrator\Desktop\spider\penv\lib\site-packages\wsgidav\wsgidav_app.py", line 118, in _check_config
    raise ValueError("Invalid configuration:\n  - " + "\n  - ".join(errors))
ValueError: Invalid configuration:
  - Deprecated option 'domaincontroller': use 'http_authenticator.domain_controller' instead.

At last, I want a stable point version that supports python3.7

commented

replace line 209 with
'domaincontroller': NeedAuthController (app), with 'http_authenticator': {'HTTPAuthenticator': NeedAuthController (app)},