yxw19870806 / PyCrawler

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

现有python2版本将不再更新

Required

  • OS:windows(maybe Linux and mac)
  • Python:v2.7.12+, not supported Python 3.X

Features

  • 多线程
    multithreading
  • 支持使用代理设置
    support proxy
  • 支持绑定键盘事件(快捷键),如暂停/启动程序运行
    support bind keyboard events, e.g. pause or restart process
  • 支持本地端口监听,根据收到的请求内容暂停/启动程序运行
    support local port listener, according to the received content to pause or restart process
  • 支持从本地浏览器中读取cookies并携带访问限制的网站
    read cookies from your local browser
  • 页面访问支持多种参数:
    support multiple parameter for visit web
    • 支持常用请求方法:GET、POST、HEAD、PUT、DELETE、OPTIONS、TRACE
      common request method: GET, POST, HEAD, PUT, DELETE, OPTIONS, TRACE
    • 可自定义添加request header
      add customize request header
    • 可自定义添加Cookies
      add customize cookies
    • 可设置链接超时、读取超时
      set connection timeout and read timeout
    • 可设置是否自动跳转(http code 301、302、303、307、308)
      set whether auto redirect(http code 301, 302, 303, 307, 308)

Install

  • run main/install.bat in CMD console

Support website / App

About


Languages

Language:Python 99.9%Language:Batchfile 0.1%