ayuLiao / JsSandBox

Simple javascript sandbox for web crawler

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Simple javascript sandbox for web crawler

Motivation

Many websites use complex JavaScript protection techniques, which hinders us from developing crawlers.

We developed JsSandBox based on the idea of mimicking the browser environment, allowing you to obtain the target's complete encrypted parameters without the need for in-depth knowledge of the target site's Javascript

Feature

  • You can use tools/dump_browser_env.js to copy the browser environment with one click
  • You can use tools/vm_proxy.js Hook any object
  • JsSandBox has done the appropriate protection measures to bypass the common environmental monitoring logic of the site

Basic Usage

The first step is to copy the target site's environment.

1.copy dump_browser_env.js code to Chrome sources snippet and run snippet.

copy code to snippet

2.use dump function get object environment info.

use dump

3.copy environment info to env folder.

copy location code

4.modify env/env.js.

add location code

5.run main.js

Use Proxy

Add the object you want to proxy in env/proxy_obj.js

use proxy

Thanks

  • 寄予蓝y

About

Simple javascript sandbox for web crawler


Languages

Language:JavaScript 100.0%