Giters

mkoehnke / WKZombie

WKZombie is a Swift framework for iOS/OSX to navigate within websites and collect data without the need of User Interface or API, also known as Headless browser. It can be used to run automated tests / snapshots and manipulate websites using Javascript.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Help with OpenThen, Batch, Fetch Functions

david-littlefield opened this issue · comments

commented

Hi @mkoehnke!

Thank You:
First, thank you for building this repo, I've only been able to use some of the basic features, but it's already been incredibly useful!

Goal:
I'm using WKZombie to open a website, login, wait for redirect, scrape video links, scrape each video source, and download the linked files. The video source is on the individual page of each video link.

Problems:

  • Signing into social networks like LinkedIn.
  • Performing many URL Requests at once causes the host to block access.

Request:
Could you please help teach how to login to LinkedIn, delay URL requests, and use openThen?

Additional Notes:

  • Read WKZombie manual, reviewed iOS and MacOS demo, reviewed swift files in WKZombie pod, and searched Stack Overflow, Google, YouTube, and GitHub for examples.
  • Using WKZombie with SwiftSoup.