comp-journalism / apple-news-scraper

Code used for collecting and saving the Top Stories and Trending Stories in Apple News via Appium.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Scrape without Apple hardware

mrx23dot opened this issue · comments

Is it possible to scrape it without any Apple hardware?
Do you have an Apply API endpoint?

wiki "The Apple News app works by pulling in news stories from the web through various syndication feeds (Atom and RSS)[13] or from news publishing partners through the JSON descriptive Apple News Format."

Great question! Last time I tried, this was not possible as Apple News was using SSL pinning on their endpoints. One might be able to access endpoints from individual publishers, but it wouldn't be possible to see how their stories were featured in the app.

Bypassing ssl pinning seems way too much effort :(
https://www.cyberlands.io/sslpinningbypassios