tom-draper / scrapi

A REST API for simple web scraping operations.

ScrAPI

A REST API for simple web scraping operations.

Links

To get a list of all links featured on a webpage:

https://scrapi-api.vercel.app/api/links?url=<URL>

import requests
response = requests.get('https://scrapi-api.vercel.app/api/links?url=https://www.google.com')
print(response.json())
# [{'href': 'https://www.google.com/imghp?hl=en&tab=wi'}, {'href': 'https://maps.google.com/maps?hl=en&tab=wl'}, {'href': 'https://play.google.com/?hl=en&tab=w8'}, ...]

Images

To get a list of the images on a webpage:

https://scrapi-api.vercel.app/api/images?url=<URL>

import requests
response = requests.get('https://scrapi-api.vercel.app/api/images?url=https://www.google.com')
print(response.json())
# [{'src': '/images/branding/googlelogo/1x/googlelogo_white_background_color_272x92dp.png', 'alt': 'Google'}]