SwarupKharul / Scraping-TheVerge

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Scraping-TheVerge

This is a simple web scraper that scrapes the latest news from The Verge. It uses the BeautifulSoup library to parse the HTML and Requests to get the HTML from the website.

The scrapper is deployed on AWS as a Lambda function. The function is triggered by an API Gateway endpoint. The endpoint is then used by a Django app to store the scraped data in a database.

The AWS Lambda Function url is: https://4rv2gllqedqztv6k5id4zknon40kfdss.lambda-url.ap-south-1.on.aws

About

License:MIT License


Languages

Language:Python 97.5%Language:Dockerfile 2.5%