diwamishra21 / Python-URL-Scrapper

fetch content through URL and save it to a json file using python Scrapy scrapper

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

# Objective-
to fetch content of URL and save it to a json file

# Directory structure-

# spiders-
this folder contains main file of scrapper ie. clinicaltrial.py

# scrapped_data-
this folder contains files which has extracted content

# How to run-
1. create project using scrapy by command
scrapy startproject tutorial
2. copy ur main python scrapper file(pythonscrapper.py) inside spiders folder of created project

# reference for scrapy-
https://docs.scrapy.org/en/latest/intro/tutorial.html

About

fetch content through URL and save it to a json file using python Scrapy scrapper


Languages

Language:Python 100.0%