"Google Search URL Scraper: A Python script that searches Google for a user-defined search term, collects URLs from the first page of search results, and saves them in a CSV file."
This script searches Google for a user-defined search term and saves the URLs from the first page of search results in a CSV file. This is useful for quickly gathering a list of relevant websites for a specific topic or keyword.
- The script prompts the user to enter a search term.
- It then uses the
googlesearchlibrary to search Google for URLs related to the search term on the first page only. - The script filters out any non-URL results using a regular expression.
- The URLs are saved in a CSV file with the name of the search term (spaces replaced with underscores).
- A sound notification is played when the script is done.
Before you can run this script, you need to have Python installed on your system. You can download Python from the official website.
- Download or clone this repository to your local machine.
- Open a terminal or command prompt and navigate to the directory where the script is located.
- Install the required libraries by running the following command: pip install -r requirements.txt
- In the terminal or command prompt, navigate to the directory where the script is located.
- Run the following command:
- Enter your desired search term when prompted.
- The script will search Google and save the URLs from the first page of search results in a CSV file in the same directory as the script.
- A sound notification will play when the script is done.
Note: If you want to change the sound notification, replace the file path in the winsound.PlaySound() function with your desired WAV file path.