JatinAgrawal0 / Web_Scrapper

Web Text Scraper empowers users to effortlessly extract text elements from web pages with advanced customization options. Its robust error handling ensures a smooth scraping process, enabling efficient data gathering with a human-friendly interface.

✨ Web Scrapper ✨

🌐 Web Text Scraper is your go-to tool for effortlessly extracting text elements from web pages. 🧰 Customize your extraction process by selecting 📃 paragraphs, 🏷️ titles, or specific HTML tags. With robust error handling and a visually appealing display of the extracted text, it simplifies web scraping, making data gathering a breeze. 🚀

🔧 Features:

• Flexible Element Selection 🖋️
• Interactive Interface 🌐
• Real-Time Text Extraction ⏳
• Feedback Messages 📢

📥 Installation:

To run the Web Text Scraper, make sure you have the following dependencies installed:

• streamlit
• beautifulsoup4==4.11.1
• pip==23.1.2
• requests==2.28.0

Command:

👉 pip install -r requirements.txt 👈

📝 Usage:

1. Run the streamlit_app.py script using the following command:

🚀 python streamlit_app.py 🚀

2. Enter the URL of the web page to scrape.

3. Select the elements to scrape: "Paragraphs", "Titles", "Paragraphs and Titles", "All", or "Custom".

4. If choosing the "Custom" option, enable the "Custom Tag" checkbox and enter HTML tags (comma-separated).

5. Click the "Scrape" button to start scraping.

6. View the extracted text.

📌 Note:

Make sure to replace 'Jatin_Agrawal_20BCS6606' with your desired page title and 'LOGO.png' with the path to your desired page icon in the set_page_config function.

Contributing 🤝

Contributions are welcome! If you find any issues or have suggestions for improvements, please open an issue or submit a pull request.

License 📄

This project is licensed under the MIT License.