incubated-geek-cc / WebScraper

A Node.js express server setup to create a web scraping api where web content is parsed and extracted via a proxy.

🌐 Web Scraper

🛠️ Retrieves HTML text content from https://dexur.com/icd/search/ and returns a JSON formatted response

Runs on Node.js Express framework. 🔌 Request proxy setup.

🌟 Try it yourself (where query = "panic")

Live Demo :: Link
Live Demo :: Backup Link

🧰 Run on localhost

• Run npm install to install all node dependencies
• Double-click file startup.sh
• Navigate to localhost:5000 and test API

✍ Read related post here

Article :: Link

📌 Features

• Parses HTML content with jsdom
• Minifies retrieved HTML text with html-minifier (optional)
• Traverse the HTML node(s) for raw data extraction
• Formats extracted data into structured JSON formatted data called via a GET API

👀 Preview (e.g. query = "mood")

— Join me on 📝 Medium at ~ ξ(🎀˶❛◡❛) @geek-cc

---

🌮 Please buy me a Taco! 😋