url-extractor

There are 6 repositories under url-extractor topic.

• patternknife / url-knife

  Extract and decompose (fuzzy) URLs (including emails, which are conceptually a part of URLs) in texts with robust patterns.

  url-parserurl-parsingjavascripturi-templateurl-validationurl-extractoremail-parseremail-extractoremail-parsing
  Language:JavaScript 330
• galer

  dwisiswant0 / galer

  A fast tool to fetch URLs from HTML attributes by crawl-in.

  galerspidercrawlerdevtoolwaybackurlsgogolangextractorurl-parserurl-extractor
  Language:Go 208

• r3dxpl0it / Damn-Small-URL-Crawler

  A Minimal Yet Powerful Crawler for Extracting all The Internal/External/Fuzz-able Links from a website

  crawlerurl-extractorurl-crawlerurl-parserurl-scraperurl-parameterspenetration-testing
  Language:Python 30

• eversinc33 / urlExtract

  Recursively extract urls from a web page for reconnaissance.

  crawlerbug-bountybugbountybugbounty-toolurl-extractorlink-extractorlink-extractionrelative-urlspider
  Language:Go 11

• httpreserve / tikalinkextract

  Tika based link (URL) extractor for httpreserve

  webarchivingtikatika-wrapperhttpreservecode4libdigitalpreservationarchivesiipcurl-extractor
  Language:HTML 8

• hrbrmstr / drill-twitter-text

  An Apache Drill UDF for working with Twitter tweet text via the twitter-text Java library (https://github.com/twitter/twitter-text/tree/master/java)

  apache-drilltwitter-texthashtagsmentionsurl-extractor
  Language:Java 6

• limit-zero / url-juicer

  🍊🔗 Squeeze some juice from URLs: A URL crawler/extraction library.

  url-extractorurl-crawlernodejs
  Language:JavaScript 5

• sp34rh34d / WebRunner

  Web scraping | Website cloner

  email-enumerationemail-extractorscrapingurl-extractorurl-parserctfpentestingregexppythonpython3crewlerclone-websitecloner
  Language:Python 4

• superbeppe98 / ebay-listing-matches

  The eBay Listing Matcher is a Python script designed to compare and match eBay listings with parts from an Inventree instance. This script utilizes the eBay Trading API and the Inventree API to gather and process data.

  python3checkerebayebay-apiinventreejsonurl-extractorinventree-api
  Language:Python 3

• akash-rajak / URL-Extractor

  A python script to extract URL from the text or paragraph.

  python3tkinterreintertoolsurlurl-extractor
  Language:Python 2

• hobsRKM / article-miner

  Extract article title, description, images, keywords and authors from any URL

  nodejsnewspaper3kapiimage-extractorurl-extractor
  Language:JavaScript 2

• khalidelboray / SrcSearch

  Extract URLs,endpoints,paths and word-lists form source files

  endpointsendpoints-checkerextracurl-extractor
  Language:Raku 2

• OpenBookPublishers / geturls

  Extact all URLs from anchor and image tags within a html/xhtml page and its children.

  url-extractorhtml-parsing
  Language:Shell 2

• SeyedMahmoudMousavi / url-extractor

  Extract urls from your a file or web address

  urlurl-extractorurlextractorcomposerpackagephp
  Language:PHP 2

• dotdesh71 / Website-URL-Scanner

  Website URL Scanner is a simple command-line tool that allows you to scan a website and extract all URLs. It can be useful for various purposes, such as link analysis or checking for broken links.

  command-line-toolgithubseourl-extractorweb-scrapingwebsite-url-scanner
  Language:Batchfile 1

• KOUISAmine / url-extractor

  Extract http/https URLs from any kind of text content.

  extractextract-urlextract-urlsextractorhtmljslink-extractionlink-extractorlinksonlinephpscriptsource-codetoolsurlurl-extractor
  Language:HTML 1

• loneicewolf / RE_QUERY

  A tool I use to search the web efficiently

  regexurl-extractor
  1

• ryanaryap / URL-Extractor

  URL Extractor is a simple Python code designed to extract the domain name from a list of URLs stored in a text file. This application provides a convenient way to extract and process URLs efficiently.

  extractorpythonurl-extractorurlextractor
  Language:Python 1

• zedseven / urlextractor

  A small tool for extracting all urls from a blob of binary data (ex. PDFs).

  urlextractorblobextract-dataextracturlurl-extractorutilitylightweight-tool
  Language:Go 1

• manyfacedllama / email-attachment-url-extractor

  File attachment and URL extractor for EML & MSG files using Python

  mimemsgextractorpythonurl-extractorattachment-extractor
  Language:Python 0

• AlteredAdmin / Link-Lifter

  LinkLifter is a Python script that searches for URLs in a given text file or recursively in a directory and its subdirectories. The found URLs, along with the file they are located in, are saved to a CSV file.

  urlextractorextract-urlsurl-extractorurlfinder
  Language:Python

• jessicasimplicio / mD-links-lib

  Bootcamp Laboratoria - Produto final do sprint 4. Biblioteca no npm para extracao de links em documento markdown.

  npm-packageurl-extractornodejslibrary
  Language:JavaScript

• superbeppe98 / url-title-extractor

  URL Title Extractor is a Python program that extracts the titles of web pages from a file containing URLs. It uses the requests and BeautifulSoup libraries to extract the title and decode any HTML entities.

  python3requestsurl-extractor
  Language:Python