colly

There are 3 repositories under colly topic.

• tb0hdan / domains

  World’s single largest Internet domains dataset

  collydatasetinternet-domainsscrapysearch-enginesyacy
  Language:HTML 677

• hezhizheng / go-movies

  golang spider Crawler 爬虫 电影

  collycrawlerdockerfasthttpgogocollygolangmoviesredisspider
  Language:Go 256

• foolin / pagser

  Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler

  gogolanggoquerycollyhtmlscrapypagedeserializationparsercrawler
  Language:Go 103

• hipig / tonovel-go

  tonovel是一个简洁，干净的小说聚合系统

  collyiris
  Language:Go 88

• slurpcode / slurp

  One repo to rule them all !!?!?!! 🤓 😎

  jekyllliquidrubygithub-pagesjavascripteaster-eggjquerysnowstormpythongolangshellditaxsltcollyreadthedocscloudflare-workersherokuwebscrapingpercyhacktoberfest
  Language:JavaScript 53

• clouedoc / goquotes

  A Go scraper aimed at scrapping quotes.

  golanggoscrapperscrappingcollyquotesh4ck3rz
  Language:Go 50

• Youngkingman / gentlemanSpider

  基于colly，支持标签(xp)筛选和多线程加速的绅士漫画爬虫优雅实现

  collygolangerohonhentaiscraper
  Language:Go 48

• chieund / crawl

  Teach daily is web crawl by GoLang from web dev.to, freecodecamp.com, medium.com, hashnode.com, logrocket.com,infoq.com

  corbadockerdocker-composegogolanggormmakefilenginxcollycrawlgonicmysqltypesenseviper
  Language:Go 42

• sb-child / lsp

  python 爬虫, golang 爬虫: 涩涩网站 学习资料 视频爬取下载工具 完美适配 miya(蜜芽)和 yysp(夜夜视频, 夜夜視頻)

  pythonrequestsbeautifulsoup4spiderffmpegmultiprocessingm3u8decryptcollyhtmlvideodownloadergogolang
  Language:Go 42

• Drack112 / Go-Wallpaper

  Um projeto simples que tem como função utilizar o go como um Scrapper (Colly) para fazer Download de Wallpapers do site Wallpaper Flare.

  collygolang
  Language:Go 21

• zolamk / colly-mongo-storage

  MongoDB Storage For Colly

  collymongodb
  Language:Go 21

• luckylittle / dzone-refcardz-downloader

  Downloads all refcardz from https://dzone.com/refcardz

  gogolangdzonerefcardzgo-collygocollycollyscraperscraping
  Language:Go 19

• xilaluna / fentanyl-epidemic-tracker

  A go scraper that identifies articles relating to fentanyl to map the trend of the fentanyl epidemic.

  collygin-gonicgogolangmongodbredis
  Language:Go 17

• youngjuning / homebrew-juejin-spider

  爬取掘金专栏并转为Markdown保存到本地

  golangspidercolly
  Language:Go 14

• kangoo13 / proxy-checker

  Check for a set of proxies different conditions, is the proxy working, does the proxy bypass cloudflare and so on.

  proxy-checkercloudflare-bypasscloudflare-checkerproxies-detectedcollygocollygolangban-checkerproxy-ban-checkerproxies-checkerproxy-al
  Language:Go 13

• niloysikdar / Go-IMDb-Crawler

  Want to know which celebrities have a common birthday with yours? 👀 Get the full data about them. Made using Go + Colly

  crawlergolangcollyimdb
  Language:Go 13

• alt-romes / llvm-c-search

  Terminal interface to search the LLVM-C API

  llvmllvm-ccollyscraperctuibubbletea
  Language:Go 12

• eval-exec / goodreads

  gocolly/colly demo project, crawl quotes from https://www.goodreads.com/quotes

  collygocollygoodreadsgoodreads-quotes
  Language:Go 12

• Leagify / colly-draft-prospects

  Source code for web scraping football draft prospects

  golangcolly
  Language:Go 9

• toannd96 / devread

  DevRead - ứng dụng tổng hợp kiến thức cho developer

  web-scrapinggolangcollyecho-frameworkconcurrency
  Language:Go 9

• wlcn / yq-colly

  基于colly的爬虫项目

  golangcolly
  Language:Go 9

• alibo / gosubscene

  A simple API wrapper for https://subscene.com written in golang

  subscenesubtitlescollygolang
  Language:Go 7

• elonzh / colly-bolt-storage

  Simple and fast storage for colly, built on top of bolt.

  collyboltboltdb
  Language:Go 7

• itwars / golang-scraping-colly

  Exemples de récupération de données non structurées avec le framework Golang COLLY

  scrapingcrawlinggolangcollyscrapercrawlerbigdatadatasportsforecast
  Language:Go 7

• luckylittle / aws-whitepapers-downloader

  Golang downloader for all AWS whitepapers

  gogolangawswhitepapersdownloadercollyamazon-web-services
  Language:Go 7

• fuchsia-programming / scrapers

  Scraper Replicants

  golangcollyxpathregexprubynokogirirubocopphpcurlpythonrequestslxmlfqlferrethtmldata-miningtext-miningshellweb-crawlersed
  Language:Go 5

• AaruranLog / pydoc.random

  Generate python docs with deep learning

  python3text-generationdeep-learningcollygolangdocumentation-generator
  Language:Jupyter Notebook 4

• gotneb / manga_api

  A simple manga api whose scrape data from manga websites.

  collygomanga-scraperscraping-websitesmongodb
  Language:Go 4

• rustyeddy / moni

  Website Baby Sitter

  scrapercollymonitoring
  Language:Go 4

• YizheZhang-Ervin / BackEnd_Golang

  Frameworks By Golang (Beego/Gin/Colly/GoMicro/GoChain/Fyne)

  beegogolanggingo-microcollygochainfyne
  Language:Go 4

• almmiko / safaribooks-scraper

  Safaribooks Scraper Example.

  golangscrapercollydep
  Language:Go 3

• jph5396 / sumoscrape

  Gather Sumo data from the web

  golangcollywebscraping
  Language:Go 3

• milindmadhukar / stonksapi

  An API to provide with stocks,crypto data and news.

  golanggo-chicollyfinancestockscryptoapicryptocurrencystock
  Language:Go 3

• pooulad / go-scraper

  🚨Web scraper in Golang

  collygolangscraper
  Language:Go 3
• istockphoto-go

  QIN2DIM / istockphoto-go

  📸 Gracefully download dataset from iStockPhoto.

  collycrawleristockphoto
  Language:Go 3

• husnainkhurshiid / golang-webscraping

  Golang is a vast language and have a much to offer. Scraping is also one of those Scraped quotes.toscrape.com using Golang's Colly

  collydatadata-sciencedataextractiongolangscraping-websiteswebscraping
  Language:Go 2