wget

There are 10 repositories under wget topic.

• ArchiveBox

  ArchiveBox / ArchiveBox

  🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

  archiveboxbackupsbookmark-archiverbrowser-bookmarkschromiumdigipresfirefoxheadless-browserinternet-archivingpinboardpocketpythonrssself-hostedsinglefilewarcwayback-machineweb-archivingwgetyoutube-dl
  Language:Python 19761

• wkentaro / gdown

  Google Drive Public File Downloader when Curl/Wget Fails

  curldownloaddownloadergoogle-drivepythonwget
  Language:Python 3895

• circulosmeos / gdown.pl

  Google Drive direct download of big files

  perl-scriptsgoogle-drivewgetgdrivedockerfile
  Language:Perl 927

• benibela / xidel

  Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

  xqueryxmlhtmljsonxpathclicommand-linehttpwebrestcss-selectorwgetcurlhttpiexmlstarletwebscraperwebscrapingscraperdatascrapingdata-processing
  Language:Pascal 651
• bitextor

  bitextor / bitextor

  Bitextor generates translation memories from multilingual websites

  document-alignerapertiumdictionariescrawlerwgethunalignsentence-segmentationtokenizerbicleanertmxwarccorpus-toolscorpus-processingcorpus-generatorparallel-corporamachine-translationneural-machine-translationstatistical-machine-translationbitextorbleualign
  Language:Python 278

• icy / google-group-crawler

  [Deprecated] Get (almost) original messages from google group archives. Your data is yours.

  bashcookiecrawlercurlgoogleownershipwget
  Language:Shell 214

• teracow / googliser

  a fast BASH multiple-image downloader

  bashgoogleimagedownloadscriptshellgallerylinuxwgetcurlfastgallery-imageimagemagickmontagedebianmacosmanjaropuppiesparallel-downloadscontact-sheet
  Language:Shell 207

• Yezz123-Archive / Phisher

  Perform various social engineering attacks using PHP, Apache, Ngrok 🦥

  phishingphpngrokwgetlinuxapache
  Language:HTML 195

• georgjaehnig / webpages-to-ebook

  Create an EPUB from a list of URLs. Standing on the shoulders of Wget, Readability and Pandoc.

  epub-generationepubwgetpandocebook-compliationebookjsnpm
  Language:JavaScript 187

• jiejieTop / http-client

  A high-performance, high-stability, cross-platform HTTP client.

  httphttp-clientrtoslinuxtcpiphttp-parsercross-platformsslmbedtlsrequesthttpswgetcurl
  Language:C 177
• InsideHeartz-WhatsApp-Bot

  fdciabdul / InsideHeartz-WhatsApp-Bot

  A multipurpose whatsapp bot buillt on node.js

  downloaderwhatsappwhatsapp-botwhatsapp-apiyoutubenhentaitracemoehacktoberfesthacktoberfest2020perintahvoicemp3wget
  Language:JavaScript 164

• PThorpe92 / CuTE

  HTTP client/libcurl TUI front end in Rust, with request + key storage

  api-keyscurlhttpratatuirest-api-testrusttuiwget
  Language:Rust 143

• otavio / rsget

  A simple command line utility to download a remote file, similar to wget. This is not intended to be a full feature wget replacement but a simple tool to test few Rust crates.

  structoptindicatifreqwestwgetrustsimple
  Language:Rust 132

• tahmidrayat / ubuntu

  Install ubuntu in Termux Without Rooted Device

  htr-techtermuxtermux-tooltermux-toolsubuntunon-rootbashbash-scriptshellwgetprootterminal
  Language:Shell 124

• adamdehaven / fetchurls

  A bash script to spider a site, follow links, and fetch urls (with built-in filtering) into a generated text file.

  bash-scriptingcrawlshell-scriptspiderurlswebsitewget
  Language:Shell 123

• theaquacadet / pillager

  A wget script for pillaging.

  bash-scriptwget
  Language:Shell 114

• sigmaboy / nopaystation_scripts

  do things with nopaystation tsv and links automatically

  nopaystationtsvpsvitavitadownloadwgetpkg2zipcurlshell-scriptsmktorrentgame-mediaps-vita-gamedownloading-gamesdlctorrentgame
  Language:Shell 102

• yiliyassh / authority-data

  官方权威数据：统计年签，统计公报，互联网行业报告，工信部数据，ICT报告等 Official authoritative data (Chinese)

  authorityawkcrawlerdatafreepython3shellstatisticswget
  Language:Python 96

• mihaigalos / aim

  🎯 A command line download/upload tool with resume.

  rustdownloaderwgetdownload-resumeresumecurlcommand-linecommandline-toolcommand-line-tool
  Language:Rust 91

• webfolderio / wget-windows

  Windows binary of GNU Wget

  wget
  Language:Shell 86

• ArchiveTeam / wget-lua

  Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

  webarchivingwarcwgetluaarchivingcrawlercrawlcrawlingspiderarchiveteamwget-luazstdftpscraperscrapingcrawlersdownloader
  Language:C 81

• IO-Technologies / bashupload

  Opensource for bashupload.com - PHP based files uploader for CLI, servers, desktops and mobiles

  phpcliuploadfilesharingcurlwget
  Language:PHP 81

• abemassry / wsend

  wsend: The opposite of wget

  storagebashwgetfriendscliunixcurlshelltransfersendreceivefileshacktoberfest
  Language:Shell 76

• evertonstz / pynps

  A cli Linux and Windows Nopaystation client made with python and wget. Works with PSvita, PSP, PSMobile and PS3 packages

  wgetpsvitapsxpkg2zippsmps3pspnopaystationpython
  Language:Python 61

• suyashkumar / getbin

  💻 Easily fetch latest GitHub release binaries (for your OS/arch) using just wget or curl

  binarydistributionpackage-managerreleasegithub-releaseswgetcurlpackagereleasesrelease-engineeringrelease-automationrelease-apipackage-management
  Language:Go 60

• yoonwaiyan / stackskills-dl

  Simple Ruby script to download all StackSkills tutorials.

  downloaderruby-scriptstackskillsrubywgetstackskills-dlstackskills-tutorialsdownloaddownload-script
  Language:Ruby 59

• Azathothas / Static-Binaries

  Cross Compiled Statically Linked Binaries for Android Linux macOS Windows & More

  androidbinarybusyboxcompilecoreutilslinuxmasscanmassdnsstatictoyboxaria2wgettailscalechrootcrocgostnet-toolsngroktwingateuserspace
  Language:Tcl 56

• slyfox1186 / pihole-regex

  Custom RegEx, Exact, and Adlist filters for Pi-hole's FTLDNS

  blacklistdnspi-holeregexad-blockeradsblacklistingfilterspython3shell-scriptwgetwhitelistingaddns-serverdnsmasqpiholepihole-blocklistspython
  Language:TSQL 55

• r1b / CVE-2017-13089

  PoC for wget v1.19.1

  wgetcve-2017-13089dockersecurity
  Language:Shell 53

• socketry / rackula

  Generate a static site from any rack middleware.

  asyncrackrailsrubywget
  Language:Ruby 50

• aligoren / gofret

  gofret is a Download Manager written in Go.

  golanggowgetfile-download
  Language:Go 47

• pirate / internet-archiving-talk

  🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.

  internet-archivingtalksslideshowweb-archivingwgetwarcarchiveboxcensorshipethics
  Language:JavaScript 47

• lifenjoiner / wget-for-windows

  Small. New features: Windows native support for https, ftps, ntlm, metalink and IDN, instead of OpenSSL, GNU hashes and libidn dependencies; New URL transcoding model; And the smallest ever file size ~500K. 小！新特性：不依赖 OpenSSL, GNU hashes 和 libidn 的， Windows 原生支持的 https, ftps, ntlm, metalink 和 IDN；新 URL 转码模型；目前最小编译 ~500K.

  clidownloaddownloaderhttpstoolswgetwindowswintls
  Language:C 46

• sachin-bisht / Instagram_Stalker_Scraper

  (UNMAINTAINED) Fetch data of any public Instagram profile, without using api

  instagram-scraperinstagrampython3requestsjsonlxmlmatplotlibwgetosinfinite-scroll
  Language:Python 43

• ksk001100 / ruget

  Alternative to wget written in Rust

  downloaderrustwget
  Language:Rust 39

• pH-7 / Crawling-Emails

  Very simple bash script to crawl email addresses from a specific website.

  emailcrawlerbashwgetscraperscrape-emailemail-scraperscrapingscrapeshell
  Language:Shell 33