kvmpret

ArchiveBox

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

lemmy

🐀 A link aggregator and forum for the fediverse

awesome-web-scraping

List of libraries, tools and APIs for web scraping and data processing.

MechanicalSoup

A Python library for automating interaction with websites.

payloads

Git All the Payloads! A collection of web attack payloads.

fbchat

Facebook Chat (Messenger) for Python

quran.com-frontend

quran.com frontend

thumbsup

Generate static HTML photo / video galleries

TelegramApiServer

Fast, simple, async php telegram api server: MadelineProto + Amp HTTP Server

telegram-export

Export Telegram chat data and history

reddit-shell

web based linux shell emulator that allows you to browse reddit via command line

Canvas-Streaming-Example

This project contains example code showing how to go live on Facebook using a <canvas> element as a source.

termux-fedora

A script to install a Fedora chroot into Termux

Sitemap-Generator-Crawler

PHP script to recursively crawl websites and generate a sitemap. Zero dependencies.

TelegramRSS

Convert telegram posts to RSS or json in amphp server

transistor

Transistor, a Python web scraping framework for intelligent use cases.

hackernewsbot

:newspaper: Telegram bot that posts new hot stories from Hacker News to telegram channel

JSON2CSV

A simple PHP script to convert JSON data to CSV

fbarc

A commandline tool and Python library for archiving data from Facebook using the Graph API.

screenshot-tweet

Screenshot a tweet.

ngDownloader

:video_camera: :movie_camera: Now Download videos from any website including YouTube, Facebook, Udemy etc without ads.

socials

👨‍👩‍👦 Social account detection and extraction in Python, e.g. for crawling/scraping.

csviewer

csv viewer command

domnibus

Access domain information via python and command line.

telegram-insta-loader

Getting the Instagram posts and send to to a telegram peer using instaloade (https://github.com/instaloader/instaloader)

darip

Bulk downloads images from Deviant Art using Mechanicalsoup's simulated browser

bounce

you type in things, it redirects you

Top-Climate-Heroes

A curated list of Twitter accounts worth following, writing about the climate change emergency, scientist evidence, actions and more.

twitter-threads

tweets-to-text

TweetsToText is a bot that lives on Twitter. It collects your tweets into plain text files. So you can take your brilliant observations somewhere else.