Documenting the Now

twarc

A command line tool (and Python library) for archiving Twitter JSON

hydrator

Turn Tweet IDs into Twitter JSON & CSV from your desktop!

diffengine

track changes to the news, where news is anything with an RSS feed

docnow

A Twitter data collection and appraisal application.

unshrtn

A LevelDB backed URL unshortening microservice written in JavaScript

twarc-csv

A plugin for twarc2 for converting tweet JSON into DataFrames and exporting to CSV.

catalog

A simple catalog of Twitter ID Datasets

twarc-network

Generate network visualizations from Twitter data.

awesome-social-media-archiving

Tools for helping you work with web platform archive downloads.

tweet-archive

A tool for working with tweet archives.

code-of-conduct

Code of Conduct for the Documenting the Now Community

waybackprov

utility to fetch provenance information from Internet Archive's Wayback Machine

storified

archive Storify stories

twitter-archive-unshorten

Convert the t.co URLs in your Twitter archive back to their full form

twarc-timeline-archive

Download timelines for a set of users

docnow-ansible

Ansible Installer for Docnow App

docnow.github.io

docnow.io website

social-humans

social media labels for more ethical archives

twarc-edits

Add a twarc2 command to get edited tweets

twarc-hashtags

Report on hashtags in tweet data.

twarc-ids

A plugin for twarc2 to extract tweet ids from tweet JSON.

flatten-tweet

Make Twitter v2 API response data easier to work with

twarc-text

A twarc plugin to print tweets to the console

instagram-export-viewer

roadmap

A roadmap of development on the Documenting the Now project.

twarc-statistics

A plugin for getting counts and basic statistics from a dataset

twarc-videos

tweetgresql

A little playground for testing modeling tweets in Node & PostgreSQL

docnow-infra

Docnow Terraform Infrastructure

howtoarchiveit.github.io

Compilation of manuals and instructions on how to preserve profiles on social media and messaging services.