shiruken / rt-archive

Rooster Teeth website archive tracker and Rooster Teeth API archive

Home Page:https://shiruken.github.io/rt-archive/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Update Rooster Teeth Data Update Internet Archive Data Identify Dark Uploads

Rooster Teeth Archive

Archive Progress Tracker

Track the progress of the ongoing effort to mirror the Rooster Teeth website to Internet Archive.

https://shiruken.github.io/rt-archive/

Browse the RT Archive

Metrics

  • Rooster Teeth Videos: 42,603
  • Items on Internet Archive: 42,602 (100.00%)
  • Items Missing from Internet Archive: 2 (0.00%)
  • Incomplete Items on Internet Archive: 848
  • Items Removed from Internet Archive: 2

Rooster Teeth API

Comprehensive mirror of the Rooster Teeth API stored on Internet Archive. The pages of each endpoint are condensed to a single JSON file for easy download.

Updated every 4 hours on the hour

/watch

This endpoint lists every video published on the Rooster Teeth website, including bonus content.

/episodes

This endpoint lists every episode published on the Rooster Teeth website, excluding bonus content.

/shows

This endpoint lists every show published on the Rooster Teeth website.

Note: This endpoint is supposed to list every show published on the website, however it is missing seven shows that appear in the /watch endpoint: Inside Gaming Daily, Inside Gaming Explains, Inside Gaming Features, Inside Gaming Live!, Inside Gaming Podcast, Inside Gaming Reviews, and Inside Gaming Special.

/channels

This endpoint lists every channel published on the Rooster Teeth website.

Rooster Teeth API Images

Comprehensive mirror of the images referenced in the Rooster Teeth API stored on Internet Archive. The archived images can be accessed by swapping the original domain name with the Internet Archive download URL:

cdn.roosterteeth.comarchive.org/download/roosterteeth-api-images

A small number of images (12) were stored using a bare AWS domain. These should be mapped with:

s3.amazonaws.com/dev.cdn.roosterteeth.comarchive.org/download/roosterteeth-api-images/image

There were 2,720,688 image urls referenced by the Rooster Teeth API of which 181,180 were unique. There were 40 broken image links (HTTP Error 404) that could not be archived. They are listed below:

Broken URLs
https://cdn.roosterteeth.com/image/upload/t_t/f_auto/2/uploads/images/4bc2aac0-9528-4111-a876-ada9c0efdfa6/original/24363-1437848352684-mirror%27s_edge_catalyst.jpg
https://cdn.roosterteeth.com/image/upload/t_sm/f_auto/2/uploads/images/4bc2aac0-9528-4111-a876-ada9c0efdfa6/original/24363-1437848352684-mirror%27s_edge_catalyst.jpg
https://cdn.roosterteeth.com/image/upload/t_m/f_auto/2/uploads/images/4bc2aac0-9528-4111-a876-ada9c0efdfa6/original/24363-1437848352684-mirror%27s_edge_catalyst.jpg
https://cdn.roosterteeth.com/image/upload/t_l/f_auto/2/uploads/images/4bc2aac0-9528-4111-a876-ada9c0efdfa6/original/24363-1437848352684-mirror%27s_edge_catalyst.jpg
https://cdn.roosterteeth.com/image/upload/t_t/f_auto/2/uploads/images/3b5e7ff2-440a-4416-8cab-30aad0919d40/original/DBZ_Earth%27s_Special_Forces.jpg
https://cdn.roosterteeth.com/image/upload/t_sm/f_auto/2/uploads/images/3b5e7ff2-440a-4416-8cab-30aad0919d40/original/DBZ_Earth%27s_Special_Forces.jpg
https://cdn.roosterteeth.com/image/upload/t_m/f_auto/2/uploads/images/3b5e7ff2-440a-4416-8cab-30aad0919d40/original/DBZ_Earth%27s_Special_Forces.jpg
https://cdn.roosterteeth.com/image/upload/t_l/f_auto/2/uploads/images/3b5e7ff2-440a-4416-8cab-30aad0919d40/original/DBZ_Earth%27s_Special_Forces.jpg
https://cdn.roosterteeth.com/image/upload/t_t/f_auto/2/uploads/images/87749a8f-b5c2-4f1c-b9ed-f9cac2908e1b/original/Reggie-Fils-Aime%27s-ABC-Interview.jpg
https://cdn.roosterteeth.com/image/upload/t_sm/f_auto/2/uploads/images/87749a8f-b5c2-4f1c-b9ed-f9cac2908e1b/original/Reggie-Fils-Aime%27s-ABC-Interview.jpg
https://cdn.roosterteeth.com/image/upload/t_m/f_auto/2/uploads/images/87749a8f-b5c2-4f1c-b9ed-f9cac2908e1b/original/Reggie-Fils-Aime%27s-ABC-Interview.jpg
https://cdn.roosterteeth.com/image/upload/t_l/f_auto/2/uploads/images/87749a8f-b5c2-4f1c-b9ed-f9cac2908e1b/original/Reggie-Fils-Aime%27s-ABC-Interview.jpg
https://cdn.roosterteeth.com/image/upload/t_t/f_auto/2/uploads/images/f9da9a7d-8725-43a3-b007-18d17520f2ae/original/Whomp%27Em.gif
https://cdn.roosterteeth.com/image/upload/t_sm/f_auto/2/uploads/images/f9da9a7d-8725-43a3-b007-18d17520f2ae/original/Whomp%27Em.gif
https://cdn.roosterteeth.com/image/upload/t_m/f_auto/2/uploads/images/f9da9a7d-8725-43a3-b007-18d17520f2ae/original/Whomp%27Em.gif
https://cdn.roosterteeth.com/image/upload/t_l/f_auto/2/uploads/images/f9da9a7d-8725-43a3-b007-18d17520f2ae/original/Whomp%27Em.gif
https://cdn.roosterteeth.com/image/upload/t_t/f_auto/2/uploads/images/40e55b47-a5b0-4ac6-bf84-e07f227cb07f/original/Ghosts_%27N_Goblins_-_NES_-_Title.png
https://cdn.roosterteeth.com/image/upload/t_sm/f_auto/2/uploads/images/40e55b47-a5b0-4ac6-bf84-e07f227cb07f/original/Ghosts_%27N_Goblins_-_NES_-_Title.png
https://cdn.roosterteeth.com/image/upload/t_m/f_auto/2/uploads/images/40e55b47-a5b0-4ac6-bf84-e07f227cb07f/original/Ghosts_%27N_Goblins_-_NES_-_Title.png
https://cdn.roosterteeth.com/image/upload/t_l/f_auto/2/uploads/images/40e55b47-a5b0-4ac6-bf84-e07f227cb07f/original/Ghosts_%27N_Goblins_-_NES_-_Title.png
https://cdn.roosterteeth.com/image/upload/t_t/f_auto/2/uploads/images/3be9bf4a-686d-4402-aa76-b43eb1a3e3d8/original/03+Sonic+The+Hedgehog+2.jpg
https://cdn.roosterteeth.com/image/upload/t_sm/f_auto/2/uploads/images/3be9bf4a-686d-4402-aa76-b43eb1a3e3d8/original/03+Sonic+The+Hedgehog+2.jpg
https://cdn.roosterteeth.com/image/upload/t_m/f_auto/2/uploads/images/3be9bf4a-686d-4402-aa76-b43eb1a3e3d8/original/03+Sonic+The+Hedgehog+2.jpg
https://cdn.roosterteeth.com/image/upload/t_l/f_auto/2/uploads/images/3be9bf4a-686d-4402-aa76-b43eb1a3e3d8/original/03+Sonic+The+Hedgehog+2.jpg
https://cdn.roosterteeth.com/image/upload/t_t/f_auto/2/uploads/images/d3ad1342-7a92-482f-b23a-cc6c23911553/original/01+Sonic+The+Hedgehog+1.jpg
https://cdn.roosterteeth.com/image/upload/t_sm/f_auto/2/uploads/images/d3ad1342-7a92-482f-b23a-cc6c23911553/original/01+Sonic+The+Hedgehog+1.jpg
https://cdn.roosterteeth.com/image/upload/t_m/f_auto/2/uploads/images/d3ad1342-7a92-482f-b23a-cc6c23911553/original/01+Sonic+The+Hedgehog+1.jpg
https://cdn.roosterteeth.com/image/upload/t_l/f_auto/2/uploads/images/d3ad1342-7a92-482f-b23a-cc6c23911553/original/01+Sonic+The+Hedgehog+1.jpg
https://cdn.roosterteeth.com/image/upload/t_t/f_auto/2/uploads/images/13003ad2-3bb3-41f4-9897-6779feefcae2/original/Battleship+(U)+[!]+0.jpg
https://cdn.roosterteeth.com/image/upload/t_sm/f_auto/2/uploads/images/13003ad2-3bb3-41f4-9897-6779feefcae2/original/Battleship+(U)+[!]+0.jpg
https://cdn.roosterteeth.com/image/upload/t_m/f_auto/2/uploads/images/13003ad2-3bb3-41f4-9897-6779feefcae2/original/Battleship+(U)+[!]+0.jpg
https://cdn.roosterteeth.com/image/upload/t_l/f_auto/2/uploads/images/13003ad2-3bb3-41f4-9897-6779feefcae2/original/Battleship+(U)+[!]+0.jpg
https://cdn.roosterteeth.com/image/upload/t_t/f_auto/2/uploads/images/9269b55a-af01-4102-af80-16e97aded6d5/original/Track+and+Field+2.jpg
https://cdn.roosterteeth.com/image/upload/t_sm/f_auto/2/uploads/images/9269b55a-af01-4102-af80-16e97aded6d5/original/Track+and+Field+2.jpg
https://cdn.roosterteeth.com/image/upload/t_m/f_auto/2/uploads/images/9269b55a-af01-4102-af80-16e97aded6d5/original/Track+and+Field+2.jpg
https://cdn.roosterteeth.com/image/upload/t_l/f_auto/2/uploads/images/9269b55a-af01-4102-af80-16e97aded6d5/original/Track+and+Field+2.jpg
https://cdn.roosterteeth.com/image/upload/t_t/f_auto/2/uploads/images/76fd2fe3-ed5b-4ab3-bbca-6f32b480a8e1/original/600full-chip-%27n-dale-rescue-rangers-screenshot.jpg
https://cdn.roosterteeth.com/image/upload/t_sm/f_auto/2/uploads/images/76fd2fe3-ed5b-4ab3-bbca-6f32b480a8e1/original/600full-chip-%27n-dale-rescue-rangers-screenshot.jpg
https://cdn.roosterteeth.com/image/upload/t_m/f_auto/2/uploads/images/76fd2fe3-ed5b-4ab3-bbca-6f32b480a8e1/original/600full-chip-%27n-dale-rescue-rangers-screenshot.jpg
https://cdn.roosterteeth.com/image/upload/t_l/f_auto/2/uploads/images/76fd2fe3-ed5b-4ab3-bbca-6f32b480a8e1/original/600full-chip-%27n-dale-rescue-rangers-screenshot.jpg

Derived Files

Listings derived from the Rooster Teeth API and Internet Archive Scrape API. Predominantly for use with the rooster archival script.

Updated every hour at minute 30

  • missing.txt: Rooster Teeth URLs for every video missing from Internet Archive (includes 'dark' uploads)
  • incomplete_urls.csv: Internet Archive and corresponding Rooster Teeth URLs for every video with an incomplete upload to Internet Archive

Updated every 4 hours on the hour

Updated daily at 00:45

  • dark.csv: URLs for every upload removed (i.e. made dark) by Internet Archive.

About

Rooster Teeth website archive tracker and Rooster Teeth API archive

https://shiruken.github.io/rt-archive/


Languages

Language:Python 100.0%