WKCR radio-ripper

Rips Radio Streams for Brute-Force Podcasting Pleasure

There's this FM radio station in NYC that I love. They broadcast their lovely programs live on the internet, but for legal reasons, cannot offer podcast feeds. So I created this.

This solution does the following:

scrapes the schedules of all programs and parses them.
outputs the necessary crontab entries to record your favorite shows at the right times (in your timezone).
uses streamripper to capture live streams as individual mp3 files, and mp3wrap to join multiple mp3s together.
manages the files
creates a private podcast RSS feed of your favorite program(s)

The final podcast file and MP3 folder structure can be made available on a web server, and added to iTunes (or any other podcasting app) for your private listening pleasure.

Installation

I suggest you put this on a private server somewhere, but you might want to run it on a local machine. The requirements are simply: a persistent internet connection, and a locally-accessible folder that is served by a web server.

Note: right now, recording only works on a linux host with cron. Scheduling on OSX is still to be worked out.

Requirements

rvm
ruby 2.0

Install Dependencies

This solution uses streamripper to record mp3 radio feeds, and mp3wrap to combine several mp3s into one (which happens due to disconnects/reconnects).

(On Debian)

$ aptitude install streamripper mp3wrap

(on OSX using homebrew)

$ brew install streamripper mp3wrap

Prepare

Clone a local copy of this repository via git. Then:

$ cd radio-ripper
$ bundle

Customize

Create a config file and edit it:

$ cp config/settings-example.yml config/settings.yml

Edit the config file. Set up the directories for storing mp3 files and feeds. The setting feed_dir should be a folder served by a web server.

settings:
  cache_dir: ./tmp/cache
  mp3_dir: ./tmp/mp3  # streamripper output
  feed_dir: /var/nginx/myhost.com/html/podcasts/wkcr # webserver dir
  base_url: "http://myhost.com/podcasts/wkcr" # webserver dir public url (keep it private!)
  streamripper: /usr/bin/streamripper
  mp3wrap: /usr/bin/mp3wrap
  pre_roll: 60 # seconds, start recordings early
  post_roll: 120 # seconds, keep recording a bit after
  cache_ttl: 86400 # seconds, used by schedule scraper

Also verify the correct paths to streamripper and mp3wrap.

Favorites

You will want to edit the favorites in the config/settings.yml file, and add the titles of the shows you want to record:

favorites:
  - Hobo's Lullaby
  - The Early Music Show
  - The Moonshine Show

To get a list of available programs:

$ rake wkcr:shows
Jazz 'til Dawn (300m, Jazz)
 🕑 Sun, Nov 24 01:00AM
Morning Ragas (120m, In All Languages)
 🕑 Sun, Nov 24 08:00AM
The Moonshine Show (120m, American Music)
 🕑 Sun, Nov 24 02:00PM
Raag Aur Taal (120m, In All Languages)
 🕑 Sun, Nov 24 07:00PM
Transfigured Night (240m, New Music)
 🕑 Tue, Nov 26 01:00AM, Thu, Nov 28 01:00AM, Sat, Nov 23 02:00AM    
... etc ...

Set Up Scheduled Recordings

The cron task outputs the necessary commands for recording shows. Copy and paste the result into a crontab file.

$ rake wkcr:cron
59 21 * * 6 cd "/Users/foz/src/radio-ripper" && bin/record # Hobo's Lullaby, every Sat at 04:00PM for 120m

29 15 * * 5 cd "/Users/foz/src/radio-ripper" && bin/record # The Early Music Show, every Fri at 09:30AM for 150m

59 15 * * 0 cd "/Users/foz/src/radio-ripper" && bin/record # The Moonshine Show, every Sun at 10:00AM for 120m

NOTE: I have not yet figured out a good way to schedule recording on OSX. Mavericks (10.9) and the new energy saver features make scheduling exact times even harder. Looking for ideas...

Other Utilities

On OSX, there is a shortcut to tune into WKCR using VLC:

$ rake wkcr:listen

To display the currently broadcast show:

$ rake wkcr:current
Afternoon Classical       Thu, Nov 28 03:00PM 180m

To start an interactive console session:

$ rake console

Notes

The web scraper process employs a local disk cache, as to not be greedy. The default cache expiration is 1 day.

Dates are kept in the America/New York timezone, and converted to local time for the scheduling of recordings.

Pull requests are welcome. Open an issue with any ideas you may have.

TODO

Automatically install dependencies
Automatically create/update cron jobs
Support scheduling on OSX via launchd
Create RSS feeds and subscription page
Support other stations (considering WNYU or WBAI for some other favorites), and maybe a generic way to add favorites by time/url.
Tests. This was written in a fury of hacking, with disregard for proper TDD. Tisk.

Support WKCR

WKCR is a legendary FM broadcaster at Columbia University. Please consider donating to this important station, one of the few remaining in the USA that plays incredible jazz and classical, and employs real DJs who know what they are talking about. Really, the programming is outstanding. They are completely listener-supported.

Disclaimer

All contents are open-source, unlicensed, and unsupported. Enjoy, share, and realize that I offer no warranty or claim to anything you see here.

Also be aware, that you should not use this to create a public feed of WKCR programs. If they wanted this to happen, they would offer it themselves. This program is intended to be used for private recording and entertainment purposes. The moment you publish your recordings or feed, you are most probably breaking the law!

And Finally...

When I was a kid I recorded the radio on cassette tapes. Later on, I used RadioShift, from Rouge Amoeba to record my favorite internet streams. That program never quite reached a good point of polish, and was discontinued in 2011. Eventually I realized this could be done without too much effort using a few tools and Ruby.

Overall, this app took about 8 hours of time to complete. Not bad for the result: I can listen to my favorite WKCR programs on the train or at home. And despite the time difference and changing broadcast schedules, I can be reasonably sure the recordings are correct. Bliss!

somebox / radio-ripper