Use OpenAI API to do entity extraction of all the songs from this huge Reddit thread (25k replies) and create a Spotify playlist with ~1000+ songs
- Use Reddit PRAW API to download all the comments (with Reddit API key)
- Use OpenAI API with a prompt like, extract all the songs from this text to CSV (with OpenAI API key). Made a couple of followup prompts to fix spelling, dedupe, cleanup.
- Use Spotify API with Spotipy to make a playlist (with Spotify API key)
- Needed a bit of scrubbing, but about 1 day of work, wouldn't have been possible to do a 1000-song playlist manually without a team of Mechanical Turks or something
To run the Jupyter notebook you will need to sign up for those 3 APIs, and put IDs and secrets in a .env file similar to dot-env-template.
ChatGPT sometimes does really well, for instance this extracts 4 good CSV records:
Gordon is an amazing poet and so versatile. Il"If You Could Read My Mind," "Early Morning Rain," Old Dan's Records," "Don Quixote," and of course, "The Wreck of the Edmund Fitzgerald" are all so different but so good.
also handles " Smaointe" is beautiful too. in the context of an Enya conversation.
also handles The Killers do a pretty fantastic version of this tune as well. Around the release of "Sam's Town" they recorded a few tracks at Abbey Road studios that were eventually dropped as B-sides and a cover of this song was one of them. in the context of Romeo and Juliet, by Dire Straits
But sometimes it hallucinates, Mrs. Robinson ended up in the playlist but it's nowhere in the thread. Possibly ChatGPT just thought it should be there. (not wrong probably).
Note that all of this is at a temperature of 0, so ChatGPT should not get super creative.
Spotify search API is pretty wonky, doesn't like apostrophes, maybe they need to be escaped, sometimes returns covers and karaoke versions instead of well known songs.
Top 20 tracks below.
| score | artist | track |
|---|---|---|
| 22150 | Claude Debussy | Clair de Lune |
| 11123 | Simon & Garfunkel | Scarborough Fair |
| 8900 | Beatles | In my Life |
| 8272 | The Cranberries | Dreams |
| 7568 | Erik Satie | Gymnopédies |
| 7025 | Israel Kamakawiwoole | Over the Rainbow |
| 5379 | Neil Young | Harvest Moon |
| 4871 | Jim Croce | Time in a Bottle |
| 4241 | Elton John | Your Song |
| 4208 | Mazzy Star | Fade into you |
| 4202 | Sigur Rós | Hoppipolla |
| 4144 | Fleetwood Mac | Landslide |
| 3859 | Don McLean | Vincent (Starry, Starry Night) |
| 3778 | The Beach Boys | God Only Knows |
| 3352 | Lord Huron | The night we met |
| 3198 | Édith Piaf | La Vie en Rose |
| 2993 | John Denver | Annie’s Song |
| 2700 | The Righteous Brothers | Unchained Melody |
| 2655 | Fleet Foxes | White Winter Hymnal |
| 2492 | Joni Mitchell | Both Sides Now |