hackclub / hackathons-backend

Powering https://hackathons.hackclub.com

Home Page:https://hackathons.hackclub.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Hackathons: Web Archive websites

garyhtou opened this issue · comments

We want to preserve hackathon websites! Generally, these websites tend to be short-lived due maintenance/hosting costs.

We'll still need to figure out the exact way we want to approach this, but here's what I envision at the moment:

  • Use the Wayback Machine's API to archive hackathon websites at a regular interval, until 1 month after the hackathon's end date
  • At a regular interval, crawl all hackathon websites. If a hackathon's website is down, return the archived version's URL in the API (rather than the original URL)