Giters

datamade / how-to

📚 Doing all sorts of things, the DataMade way

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Proposal: Switch to R2 for large file hosting

fgregg opened this issue · comments

commented

Proposal: Switch to R2 for file hosting.

R2 is a drop-in replacement for S3 sold by cloudflare.

R2's big advantage is ease of setup, and more particularly ease of setting up access credentials.

R2 does not use IAM's instead, you can create API credentials. Here's what that looks like:

Screenshot 2024-04-08 at 12-28-37 Fgregg@datamade us's Account Cloudflare

Click create gives you credentials that you can use everywhere boto or any other client expects AWS credentials.

Disadvantages

  • The current s3-credentials pattern has already made it a lot easier to set up credentials for s3 then it used to be. Even though r2 is a easier, it may not be a big enough difference.
  • We have a lot of legacy s3 buckets set up which we are not really going to convert. so we will have to use two tools for a long time.