ornicar / bytebin

Fast & lightweight content storage web service.

bytebin

bytebin is a fast & lightweight content storage web service.

You can think of it a bit like a pastebin, except that it accepts any kind of data (not just plain text!). Accordingly, the name 'bytebin' is a portmanteau of "byte" (binary) and "pastebin".

bytebin is:

• fast & (somewhat) lightweight - the focus is on the speed at which HTTP requests can be handled.
  • relatively low CPU usage
  • relatively high memory usage (content is cached in memory, up to a configurable limit)
• standalone - it's just a simple Java app that listens for HTTP requests on a given port.
• efficient - utilises compression to reduce disk usage and network load.
• flexible - supports any content type or encoding. (and CORS too!)
• easy to use - simple HTTP API and a minimal HTML frontend.

I host a public instance of bytebin for some of my own projects, which you are welcome to use too.

There is also a traditional "pastebin" frontend for sharing code/configs/whatever, see lucko/paste for more information.

API usage

Read

• Just send a HTTP GET request to /{key} (e.g. /aabbcc).
  • The content will be returned as-is in the response body.
  • If the content was posted using an encoding other than gzip, the requester must also "accept" it.
  • For gzip, bytebin will automatically uncompress if the client doesn't support compression.

Post

• Send a POST request to /post with the content in the request body.
  • You should also specify Content-Type and User-Agent headers, but this is not required.
• Ideally, content should be compressed with GZIP or another mechanism before being uploaded.
  • Include the Content-Encoding: <type> header if this is the case.
  • bytebin will compress server-side using gzip if no encoding is specified - but it is better (for performance reasons) if the client does this instead.
• A unique key that identifies the content will be returned. You can find it:
  • In the response Location header.
  • In the response body, encoded as JSON - {"key": "aabbcc"}.

Public Instances

I host a public instance at https://bytebin.lucko.me

You can use it in your application as long as:

• you're not malicious
• you don't needlessly spam it
• your usage isn't illegal, infringing copyright or otherwise going to get me into trouble
• you provide a User-Agent header uniquely identifying your application

If you're planning something likely to be super duper popular or use a lot of data (say >5GB per month across all users), then please run it past me first - otherwise, go for it!

If you come across any content which is illegal or infringes on copyright, please get in touch and let me know so I can remove it.

Credits

bytebin uses:

• rapidoid as a web server
• caffeine to cache content & handle rate limits
• guava for byte stream manipulation
• gson to read the config

and plain ol' Java for everything else.

Benchmarks

I haven't bothered doing anything proper, but... rapidoid is pretty fast, and so is caffeine.

The public instance handles approx ~250k requests per day and stores ~850k items at any one time. It doesn't seem to mind or use many resources!

License

MIT, have fun!