s3

There are 45 repositories under s3 topic.

minio
minio / minio
MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.
amazon-s3 cloud cloudnative cloudstorage go k8s kubernetes multi-cloud multi-cloud-kubernetes objectstorage s3 storage
Language:Go 57937
rclone
rclone / rclone
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
azure-blob azure-blob-storage azure-files backblaze-b2 cloud-storage dropbox encryption ftp fuse-filesystem go golang google-cloud-storage google-drive onedrive openstack-swift rclone s3 sftp sync webdav
Language:Go 53392
siyuan
siyuan-note / siyuan
A privacy-first, self-hosted, fully open source personal knowledge management software, written in typescript and golang.
anki chatgpt deepseek electron evernote knowledge-base local-first markdown note-taking notes-app notion obsidian ocr ollama openai pdf s3 self-hosted webdav
Language:TypeScript 38879
seaweedfs
seaweedfs / seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.
distributed-storage distributed-systems s3 hdfs fuse distributed-file-system hadoop-hdfs posix tiered-file-system kubernetes replication object-storage s3-storage seaweedfs erasure-coding blob-storage cloud-drive
Language:Go 27307
airbytehq / airbyte
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
bigquery change-data-capture data data-analysis data-collection data-engineering data-integration data-pipeline elt etl java mssql mysql pipeline postgresql python redshift s3 self-hosted snowflake
Language:Python 19979
ceph
ceph / ceph
Ceph is a distributed object, block, and file storage platform
storage software-defined-storage distributed-storage s3 block-storage distributed-file-system object-store nfs highly-available iscsi cloud-storage kubernetes hdfs smb high-performance fuse posix erasure-coding replication nvme-over-fabrics
Language:C++ 15695
donnemartin / awesome-aws
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
aws aws-cli aws-sdk cloud cloud-management cloudformation cloudwatch dynamodb ec2 ecs elasticsearch iam kinesis lambda machine-learning rds redshift route53 s3 serverless
Language:Python 13799
thanos
thanos-io / thanos
Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.
prometheus google-cloud-storage high-availability prometheus-ha-pairs thanos s3 storage cncf prometheus-setup go metrics monitoring observability hacktoberfest
Language:Go 13798
filestash
mickael-kerjean / filestash
:file_folder: The Dropbox like web client for SFTP, S3, FTP, WebDAV, Git, Minio, LDAP, CalDAV, CardDAV, Mysql, Backblaze, ...
dwg file-manager file-sharing filemanager ftp git ldap mcp nfs raw s3 sftp smb webdav
Language:JavaScript 12998
litestream
benbjohnson / litestream
Streaming replication for SQLite.
replication s3 sqlite
Language:C 12805
juicefs
juicedata / juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
filesystem cloud-native golang redis distributed-systems storage object-storage posix hdfs s3 bigdata go
Language:Go 12375
drakkan / sftpgo
Full-featured and highly configurable SFTP, HTTP/S, FTP/S and WebDAV server - S3, Google Cloud Storage, Azure Blob
azure-blob cloud-storage data-at-rest-encryption docker ftp ftp-server go google-cloud-storage multi-factor-authentication portable prometheus proxy-protocol s3 scp sftp sftp-server webdav webdav-server
Language:Go 11273
rustfs / rustfs
🚀 RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.
amazon-s3 bigdata cloud-native filesystem minio object-storage objectstorage rust s3
Language:Rust 11078
s3fs-fuse / s3fs-fuse
FUSE-based file system backed by Amazon S3
aws-s3 cloud-storage filesystem fuse fuse-filesystem s3
Language:C++ 9517
moto
getmoto / moto
A library that allows you to easily mock out tests based on AWS infrastructure.
aws boto ec2 s3
Language:Python 8084
automq
AutoMQ / automq
AutoMQ is a diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
apache-kafka cloud cloud-first cloud-native diskless kafka messaging minio minio-storage object-storage s3 serverless streaming
Language:Java 7597
KodExplorer
kalcaddle / KodExplorer
A web based file manager,web IDE / browser based code editor
archive collaboration docx file-browser file-explorer file-sharing file-upload filemanager free-software ide markdown-editor s3 text-editor webdav xlsx zip
Language:PHP 6344
awslabs / mountpoint-s3
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
aws filesystem fuse object-storage s3
Language:Rust 5475
kahing / goofys
a high-performance, POSIX-ish Amazon S3 file system written in Go
s3-bucket s3 posix filesystem aws-s3 cloud-storage golang fuse gcs google-cloud-storage openstack-swift fuse-filesystem azure-storage azure-blob-storage azure-blob azure-data-lake
Language:Go 5455
backup / backup
Easy full stack backup operations on UNIX-like systems.
backup ruby database s3 encryption slack mysql postgresql mongodb
Language:Ruby 4862
s3tools / s3cmd
Official s3cmd repo -- Command line tool for managing S3 compatible storage services (including Amazon S3 and CloudFront).
s3cmd python cli s3 storage-service backup hacktoberfest
Language:Python 4809
apache / opendal
Apache OpenDAL: One Layer, All Storage.
storage s3 rust azblob gcs redis hacktoberfest
Language:Rust 4558
Replibyte
Qovery / Replibyte
Seed your development database with real data ⚡️
aws backup cloud cloudnative database mongodb mysql postgres postgresql rust rust-lang s3
Language:Rust 4359
cyberduck
iterate-ch / cyberduck
Cyberduck is a libre FTP, SFTP, WebDAV, Amazon S3, Backblaze B2, Microsoft Azure & OneDrive and OpenStack Swift file transfer client for Mac and Windows.
webdav sftp azure openstack-swift google-drive onedrive ftp backblaze-b2 cryptomator google-storage dropbox hubic sharepoint irods cloudfront s3 cyberduck dracoon onedrive-storage onedrive-for-business
Language:Java 4027
wal-g / wal-g
Archival and Restoration for databases in the Cloud
archiving aws aws-s3 azure azure-storage backup cloud go golang greenplum mariadb mongodb mysql postgres postgresql redis s3 sqlserver
Language:Go 3781
peak / s5cmd
Parallel S3 and local filesystem execution tool.
aws cli filesystem go s3 s5cmd storage
Language:Go 3720
wal-e / wal-e
Continuous Archiving for Postgres
python backup backups postgresql postgres archiving s3 google-cloud-storage openstack-swift blob-store azure-blob replication recovery pitr
Language:Python 3470
aws / aws-sdk-js-v3
Modularized AWS SDK for JavaScript.
aws-sdk aws-sdk-js javascript typescript nodejs dynamodb lambda s3 sns
Language:TypeScript 3467
pgbackrest / pgbackrest
Reliable PostgreSQL Backup & Restore
archiving azure backup bzip2 checksum database differential gcs gzip incremental lz4 multi-process parallel pgbackrest postgres postgresql restore s3 wal zstd
Language:C 3380
piskvorky / smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
python s3 hdfs webhdfs boto streaming file streaming-data gzip-stream bz2 hacktoberfest
Language:Python 3379
MarSeventh / CloudFlare-ImgBed
Open-source file hosting solution based on CloudFlare (Image hosting/File storage/Cloud drive) / 基于 CloudFlare 的开源文件托管解决方案（图床/文件床/网盘）
cloudflare-pages cloudflare-r2 img imgbed netdisk oss s3 telegram-bot
Language:JavaScript 3366
roapi / roapi
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
sql graphql arrow rest-api analytics query columnar rust in-memory-database datafusion blob-storage cloud-native parquet query-frontends datasets static-datasets s3 delta-lake
Language:Rust 3355
winscp / winscp
WinSCP is a popular free file manager for Windows supporting SFTP, FTP, FTPS, SCP, S3, WebDAV and local-to-local file transfers. A powerful tool to enhance your productivity with a user-friendly interface and automation options like .NET assembly.
ftp ftp-client ftps s3 scp sftp ssh webdav windows winscp
Language:C 3303
shrinerb / shrine
File Attachment toolkit for Ruby applications
attachment background-jobs direct-upload file-upload filesystem metadata orm rack ruby s3 storage
Language:Ruby 3256
minio / mc
Unix like utilities for object store
storage aws-s3 filesystem s3 go tools coreutils aws golang s3-bucket
Language:Go 3250
offen / docker-volume-backup
Backup Docker volumes locally or to any S3, WebDAV, Azure Blob Storage, Dropbox, Google Drive or SSH compatible storage
backup docker docker-compose docker-swarm docker-volume s3 ssh webdav
Language:Go 3091

s3

minio / minio

rclone / rclone

siyuan-note / siyuan

seaweedfs / seaweedfs

airbytehq / airbyte

ceph / ceph

donnemartin / awesome-aws

thanos-io / thanos

mickael-kerjean / filestash

benbjohnson / litestream

juicedata / juicefs

drakkan / sftpgo

rustfs / rustfs

s3fs-fuse / s3fs-fuse

getmoto / moto

AutoMQ / automq

kalcaddle / KodExplorer

awslabs / mountpoint-s3

kahing / goofys

backup / backup

s3tools / s3cmd

apache / opendal

Qovery / Replibyte

iterate-ch / cyberduck

wal-g / wal-g

peak / s5cmd

wal-e / wal-e

aws / aws-sdk-js-v3

pgbackrest / pgbackrest

piskvorky / smart_open

MarSeventh / CloudFlare-ImgBed

roapi / roapi

winscp / winscp

shrinerb / shrine

minio / mc

offen / docker-volume-backup