s3

There are 36 repositories under s3 topic.

minio
minio / minio
MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.
go storage cloud s3 objectstorage cloudstorage amazon-s3 cloudnative k8s kubernetes multi-cloud multi-cloud-kubernetes
Language:Go 47053
rclone
rclone / rclone
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
azure-blob azure-blob-storage azure-files backblaze-b2 cloud-storage dropbox encryption ftp fuse-filesystem go golang google-cloud-storage google-drive onedrive openstack-swift rclone s3 sftp sync webdav
Language:Go 46437
seaweedfs
seaweedfs / seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
blob-storage cloud-drive distributed-file-system distributed-storage distributed-systems erasure-coding fuse hadoop-hdfs hdfs kubernetes object-storage posix replication s3 s3-storage seaweedfs tiered-file-system
Language:Go 22433
siyuan
siyuan-note / siyuan
A privacy-first, self-hosted, fully open source personal knowledge management software, written in typescript and golang.
note-taking pkm local-first knowledge-base markdown s3 ocr chatgpt openai notion obsidian evernote pdf notebook webdav self-hosted anki notes-app electron
Language:TypeScript 18865
airbytehq / airbyte
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
bigquery change-data-capture data data-analysis data-collection data-engineering data-integration data-pipeline elt etl java mssql mysql pipeline postgresql python redshift s3 self-hosted snowflake
Language:Python 15717
ceph
ceph / ceph
Ceph is a distributed object, block, and file storage platform
block-storage cloud-storage distributed-file-system distributed-storage erasure-coding fuse hdfs high-performance highly-available iscsi kubernetes nfs nvme-over-fabrics object-store posix replication s3 smb software-defined-storage storage
Language:C++ 13961
thanos
thanos-io / thanos
Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.
cncf go google-cloud-storage hacktoberfest high-availability metrics monitoring observability prometheus prometheus-ha-pairs prometheus-setup s3 storage thanos
Language:Go 13015
donnemartin / awesome-aws
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
aws cloud aws-sdk aws-cli cloudformation cloudwatch dynamodb elasticsearch kinesis lambda serverless machine-learning redshift s3 ec2 iam rds route53 ecs cloud-management
Language:Python 12437
litestream
benbjohnson / litestream
Streaming replication for SQLite.
replication s3 sqlite
Language:Go 10762
juicefs
juicedata / juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
bigdata cloud-native distributed-systems filesystem go golang hdfs object-storage posix redis s3 storage
Language:Go 10636
filestash
mickael-kerjean / filestash
🦄 A file manager / web client for SFTP, S3, FTP, WebDAV, Git, Minio, LDAP, CalDAV, CardDAV, Mysql, Backblaze, ...
ftp ftps git ldap nfs s3 sftp smb webdav
Language:JavaScript 10089
drakkan / sftpgo
Full-featured and highly configurable SFTP, HTTP/S, FTP/S and WebDAV server - S3, Google Cloud Storage, Azure Blob
azure-blob cloud-storage data-at-rest-encryption docker ftp ftp-server git go google-cloud-storage multi-factor-authentication portable prometheus proxy-protocol s3 scp sftp sftp-server webdav webdav-server
Language:Go 9192
s3fs-fuse / s3fs-fuse
FUSE-based file system backed by Amazon S3
aws-s3 cloud-storage filesystem fuse fuse-filesystem s3
Language:C++ 8541
moto
getmoto / moto
A library that allows you to easily mock out tests based on AWS infrastructure.
boto aws ec2 s3
Language:Python 7602
KodExplorer
kalcaddle / KodExplorer
A web based file manager,web IDE / browser based code editor
archive collaboration docx file-browser file-explorer file-sharing file-upload filemanager free-software ide markdown-editor s3 text-editor webdav xlsx zip
Language:PHP 6226
kahing / goofys
a high-performance, POSIX-ish Amazon S3 file system written in Go
aws-s3 azure-blob azure-blob-storage azure-data-lake azure-storage cloud-storage filesystem fuse fuse-filesystem gcs golang google-cloud-storage openstack-swift posix s3 s3-bucket
Language:Go 5180
backup / backup
Easy full stack backup operations on UNIX-like systems.
backup ruby database s3 encryption slack mysql postgresql mongodb
Language:Ruby 4831
s3tools / s3cmd
Official s3cmd repo -- Command line tool for managing S3 compatible storage services (including Amazon S3 and CloudFront).
backup cli hacktoberfest python s3 s3cmd storage-service
Language:Python 4556
awslabs / mountpoint-s3
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
aws filesystem fuse s3
Language:Rust 4478
Replibyte
Qovery / Replibyte
Seed your development database with real data ⚡️
aws backup cloud cloudnative database mongodb mysql postgres postgresql rust rust-lang s3
Language:Rust 4130
automq
AutoMQ / automq
AutoMQ is a cloud-first alternative to Kafka by decoupling durability to S3 and EBS. 10x cost-effective. Autoscale in seconds. Single-digit ms latency.
cloud-native kafka messaging s3 storage streaming cloud cloud-economics ebs minio serverless spot aws azure gcp
Language:Java 3731
wal-e / wal-e
Continuous Archiving for Postgres
archiving azure-blob backup backups blob-store google-cloud-storage openstack-swift pitr postgres postgresql python recovery replication s3
Language:Python 3452
apache / opendal
Apache OpenDAL: access data freely.
azblob gcs hacktoberfest redis rust s3 storage
Language:Rust 3266
cyberduck
iterate-ch / cyberduck
Cyberduck is a libre FTP, SFTP, WebDAV, Amazon S3, Backblaze B2, Microsoft Azure & OneDrive and OpenStack Swift file transfer client for Mac and Windows.
webdav sftp azure openstack-swift google-drive onedrive ftp backblaze-b2 cryptomator google-storage dropbox hubic sharepoint irods cloudfront s3 cyberduck dracoon onedrive-storage onedrive-for-business
Language:Java 3253
wal-g / wal-g
Archival and Restoration for databases in the Cloud
go golang postgresql postgres backup archiving s3 aws aws-s3 azure azure-storage mariadb mysql sqlserver greenplum cloud mongodb redis
Language:Go 3246
roapi / roapi
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
analytics arrow blob-storage cloud-native columnar datafusion datasets delta-lake graphql in-memory-database parquet query query-frontends rest-api rust s3 sql static-datasets
Language:Rust 3188
piskvorky / smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
boto bz2 file gzip-stream hacktoberfest hdfs python s3 streaming streaming-data webhdfs
Language:Python 3181
shrinerb / shrine
File Attachment toolkit for Ruby applications
file-upload ruby rack storage attachment filesystem s3 background-jobs direct-upload orm metadata
Language:Ruby 3176
aws / aws-sdk-js-v3
Modularized AWS SDK for JavaScript.
aws-sdk aws-sdk-js dynamodb javascript lambda nodejs s3 sns typescript
Language:TypeScript 3059
0x4447 / 0x4447_product_s3_email
📫 A serverless email server on AWS using S3 and SES
0x4447 0x4447-product-s3-email 0x4447-products aws aws-lambda aws-s3 aws-ses codepipeline email email-sender free free-email s3 s3-bucket s3-email
3019
minio / mc
Simple | Fast tool to manage MinIO clusters :cloud:
aws aws-s3 coreutils filesystem go golang s3 s3-bucket storage tools
Language:Go 2832
winscp / winscp
WinSCP is a popular free SFTP and FTP client for Windows, a powerful file manager that will improve your productivity. It supports also Amazon S3, FTPS, SCP and WebDAV protocols, as well as copying between two local directories. Power users can automate WinSCP using .NET assembly.
ftp ftp-client ftps s3 scp sftp ssh webdav windows winscp
Language:C 2614
peak / s5cmd
Parallel S3 and local filesystem execution tool.
aws cli filesystem go s3 s5cmd storage
Language:Go 2594
pgbackrest / pgbackrest
Reliable PostgreSQL Backup & Restore
postgresql parallel backup restore archiving multi-process database s3 gzip lz4 checksum zstd bzip2 wal azure incremental differential pgbackrest postgres gcs
Language:C 2528
sa7mon / S3Scanner
Scan for misconfigured S3 buckets across S3-compatible APIs!
aws bugbounty gcp infosec s3 s3scanner
Language:Go 2526
minio / minio-go
MinIO Go client SDK for S3 compatible object storage
aws-signature client-sdk cloud fileuploader go libraries minio s3
Language:Go 2442

s3

minio / minio

rclone / rclone

seaweedfs / seaweedfs

siyuan-note / siyuan

airbytehq / airbyte

ceph / ceph

thanos-io / thanos

donnemartin / awesome-aws

benbjohnson / litestream

juicedata / juicefs

mickael-kerjean / filestash

drakkan / sftpgo

s3fs-fuse / s3fs-fuse

getmoto / moto

kalcaddle / KodExplorer

kahing / goofys

backup / backup

s3tools / s3cmd

awslabs / mountpoint-s3

Qovery / Replibyte

AutoMQ / automq

wal-e / wal-e

apache / opendal

iterate-ch / cyberduck

wal-g / wal-g

roapi / roapi

piskvorky / smart_open

shrinerb / shrine

aws / aws-sdk-js-v3

0x4447 / 0x4447_product_s3_email

minio / mc

winscp / winscp

peak / s5cmd

pgbackrest / pgbackrest

sa7mon / S3Scanner

minio / minio-go