s3

There are 33 repositories under s3 topic.

minio
minio / minio
The Object Store for AI Data Infrastructure
go storage cloud s3 objectstorage cloudstorage amazon-s3 cloudnative k8s kubernetes multi-cloud multi-cloud-kubernetes
Language:Go 44182
rclone
rclone / rclone
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
golang go cloud-storage s3 openstack-swift google-drive azure-blob amazon-drive backblaze-b2 sftp ftp rclone hubic dropbox google-cloud-storage onedrive sync fuse-filesystem encryption webdav
Language:Go 43768
seaweedfs
seaweedfs / seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
blob-storage cloud-drive distributed-file-system distributed-storage distributed-systems erasure-coding fuse hadoop-hdfs hdfs kubernetes object-storage posix replication s3 s3-storage seaweedfs tiered-file-system
Language:Go 21040
siyuan
siyuan-note / siyuan
A privacy-first, self-hosted, fully open source personal knowledge management software, written in typescript and golang.
note-taking pkm local-first knowledge-base markdown s3 ocr chatgpt openai notion obsidian evernote pdf notebook webdav self-hosted anki notes-app electron
Language:TypeScript 15791
airbytehq / airbyte
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
bigquery change-data-capture data data-analysis data-collection data-engineering data-integration data-pipeline elt etl java mssql mysql pipeline postgresql python redshift s3 self-hosted snowflake
Language:Python 13979
ceph
ceph / ceph
Ceph is a distributed object, block, and file storage platform
storage software-defined-storage distributed-storage s3 block-storage distributed-file-system object-store nfs highly-available iscsi cloud-storage kubernetes hdfs smb high-performance fuse posix erasure-coding replication nvme-over-fabrics
Language:C++ 13219
thanos
thanos-io / thanos
Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.
cncf go google-cloud-storage hacktoberfest high-availability metrics monitoring observability prometheus prometheus-ha-pairs prometheus-setup s3 storage thanos
Language:Go 12582
donnemartin / awesome-aws
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
aws aws-cli aws-sdk cloud cloud-management cloudformation cloudwatch dynamodb ec2 ecs elasticsearch iam kinesis lambda machine-learning rds redshift route53 s3 serverless
Language:Python 12150
litestream
benbjohnson / litestream
Streaming replication for SQLite.
replication s3 sqlite
Language:Go 9977
juicefs
juicedata / juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
filesystem cloud-native golang redis distributed-systems storage object-storage posix hdfs s3 bigdata go
Language:Go 9795
filestash
mickael-kerjean / filestash
🦄 A modern web client for SFTP, S3, FTP, WebDAV, Git, Minio, LDAP, CalDAV, CardDAV, Mysql, Backblaze, ...
file-manager file-upload ftp-client sftp-client webdav-client webapp dropbox-client google-drive s3-client ftp sftp s3 dropbox emacs webdav file-viewer s3-browser file-sharing filemanager orgmode
Language:JavaScript 9400
drakkan / sftpgo
Fully featured and highly configurable SFTP server with optional HTTP/S, FTP/S and WebDAV support - S3, Google Cloud Storage, Azure Blob
sftp-server go sftp scp git docker prometheus multi-factor-authentication portable proxy-protocol cloud-storage s3 google-cloud-storage ftp-server ftp webdav webdav-server azure-blob data-at-rest-encryption
Language:Go 8101
s3fs-fuse / s3fs-fuse
FUSE-based file system backed by Amazon S3
fuse s3 aws-s3 filesystem cloud-storage fuse-filesystem
Language:C++ 8069
moto
getmoto / moto
A library that allows you to easily mock out tests based on AWS infrastructure.
boto aws ec2 s3
Language:Python 7376
KodExplorer
kalcaddle / KodExplorer
A web based file manager,web IDE / browser based code editor
filemanager file-sharing file-browser file-explorer file-upload collaboration free-software text-editor markdown-editor zip archive docx xlsx s3 ide webdav
Language:PHP 6167
kahing / goofys
a high-performance, POSIX-ish Amazon S3 file system written in Go
aws-s3 azure-blob azure-blob-storage azure-data-lake azure-storage cloud-storage filesystem fuse fuse-filesystem gcs golang google-cloud-storage openstack-swift posix s3 s3-bucket
Language:Go 5035
backup / backup
Easy full stack backup operations on UNIX-like systems.
backup database encryption mongodb mysql postgresql ruby s3 slack
Language:Ruby 4817
s3tools / s3cmd
Official s3cmd repo -- Command line tool for managing S3 compatible storage services (including Amazon S3 and CloudFront).
s3cmd python cli s3 storage-service backup hacktoberfest
Language:Python 4421
awslabs / mountpoint-s3
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
aws filesystem fuse s3
Language:Rust 4002
Replibyte
Qovery / Replibyte
Seed your development database with real data ⚡️
aws backup cloud cloudnative database mongodb mysql postgres postgresql rust rust-lang s3
Language:Rust 3990
wal-e / wal-e
Continuous Archiving for Postgres
archiving azure-blob backup backups blob-store google-cloud-storage openstack-swift pitr postgres postgresql python recovery replication s3
Language:Python 3423
shrinerb / shrine
File Attachment toolkit for Ruby applications
file-upload ruby rack storage attachment filesystem s3 background-jobs direct-upload orm metadata
Language:Ruby 3142
piskvorky / smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
python s3 hdfs webhdfs boto streaming file streaming-data gzip-stream bz2 hacktoberfest
Language:Python 3090
roapi / roapi
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
sql graphql arrow rest-api analytics query columnar rust in-memory-database datafusion blob-storage cloud-native parquet query-frontends datasets static-datasets s3 delta-lake
Language:Rust 3076
wal-g / wal-g
Archival and Restoration for databases in the Cloud
go golang postgresql postgres backup archiving s3 aws aws-s3 azure azure-storage mariadb mysql sqlserver greenplum cloud mongodb redis
Language:Go 3042
0x4447 / 0x4447_product_s3_email
📫 A serverless email server on AWS using S3 and SES
0x4447 s3 s3-bucket aws aws-lambda aws-s3 aws-ses email email-sender free free-email codepipeline s3-email 0x4447-product-s3-email 0x4447-products
3010
cyberduck
iterate-ch / cyberduck
Cyberduck is a libre FTP, SFTP, WebDAV, Amazon S3, Backblaze B2, Microsoft Azure & OneDrive and OpenStack Swift file transfer client for Mac and Windows.
webdav sftp azure openstack-swift google-drive onedrive ftp backblaze-b2 cryptomator google-storage dropbox hubic sharepoint irods cloudfront s3 cyberduck dracoon onedrive-storage onedrive-for-business
Language:Java 2956
aws / aws-sdk-js-v3
Modularized AWS SDK for JavaScript.
aws-sdk aws-sdk-js javascript typescript nodejs dynamodb lambda s3 sns
Language:TypeScript 2851
apache / opendal
Apache OpenDAL: access data freely.
azblob gcs hacktoberfest redis rust s3 storage
Language:Rust 2827
minio / mc
Simple | Fast tool to manage MinIO clusters :cloud:
storage aws-s3 filesystem s3 go tools coreutils aws golang s3-bucket
Language:Go 2692
sa7mon / S3Scanner
Scan for misconfigured S3 buckets across S3-compatible APIs!
aws bugbounty gcp infosec s3 s3scanner
Language:Go 2375
winscp / winscp
WinSCP is a popular free SFTP and FTP client for Windows, a powerful file manager that will improve your productivity. It supports also Amazon S3, FTPS, SCP and WebDAV protocols, as well as copying between two local directories. Power users can automate WinSCP using .NET assembly.
sftp ftp scp webdav s3 ftps winscp ftp-client windows ssh
Language:C 2327
peak / s5cmd
Parallel S3 and local filesystem execution tool.
aws cli filesystem go s3 s5cmd storage
Language:Go 2316
lad
ladjs / lad
Node.js framework made by a former @expressjs TC and @koajs team member. Built for @forwardemail, @spamscanner, @breejs, @cabinjs, and @lassjs.
koa mvc framework nodejs passport bootstrap async-await javascript mongodb redis aws cloudfront s3 react-native boilerplate api ava prettier xo mongoose
Language:JavaScript 2259
minio / minio-go
MinIO Go client SDK for S3 compatible object storage
aws-signature client-sdk cloud fileuploader go libraries minio s3
Language:Go 2256
amazon-archives / aws-mobile-react-native-starter
AWS Mobile React Native Starter App https://aws.amazon.com/mobile
api-gateway aws aws-amplify aws-amplify-react-native cognito dynamodb javascript lambda mobile-hub react-native s3 serverless
Language:JavaScript 2229