s3-storage

There are 24 repositories under s3-storage topic.

• seaweedfs

  seaweedfs / seaweedfs

  SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

  distributed-storagedistributed-systemss3hdfsfusedistributed-file-systemhadoop-hdfsposixtiered-file-systemkubernetesreplicationobject-storages3-storageseaweedfserasure-codingblob-storagecloud-drive
  Language:Go 21221

• truenas / middleware

  TrueNAS CORE/Enterprise/SCALE Middleware Git Repository

  storagescalefreenaszfssmbiscsinfss3-storagetruenas
  Language:Python 2214

• TileDB-Inc / TileDB

  The Universal Storage Engine

  tiledbarraysstorage-enginescientific-computingdata-analysishdfss3s3-storagedata-sciencesparse-datadense-datadataframessparse-arrays
  Language:C++ 1774
• cloudserver

  scality / cloudserver

  Zenko CloudServer, an open-source Node.js implementation of the Amazon S3 protocol on the front-end and backend storage capabilities to multiple clouds, including Azure and Google.

  aws-s3dockermultiple-backendsstorageclouds3-storagecloud-storagecloud-nativeobject-storagenodejsjavascript
  Language:JavaScript 1640

• leo-project / leofs

  The LeoFS Storage System

  leofserlangdistributed-storagedistributed-file-systems3-storages3nfs-servernfsdatalake
  Language:Erlang 1540

• stavro / arc

  :paperclip: Flexible file upload and attachment library for Elixir

  attachmentelixirs3s3-storagestorage
  Language:Elixir 1161

• Forceu / Gokapi

  Lightweight selfhosted Firefox Send alternative without public upload. AWS S3 supported.

  selfhostedself-hosteddownloaduploaderfirefox-sendgolangs3-storagebackblaze-b2ownyourdatadockerssl
  Language:Go 1022

• stefanprodan / mgob

  MongoDB dockerized backup agent. Runs schedule backups with retention, S3 & SFTP upload, notifications, instrumentation with Prometheus and more.

  backupdockerkubernetesmongodbs3-storagesftp
  Language:Go 770

• open-io / oio-sds

  High Performance Software-Defined Object Storage for Big Data and AI, that supports Amazon S3 and Openstack Swift

  storageobject-storagecpythonsoftware-defined-storagelightweightgolangopen-sourceflexibleobjectstorages3-storageopenstack-swift
  Language:Python 646

• Seagate / cortx

  CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

  s3-storagesoftware-defined-storagestoragestorage-apiobject-storageobject-storage-serviceobjectstorageobjectstoreopensourceopen-sourcehacktoberfesthacktoberfest2020cortx-communityinclusivityhackathonss3distributed-systemsdistributed-storagebigdatabig-data
  Language:Jupyter Notebook 631

• okhosting / awesome-storage

  A curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.

  awesomeawesome-listawesome-listsbackupcephcurated-listsencriptionglusterfshigh-availabilitynasnfsredundancyreplications3s3-backups3-buckets3-clients3-storagesanstorage
  615

• MikaAK / s3-plugin-webpack

  Uploads files to s3 after complete

  s3-storageamazonwebpack
  Language:JavaScript 485

• Clivern / Walrus

  🔥 Fast, Secure and Reliable System Backup, Set up in Minutes.

  clivernwalrusbackuprecoverys3s3-storagehigh-availabilitydigitalocean-spacesminio-storageminiohacktoberfest
  Language:Go 477

• awslabs / serverless-photo-recognition

  A collection of 3 lambda functions that are invoked by Amazon S3 or Amazon API Gateway to analyze uploaded images with Amazon Rekognition and save picture labels to ElasticSearch (written in Kotlin)

  amazon-cognitoamazon-api-gatewayamazon-rekognitionlambda-functionsaws-lambdakotlinelasticsearchserverless-photo-recognitionjwtarchitecturepicturekotlin-languageserverlessawsaws-apigatewayaws-s3s3-storage
  Language:Kotlin 382

• cloudyr / aws.s3

  Amazon Simple Storage Service (S3) API Client

  cloudyrawsraws-s3s3s3-storager-packageamazon
  Language:R 376

• operatorai / modelstore

  🏬 modelstore is a Python library that allows you to version, export, and save a machine learning model to your filesystem or a cloud storage provider.

  python-librarymodelstoremachine-learningdata-sciencescikit-learnpytorchtensorflowmlopss3-storagetransformerkeras
  Language:Python 354

• pig-mesh / oss-spring-boot-starter

  兼容S3协议的通用文件存储工具类

  osss3s3-storagespring-boot
  Language:Java 238

• aaronwmorris / indi-allsky

  Software to manage a Linux-based All Sky Camera.

  raspberry-piallsky-cameraastronomytimelapseiot-devicemqtt-protocolopencv-pythons3-storagecloudrest-apicontainersdockermulti-cloudyoutube
  Language:Python 181

• uhussain / WebCrawlerForOnlineInflation

  Price Crawler - Tracking Price Inflation

  aws-athenasparkpython3s3-storagepandas-dataframeparquet-filescommoncrawlpetabytescalculate-inflation-ratesdash
  Language:Python 171

• ForetagInc / alchemy

  Archived - High performance, realtime BaaS with RBAC, graphing, full text search, S3 / B2 Storage and GIS with a GraphQL, gRPC and REST API

  databaseormgisfull-text-searchgraphgraphqlrest-apiarangodbs3-storagedata-engineaccess-controlapiautomatic-apialchemy
  Language:Rust 167

• hemberg-lab / scRNA.seq.datasets

  Collection of public scRNA-Seq datasets used by our group

  awsdatasetdockerjenkinsmkdocsopenstacks3-storagesingle-cell
  Language:R 161

• amol- / depot

  Toolkit for storing files and attachments in web applications

  file-uploadpythonwebdevelopments3s3-storagegridfsmongodbsqlachemytestinginmemory
  Language:Python 156

• mortensteenrasmussen / docker-registry-manifest-cleanup

  Cleans up docker registry by removing untagged manifests from the registry

  docker-registrydisk-spacedockercleanupdeletedisk-usages3s3-storageharbor
  Language:Python 146

• maxisam / mgob

  MongoDB dockerized backup agent. Runs schedule backups with retention, S3 & SFTP upload, notifications, instrumentation with Prometheus and more.

  backupmongodbkubernetesdockers3-storage
  Language:Go 115

• upciti / wakemeops

  A Debian repository for portable applications

  packages-managerdebian-packagesbinaryubuntudebians3-storagehostingdevops
  Language:Shell 108

• theriverman / django-minio-backend

  Minio Backend for Django

  djangominiominio-clients3s3-storagepythondjango-minio-backend
  Language:Python 106

• jowilf / sqlalchemy-file

  SQLAlchemy-file is a SQLAlchemy extension for attaching files to SQLAlchemy model and uploading them to various storage such as Local Storage, Amazon S3, Rackspace CloudFiles, Google Storage and others using Apache Libcloud.

  attachmentslibcloudpython3s3-storagesqlalchemysqlmodelazure-storagefile-uploadminio-storage
  Language:Python 79

• lmammino / s3st

  A command line utility that allows you to stream data from multiple S3 objects directly into your terminal

  awsstreamss3s3-buckets3-storagelogscloudtrailcommand-line
  Language:JavaScript 74

• youneshenniwrites / Plush

  Pictures sharing app with Expo, React Native, Apollo GraphQL, and AWS Amplify.

  serverlessaws-amplifys3-storagegraphqlapollo-clientappsync-sdkreact-nativejavascriptexpodynamodbaws-lambdaaws-cloudformationawsmobile-developmentprogramming
  Language:JavaScript 65

• peter-evans / s3-backup

  A GitHub action to mirror a repository to S3 compatible object storage

  backup-utilitygithub-actions3-storage
  Language:Shell 63

• versity / versitygw

  versity s3 gateway

  filesystems3s3-storage
  Language:Go 63

• leroy-merlin-br / action-s3-cache

  Github action to cache dependencies and build outputs to s3 bucket

  github-actionsaws-s3s3-buckets3-storagelinuxwindowsmacos
  Language:Go 62

• alfonsof / aws-python-examples

  Python examples on AWS (Amazon Web Services) using AWS SDK for Python (Boto3). How to manage EC2 instances, Lambda Functions, S3 buckets, etc.

  pythonpython3awsaws-ec2aws-s3aws-lambdalambda-functionss3-bucketamazon-web-servicesec2s3s3-storageec2-instancepython-3s3-bucketsbotoamazon-servicesamazonamazon-s3amazon-lambda
  Language:Python 60

• gladius / spring-boot-digital-ocean-spaces

  DigitalOcean Spaces Integration with Spring boot using AWS S3 java SDK

  springspring-bootjavadigital-ocean-spacesdigitaloceandigital-oceanspacess3s3-storagedigitalocean-spacesdemo
  Language:Java 60

• deis / minio

  Minio Object Storage in Kubernetes, used by Deis Workflow.

  deis-workflowkubernetesk8ss3-storageminiounsupported
  Language:Go 51

• IndustryEssentials / label-free

  LabelFree

  labeling-tools3-storageannotation-toolbounding-boxesdatasetsimage-annotationsegmentationcocodatasetpascal-vocsegment-anything
  50