object-storage

There are 41 repositories under object-storage topic.

• seaweedfs

  seaweedfs / seaweedfs

  SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

  blob-storagecloud-drivedistributed-file-systemdistributed-storagedistributed-systemserasure-codingfusehadoop-hdfshdfskubernetesobject-storageposixreplications3s3-storageseaweedfstiered-file-system
  Language:Go 21219

• parse-community / parse-server

  Parse Server for Node.js / Express

  parse-serverparse-platformmongodbpostgresgraphqlbaasbackendrest-apiobject-storagenodejsgraphql-apimbaasrelaygraphql-servergraphql-relayfile-storagenotificationshacktoberfest
  Language:JavaScript 20646
• juicefs

  juicedata / juicefs

  JuiceFS is a distributed POSIX file system built on top of Redis and S3.

  filesystemcloud-nativegolangredisdistributed-systemsstorageobject-storageposixhdfss3bigdatago
  Language:Go 9859

• cubefs / cubefs

  cloud-native file store

  distributed-storagecncfkubernetescloud-storageerasure-codinghybrid-cloudai-native-storageobject-storagecloud-native-storagedistributed-file-systemdata-orchestrationfuse
  Language:Go 4374

• paradedb / paradedb

  Postgres for Search and Analytics

  aggregationsanalyticsbig-databm25databasedatalakeelasticsearchfull-text-searchhtaphybrid-searchlakehouse-platformmppobject-storageolappostgresqlreal-time-analyticsself-hostedsimilarity-searchsparse-vectorsql
  Language:Rust 4202
• lakeFS

  treeverse / lakeFS

  lakeFS - Data version control for your data lake | Git for data

  data-engineeringdata-versioninggoobject-storagedata-lakeaws-s3data-qualityazure-blob-storagegoogle-cloud-storagegolanggit-for-datalakefsapache-sparkapache-sparksqlhadoop-filesystemdatalakedatalakesdata-version-controlazure-storage
  Language:Go 4095

• storj / storj

  Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.

  distributed-storagedistributed-systemsdistributedstorageobject-storagegolangopen-source
  Language:Go 2870
• cloudserver

  scality / cloudserver

  Zenko CloudServer, an open-source Node.js implementation of the Amazon S3 protocol on the front-end and backend storage capabilities to multiple clouds, including Azure and Google.

  aws-s3dockermultiple-backendsstorageclouds3-storagecloud-storagecloud-nativeobject-storagenodejsjavascript
  Language:JavaScript 1640

• NVIDIA / aistore

  AIStore: scalable storage for AI applications

  object-storagedistributed-shufflemultiple-backendsdeploy-anywhereetl-offloadlinear-scalabilitynetwork-of-clusterssmall-file-datasets
  Language:Go 1113
• nitrite-java

  nitrite / nitrite-java

  NoSQL embedded document store for Java

  nosqlembedded-databasedocumentdbandroidmobile-databasedatabaseobject-storageobject-database
  Language:Java 806

• supabase / storage

  S3 compatible object storage service that stores metadata in Postgres

  postgress3gotrueobject-storage
  Language:TypeScript 667

• open-io / oio-sds

  High Performance Software-Defined Object Storage for Big Data and AI, that supports Amazon S3 and Openstack Swift

  storageobject-storagecpythonsoftware-defined-storagelightweightgolangopen-sourceflexibleobjectstorages3-storageopenstack-swift
  Language:Python 646

• Seagate / cortx

  CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

  s3-storagesoftware-defined-storagestoragestorage-apiobject-storageobject-storage-serviceobjectstorageobjectstoreopensourceopen-sourcehacktoberfesthacktoberfest2020cortx-communityinclusivityhackathonss3distributed-systemsdistributed-storagebigdatabig-data
  Language:Jupyter Notebook 632
• Zenko

  scality / Zenko

  Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.

  multi-cloudaws-s3azure-storagegoogle-cloudscalityobject-storagedocker-swarmzenkohybrid-cloudkuberneteshelmcloud-nativeprometheusgrafanakafkazookeepermongodbredisartesca
  Language:Gherkin 543

• douban / gobeansdb

  Distributed object storage server from Douban Inc.

  memcachedkvstoreobject-storagedistributed-storage
  Language:Go 451

• minio / dsync

  A distributed sync package.

  distributed-locksdistributed-systemsquorumlockingcloud-storageobject-storage
  Language:Go 400

• frugalos / frugalos

  Frugal Object Storage

  rustdistributed-object-storeobject-storage
  Language:Rust 392

• deuxfleurs-org / garage

  (Mirror) S3-compatible object store for small self-hosted geo-distributed deployments. Main repo: https://git.deuxfleurs.fr/Deuxfleurs/garage

  s3object-storagerust
  Language:Rust 372

• Just-Moh-it / Mockoops

  Create 💎 beautiful animations from boring screen recordings within ⏳ seconds

  lambdamockupmockup-generatorobject-storageremotionrenderanimationbrowsercanvaspwareactreactjsscreen-recording
  Language:JavaScript 372

• infinit / infinit

  The Infinit policy-based software-defined storage platform.

  infinitstorageplatformfault-toleranceresiliencedecentralizeddistributedpeer-to-peerkey-valuefilesystemobject-storageblock-devicepoliciesscalabilityfusenfsiscsinbdldaps3
  364

• mosuka / phalanx

  Phalanx is a cloud-native distributed search engine that provides endpoints through gRPC and traditional RESTful API.

  cloud-nativedistributedsearchenginegogolanggrpcrestful-apigossip-protocolobject-storage
  Language:Go 345

• lithops-cloud / lithops

  A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

  pythonbig-datadata-processingmulticloudbig-data-analyticsserverlessdistributedobject-storageparallelkubernetesmultiprocessingcloud-computingserverless-computingserverless-functions
  Language:Python 306

• qinguoyi / osproxy

  对象存储分布式代理(object storage distrbuted proxy)，支持Docker一键部署

  s3object-storageginproxy
  Language:Go 239

• uber-go / dosa

  DOSA is a data object abstraction layer

  storagedosacassandraobject-storageabstraction
  Language:Go 197

• EMCECS / ECS-CommunityEdition

  ECS Community Edition "Free & Frictionless"

  emcecscloudstorageobject-storageansibledellemcobject
  Language:JavaScript 128

• IBM / jupyterlab-s3-browser

  A JupyterLab extension for browsing S3-compatible object storage

  jupyterlab-extensionjupyterlabs3object-storage
  Language:TypeScript 118

• helyim / helyim

  seaweedfs implemented in pure Rust

  cudadpdkerasure-codinghdfsiouringkernel-bypassobject-storagerdmas3spdkwebdav
  Language:Rust 116

• yongman / leto

  A key value storage example powered by hashicorp raft and BadgerDB

  raftredisredis-protocolhashicorpraft-consensus-algorithmraft-protocolraft-exampleraft-goobject-storage
  Language:Go 105

• noobaa / noobaa-operator

  Operator for NooBaa - object data service for hybrid and multi cloud environments :cloud: :wrench:

  crdkubernetesnoobaamulti-cloud-environmentsobject-storageocsopenshiftk8soperatorcli
  Language:Go 98

• golang-design / tgstore

  An encrypted object storage system with unlimited space backed by Telegram.

  unlimited-storagetelegramobject-storageencrypted-storage
  Language:Go 93

• iqiyi / auklet

  Auklet is a high performance storage engine based on Openstack Swift

  distributed-systemsobject-storagehummingbirdopenstack-swiftstorage-engine
  Language:Go 93
• S4

  anthonybudd / S4

  S4 is 100% S3 compatible storage, accessed through Tor and distributed using IPFS.

  s3s4ipfsdockerstorageobject-storagedata
  Language:Shell 92

• thanos-io / objstore

  Go module providing unified interface and efficient clients to work with various object storage providers until like GCS, S3, Azure, SWIFT, COS and more.

  azure-storagegcsminioobject-storages3swift
  Language:Go 87

• allegro / akubra

  Simple solution to keep a independent S3 storages in sync

  amazon-s3amazon-s3-storagecephobject-storages3storagesync
  Language:Go 85

• pitchpoint-solutions / sfs

  The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)

  distributed-storagedistributed-systemsvertxrxjavaelasticsearchopenstack-swiftdistributed-file-systemobject-storagejava
  Language:Java 84

• christianbaun / ossperf

  A lightweight tool for analyzing the performance and data integrity of object-based storage services

  cloudstorage-serviceobject-storageaws-s3cloud-storageperformance-testingshell
  Language:Shell 70