distributed-storage

There are 68 repositories under distributed-storage topic.

• seaweedfs

  seaweedfs / seaweedfs

  SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

  blob-storagecloud-drivedistributed-file-systemdistributed-storagedistributed-systemserasure-codingfusehadoop-hdfshdfskubernetesobject-storageposixreplications3s3-storageseaweedfstiered-file-system
  Language:Go 22982
• ceph

  ceph / ceph

  Ceph is a distributed object, block, and file storage platform

  block-storagecloud-storagedistributed-file-systemdistributed-storageerasure-codingfusehdfshigh-performancehighly-availableiscsikubernetesnfsnvme-over-fabricsobject-storeposixreplications3smbsoftware-defined-storagestorage
  Language:C++ 14238

• lni / dragonboat

  A feature complete and high performance multi-group Raft library in Go.

  consensusdistributed-consensusdistributed-storagedistributed-systemsgogolangpaxosraftraft-algorithmraft-protocolreplicated-state-machines
  Language:Go 5086

• cubefs / cubefs

  cloud-native distributed storage

  distributed-storagecncfkubernetescloud-storageerasure-codinghybrid-cloudai-native-storageobject-storagecloud-native-storagedistributed-file-systemdata-orchestrationfuse
  Language:Go 4680

• baidu / braft

  An industrial-grade C++ implementation of RAFT consensus algorithm based on brpc, widely used inside Baidu to build highly-available distributed systems.

  distributed-consensusdistributed-storageraftraft-consensus-algorithmraft-cppraft-cxxraft-protocolstate-machine-replication
  Language:C++ 3980

• storj / storj

  Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.

  distributeddistributed-storagedistributed-systemsgolangobject-storageopen-sourcestorage
  Language:Go 3004

• zuoyebang / bitalostored

  Bitalostored is a high-performance distributed storage system, core engine based on bitalosdb(self-developed), compatible with Redis protocol.

  databasedistributed-storagehigh-performancekvstorenosqlredisstorage-enginebitalosdb
  Language:Go 2085

• pravega / pravega

  Pravega - Streaming as a new software defined storage primitive

  data-ingestiondistributed-storagereal-time-datastreamingstreaming-data
  Language:Java 1984

• moosefs / moosefs

  MooseFS Distributed Storage – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System / Software-Defined Storage

  software-defined-storageposixfilesystemfile-systemdistributed-file-systemdistributed-storagedistributed-computingfusehigh-availabilitystorageposix-compliantditributed-systemserasure-codingtieringsnapshotsbackupblock-storagedistributed-file-storagefile-storagemedia
  Language:C 1699

• leo-project / leofs

  The LeoFS Storage System

  leofserlangdistributed-storagedistributed-file-systems3-storages3nfs-servernfsdatalake
  Language:Erlang 1555

• eclipse-zenoh / zenoh

  zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.

  networkingprotocolmessagingstorageedge-computingiotroboticsembeddedros2zenohrustdistributed-computingdistributed-storagedistributed-systemsgeo-distributed-storagesnetwork-programmingrust-lang
  Language:Rust 1513

• wenweihu86 / raft-java

  Raft Java implementation which is simple and easy to understand.

  raftraft-protocolraft-consensus-algorithmdistributed-storagedistributed-file-systemraft-javaraft-algorithmraft-consensus
  Language:Java 1190

• eventql / eventql

  Distributed "massively parallel" SQL query engine

  databasesqltimeseriesmppcppcpp11analyticscolumnar-storagestreamingeventqldistributeddistributed-databasedistributed-storagedistributed-sql
  Language:C++ 1179

• sheepdog / sheepdog

  Distributed Storage System for QEMU

  blockdevicecdistributed-storageiscsiiscsi-targetqemuqemu-kvmsoftware-defined-storagestoragevirtualizationvmm
  Language:C 988

• Qihoo360 / huststore

  High-performance Distributed Storage

  architecturebenchmarkredisdatabase-enginenginxmessage-queuedistributed-storage
  Language:C 828

• gojek / awesome-distributed-systems

  Awesome list of distributed systems resources

  awesomeawesome-listcomputer-engineeringcomputer-sciencedistributeddistributed-computingdistributed-databasedistributed-storagedistributed-systems
  817

• daos-stack / daos

  DAOS Storage Stack (client libraries, storage engine, control plane)

  daosdistributed-storagehyperconvergedhyperscalekvstorenvme-storageobject-storepmdksoftware-defined-storagespdkstorage-as-a-service
  Language:C 767

• Seagate / cortx

  CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

  big-databigdatacortx-communitydistributed-storagedistributed-systemshackathonshacktoberfesthacktoberfest2020inclusivityobject-storageobject-storage-serviceobjectstorageobjectstoreopen-sourceopensources3s3-storagesoftware-defined-storagestoragestorage-api
  Language:Jupyter Notebook 626

• douban / gobeansdb

  Distributed object storage server from Douban Inc.

  memcachedkvstoreobject-storagedistributed-storage
  Language:Go 450
• good-karma-kit

  ArchiveBox / good-karma-kit

  😇 A Docker Compose bundle to run on servers with spare CPU, RAM, disk, and bandwidth to help the world. Includes Tor, ArchiveWarrior, BOINC, and more...

  archiveboxarchivewarriorboincdistributed-computingdistributed-storagedockerdocker-composefoldingathomegood-karmai2pinternet-archivingipfskiwixpywbsiastorjtorzimfarm
  319

• diguage / mysql-notes

  MySQL 学习笔记

  mysqlmysql-servermysql-databasedistributed-systemsdistributed-databasedistributed-storagetransaction-managementdistributed-transactions
  Language:Shell 277

• chrislusf / vasto

  A distributed key-value store. On Disk. Able to grow or shrink without service interruption.

  distributed-storagekey-valuerocksdbreplication
  Language:Go 261

• mentalfaculty / LLVS

  Low-Level Versioned Store

  distributed-storageswiftswiftuisyncsynchronization
  Language:Swift 207

• matrixorigin / matrixcube

  Fundamental Building Block for Elastic Storage With Strong Consistency and Reliability

  distributed-systemscloud-nativeconsensusraftpaxosdistributed-storagego
  Language:Go 202

• SUSE / DeepSea

  A collection of Salt files for deploying, managing and automating Ceph.

  cephsaltpythonsoftware-defined-storagedistributed-storagedeployment-system
  Language:Python 161

• zuoyebang / bitalosdb

  Bitalosdb is a high-performance KV storage engine.

  databasedistributed-storagehigh-performancekvstorenosqlstorage-engineio-architecture
  Language:Go 160

• lustre / lustre-release

  Mirror of official Lustre development repository http://git.whamcloud.com/

  filesystemfile-systemhpc-clusterlinux-kernel-moduleposixdistributed-storage
  Language:C 141

• freakmaxi / kertish-dfs

  Kertish-dfs is a simple distributed storage platform, implements file storage on a single distributed computer cluster, and provides interfaces for file/folder handling. Kertish-dfs aims primarily for completely distributed operation without a single point of failure, scalable to the exabyte level.

  data-farmdfsdistributed-file-storagedistributed-file-systemdistributed-storagescalable
  Language:Go 108

• layr-team / Layr

  A decentralized (p2p) file storage system built atop Kademlia DHT that enforces data integrity, privacy, and availability through sharding, proofs of retrievability, redundancy, and encryption, with smart-contract powered incentive scheme

  tcpfile-storagep2pnodejsstreamskademliadhtdecentralized-storagedecentralizeddistributed-systemsdistributed-storageproof-of-retreivalblockchainshardingstellar-networkstellar-lumensblockchain-networkpeer-to-peerp2p-nodesmart-contracts
  Language:JavaScript 94

• ThinkParQ / beegfs

  Public repository for the BeeGFS Parallel File System

  aibeegfsdistributed-storagefile-systemfilesystemhpchpc-clusterposix
  Language:C++ 86

• pitchpoint-solutions / sfs

  The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)

  distributed-file-systemdistributed-storagedistributed-systemselasticsearchjavaobject-storageopenstack-swiftrxjavavertx
  Language:Java 84

• CDDSCLab / DMCL-2018

  电子科技大学分布式存储与计算实验室2018新生学习资料整理

  distributed-systemsdistributed-storageuestc
  Language:JavaScript 79

• zettastor / dbs

  ZettaStor DBS provides enterprise-level business storage solutions with high availability, high performance, easy expansion and easy maintenance for large-scale virtualization, private cloud and container environments.

  clusterdistributed-storagepengyunscalabilitystorage
  75

• aganesan4 / CORDS

  File-system fault injection framework for distributed storage systems

  fault-injectionfilesystemdistributed-storage
  Language:Python 62
• saunafs

  leil-io / saunafs

  SaunaFS is a free-and open source, distributed POSIX file system inspired by Google File System.

  archivingdistributed-file-systemdistributed-storagefault-tolerancehigh-availabilityhigh-performancehigh-performance-computingself-healingself-hosted
  Language:C++ 62

• vesoft-inc / nebula-storage

  A distributed consistent graph storage. This is an archived repo for v2.5 only, from 2.6.0 +, NebulaGraph switched back to https://github.com/vesoft-inc/nebula

  graph-databasegraph-storagedistributed-storagenebula-graph
  Language:C++ 58