data-storage

There are 5 repositories under data-storage topic.

• ammarahm-ed / react-native-mmkv-storage

  An ultra fast (0.0002s read/write), small & encrypted mobile key-value storage framework for React Native written in C++ using JSI

  react-nativeasyncstoragemmkv-databasejavaobjective-cstorageandroidiosfast-storagereactnativefastdatabasedata-storagemmapmmkvencryptionreact-native-jsiexpo
  Language:C++ 1500

• fstpackage / fst

  Lightning Fast Serialization of Data Frames for R

  compressiondata-framedata-storager
  Language:R 613

• datalad / datalad

  Keep code, data, containers under control with git and git-annex

  closemberdata-storagedatasetgit-annexpythonusable
  Language:Python 489
• HDF5.jl

  JuliaIO / HDF5.jl

  Save and load data in the HDF5 file format from Julia

  data-storagehacktoberfesthdf5hdf5-binarieshdf5-fileshdf5-libraryjldjuliajulia-languagemat
  Language:Julia 377

• traversc / qs

  Quick serialization of R objects

  rcompressionserializationdata-storageencoding
  Language:C 375

• knoxite / knoxite

  A data storage & backup system

  backupdata-storagehacktoberfestrestoresnapshotvolumes
  Language:Go 277

• JuliaIO / JLD.jl

  Saving and loading julia variables while preserving native types

  juliajld-formathdf5-formatserializerdata-storage
  Language:Julia 273

• karthik / rdrop2

  Dropbox Interface from R

  dropbox-interfacerdata-storage
  Language:R 251
• autotier

  45Drives / autotier

  A passthrough FUSE filesystem that intelligently moves files between storage tiers based on frequency of use, file age, and tier fullness.

  data-storagepassthrough-fuse-filesystemstorage-tierstieredtiered-file-systemtiered-storagetiering
  Language:C++ 226

• Weedshaker / PeerWebSite

  Peer to Peer decentral Web Site hosting at your fingertips! Send full featured HTML (incl. CSS, JS) sites from your browser and attach files eg. videos, audios, images, etc.

  webtorrentpeerwebwebrtcdecentralizedpeer-to-peerp2pipfsjs-ipfsdistributedhostingwebsite-hostingdata-storageencryption-decryptionindie-webindiewebsmall-internetsmol-internetweb3old-internetthe-cyberfreedom-network
  Language:JavaScript 172

• GridProtectionAlliance / openHistorian

  The Open Source Time-Series Data Historian

  time-serieshistoriandata-miningdata-storagedata-stream
  Language:TypeScript 168

• GlitterWare / Passy

  Offline password manager with cross-platform synchronization

  androidappapplicationcross-platformdata-storagedata-storeflutterlinuxpassword-generatorpassword-managerpassword-storewindowsbrowser-extensionchrome-extensionextensionedge-extensionaddonpasswordpasswords
  Language:Dart 123

• marceloboeira / bojack

  🐴 The unreliable key-value store

  bojackcrystaldatabaseredisnosqlrubydata-storagestoragedata-storestorecachedistributed
  Language:Crystal 105

• airscholar / e2e-data-engineering

  An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

  apache-airflowapache-kafkaapache-sparkapache-zookeeperbig-datacassandracontainerizationdata-engineeringdata-pipelinedata-processingdata-storagedockeretl-pipelinepostgresqlreal-time-analytics
  Language:Python 94

• lf-edge / edge-home-orchestration-go

  Home Edge Project in LF Edge - Edge Orchestration for home edge devices to enabling smart home use cases.

  homeedgeedgecomputinglfedgeiotorchestrationcontainerizationdockercluster-computingcontainernodedata-storagerbachikey960raspberry-pihome-iot
  Language:Go 91

• artiomn / NAS

  Scripts and config files for the secure Linux-based multiservice server on ZFS

  nasdata-storagedata-storeserverhome-serversecure-serversecuritydocker-composedockerpersonal-servernextcloudorganizrldaptorrentsletsencryptdnsrobocertdebianlinux
  Language:Python 66

• Jayvardhan-Reddy / Azure-Certification-DP-200

  Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

  azurecertification-prepazure-certificationresourcesdp-200data-engineeringdata-engineerazure-storageazure-servicesdata-storagedata-lakeazure-portalsql-dwazure-databricksazure-data-factoryazure-cosmos-dbpolybaseexam-prepmicrosoft-azurebatch-processing
  62

• pracdata / awesome-open-source-data-engineering

  A curated list of open source tools used in analytical stacks and data engineering ecosystem

  analyticsawesomeawesome-listdatadata-analyticsdata-engineeringdata-integrationdata-lakehousedata-pipelinedata-platformdata-storagedata-warehousedatabasedatalakeetllakehousemlopsobservabilityself-hostedworkflow-engine
  51

• bearframework / bearframework

  An open-source PHP framework. Incredibly lightweight. Powerful enough.

  php-frameworkphpphp7frameworkroutingdata-storageweb-application-framework
  Language:PHP 45

• msdeep14 / DeepDataBase

  A relational database engine using B+ tree indexing

  databasebtree-indexesrelational-databasesbplustreedata-storagesearch-algorithmb-plus-treeindexingcppalgorithmsdevelopmentbplus-treemysql-database
  Language:C++ 41

• khoih-prog / RP2040_SD

  This library enables you to use SPI SD cards with RP2040-based boards such as Nano_RP2040_Connect, RASPBERRY_PI_PICO using either RP2040 Arduino-mbed or arduino-pico core. This SD-Fat v2 can support FAT16, FAT32, exFAT file systems. exFAT supports files larger than 4GB by using uint64_t as file offset.

  rp2040nano-rp2040-connectraspberry-pi-picoarduino-picoarduino-mbedsdfatdata-storagefat16fat32exfatspimbedsd-cardsdrpi-pico
  Language:C++ 31

• mozilla-lockwise / lockbox-datastore

  Experimental Data Storage module for Firefox Lockbox project, not being actively developed

  cryptographydata-storagefirefoxlockboxmozillasecuritystorage
  Language:JavaScript 27

• bitdust-io / public

  BitDust project source codes : official Public Git repository (mirror on GitHub) : https://bitdust.io

  p2pprivacydata-storagecommunicationsnetworkingnetwork-programmingpythontwistedblockchainraideccdhtcryptographystate-machineautomatasrestful-apijsonrpcparallel-pythonasynchronous-programminghacktoberfest
  Language:Python 21

• bitdust-io / devel

  BitDust project source codes development cycle, official Development Git repository (mirror on GitHub) : https://bitdust.io

  p2pstorageprivacydata-storagecommunicationsnetwork-programmingpythontwistedblockchainraiddhtcryptographystate-machineautomatasrestful-apijsonrpcparallel-pythonasynchronous-programmingbitdusthacktoberfest
  Language:Python 20

• khoih-prog / LittleFS_Mbed_RP2040

  Wrapper of LittleFS for Arduino MBED RP2040 boards. This library facilitates your usage of LittleFS for the onboard flash. LittleFS supports power fail safety and high performance

  rp2040nano-rp2040-connectstoragedata-storageraspberry-pi-picolittlefslittlefs-mbedmbedflash-storageposixflashfile-systemfilembed-rp2040picoadestoissiadesto-flash-chipissi-flash-chip
  Language:C++ 20

• AAROC / DevOps

  DevOps code to deploy eScience services

  devopsansibleafricagridclouddata-storagedistributed-computingmiddleware
  Language:Jinja 19

• gbeckers / Darr

  A Python library for numpy arrays that persist on disk in a format that is simple, self-documented and tool-independent, and maximizes universal readability.

  pythondata-sciencesciencedata-storageinteroperabilitynumericarraybsd-3-clausedata-sharingragged-arraymatlabrjulia-languagemathematicamapleidloctavejagged-arrayscilab
  Language:Python 19

• ZorPastaman / Event-Based-Blackboard

  Event Based Blackboard for Unity is a flexible data storage that can contain any count of properties of any type. The properties can be accessed with property names.

  blackboarddata-storageevent-basedflexibleunity
  Language:C# 17

• aureleoules / bitcandle

  Store data on Bitcoin for 350 sats/KB up to 185 KB by using P2SH-P2WSH witness scripts

  bitcoindata-storagep2sh-p2wshsegwit
  Language:Go 15

• gamontal / mongod-starter

  :bug: A menu bar helper for starting your local MongoDB Server.

  mongodhomebrewdata-storagedatabasenosql
  Language:Swift 15

• deverte / awesome-science

  A currated list of awesome scientific software, libraries and services.

  literature-managementscientificmoocsdata-storageawesome-listscienceresearchexperimentdata-processingacademic
  Language:HTML 13

• ivopetkov / object-storage

  A better way to work with files. Metadata available too.

  storagemetadataobject-storagefile-storagedata-storageatomic
  Language:PHP 13

• kevinkhanda / bubba-db

  Graph database developed on Go

  data-storagedatabasedatabase-managementdistributed-databasedistributed-systemsgogolanggraphgraph-algorithmsgraph-databasegraph-mininggraph-traversalgraphdbneo4jnosqlrpc
  Language:Go 13

• krassowski / data-vault

  IPython magic for simple, organized, compressed and encrypted: storage & transfer of files between notebooks.

  ipython-magicjupyter-notebookdata-storagedisk-cachepersistent-storage
  Language:Python 13

• ricmua / nml_bag

  A simple Python package for working with ROS2 bag files

  bagsdatadata-storageros-bagros2ros2-galactic
  Language:Python 12

• MannLabs / alpharaw

  An open-source Python package to unify raw MS data accession and storage.

  data-accessiondata-storagemass-spectrometryraw-data
  Language:Jupyter Notebook 11