LeoFS is a highly available, distributed, eventually consistent object/blob store. If you are searching a storage system that is able to store huge amount and various kind of files such as photo, movie, log data and so on, LeoFS is suitable for that.
LeoFS is supporting the following features:
- Multi Protocol
- S3-API Support
- LeoFS is an Amazon S3 compatible storage system.
- Switch to LeoFS to decrease your cost from more expensive public-cloud solutions.
- NFS Support
- NFS support was provided from LeoFS v1.1, the current status of which is beta.
- S3-API Support
- Large Object Support
- LeoFS can handle files with more than GB
- Multi Data Center Replication
- LeoFS is a highly scalable, fault-tolerant distributed file system without SPOF.
- LeoFS's cluster can be viewed as ONE-HUGE storage. It consists of a set of loosely connected nodes.
- We can build a global scale storage system with easy operations
We can access LeoFS server using S3 clients and S3 client libries of each programming language.
The presentation - Scaling and High Performance Storage System: LeoFS was given at Erlang User Conference 2014 in Stockholm on June 2014
- LeoFS aims to provide all of 3-HIGHs as follow:
- HIGH Reliability
- Nine nines - Operating ratios is 99.9999999%
- High Scalability
- Build huge-cluster at low cost
- HIGH Cost Performance
- Fast - Over 10Gbps
- A lower cost than other storage
- Provide easy management and easy operation
- HIGH Reliability
LeoFS packages have been already provided on the Web. You're able to easily install LeoFS on your environments.
- LeoProject
- Community
Here is the installation manual.
Here, we explain how to build LeoFS from source code.
First, you have to install the following packages to build Erlang and LeoFS.
## [CentOS]
$ sudo yum install libuuid-devel cmake check check-devel
## [Ubuntu]
$ sudo apt-get install build-essential libtool libncurses5-dev libssl-dev cmake checkThen, install Erlang.
##
## 1. Install libatomic
##
$ wget http://www.hpl.hp.com/research/linux/atomic_ops/download/libatomic_ops-7.2d.tar.gz
$ tar xzvf libatomic_ops-7.2d.tar.gz
$ cd libatomic_ops-7.2d
$ ./configure --prefix=/usr/local
$ make
$ sudo make install
##
## 2. Install Erlang (17.4)
##
$ wget http://www.erlang.org/download/otp_src_17.4.tar.gz
$ tar xzf otp_src_17.4.tar.gz
$ cd otp_src_17.4
$ ./configure --prefix=/usr/local/erlang/17.4 \
--enable-smp-support \
--enable-m64-build \
--enable-halfword-emulator \
--enable-kernel-poll \
--without-javac \
--disable-native-libs \
--disable-hipe \
--disable-sctp \
--enable-threads \
--with-libatomic_ops=/usr/local
$ make
$ sudo make install
##
## 3. Set PATH
##
$ vi ~/.profile
## append the follows:
export ERL_HOME=/usr/local/erlang/17.4
export PATH=$PATH:$ERL_HOME/bin
$ source ~/.profileThen, clone source of LeoFS and libraries from GitHub.
$ git clone https://github.com/leo-project/leofs.git
$ cd leofs
$ git checkout -b develop remotes/origin/develop
$ ./rebar get-deps
$ ./git_checkout.sh developThen, build LeoFS with the following commands.
$ make clean
$ make
$ make releaseNow, you can find the LeoFS package as follow.
$ ls package/
leo_gateway/ leo_manager_0/ leo_manager_1/ leo_storage/ README.mdThen, we can start and access LeoFS with the following commands. Also, you're able to easily operate LeoFS with leofs-adm script.
$ package/leo_manager_0/bin/leo_manager start
$ package/leo_manager_1/bin/leo_manager start
$ package/leo_storage/bin/leo_storage start
$ package/leo_gateway/bin/leo_gateway start
$ ./leofs-adm status
[System config]
System version : 1.0.0
Cluster Id : leofs_1
DC Id : dc_1
Total replicas : 1
# of successes of R : 1
# of successes of W : 1
# of successes of D : 1
# of DC-awareness replicas : 0
ring size : 2^128
Current ring hash : 941f20fc
Prev ring hash : 000000-1
[Multi DC replication settings]
max # of joinable DCs : 2
# of replicas a DC : 1
[Node(s) state]
-------+--------------------------+--------------+----------------+----------------+----------------------------
type | node | state | current ring | prev ring | updated at
-------+--------------------------+--------------+----------------+----------------+----------------------------
S | storage_0@127.0.0.1 | attached | | | 2014-04-16 10:09:59 +0900
$ ./leofs-adm start
OK
$ ./leofs-adm status
[System config]
System version : 1.0.0
Cluster Id : leofs_1
DC Id : dc_1
Total replicas : 1
# of successes of R : 1
# of successes of W : 1
# of successes of D : 1
# of DC-awareness replicas : 0
ring size : 2^128
Current ring hash : 941f20fc
Prev ring hash : 941f20fc
[Multi DC replication settings]
max # of joinable DCs : 2
# of replicas a DC : 1
[Node(s) state]
-------+--------------------------+--------------+----------------+----------------+----------------------------
type | node | state | current ring | prev ring | updated at
-------+--------------------------+--------------+----------------+----------------+----------------------------
S | storage_0@127.0.0.1 | running | 941f20fc | 941f20fc | 2014-04-16 10:09:59 +0900
G | gateway_0@127.0.0.1 | running | 941f20fc | 941f20fc | 2014-04-16 10:09:59 +0900
You can easily build a LeoFS cluster.
Please refer here.
About the configuration of LeoFS, please refer here.
You can benchmark LeoFS with Basho Bench.
Here is a documentation to benchmark LeoFS.
We're able to easily check LeoFS with leofs_test whether LeoFS has issues or not before getting installed LeoFS in your dev/staging/production environment(s).
- DONE - v1.0 (Nov 2013 - May 2014)
- Multi Data Center Replication
- Increase compatibility S3-APIs#5
- Other bucket operations
- DONE - v1.1
- NFS Support (Alpha)
- Improve Web GUI Console (Option)
- DONE - v1.2
- NFS Support (Beta-1)
- Watchdog
- Auto-compaction
- On Going - v1.4
- NFS Support (Beta-2)
- Improve performance of the list objects
- Improve Web GUI Console (Option)
- Improve compatibility S3-APIs#6
- Objects Expiration into the bucket
- Versioning
- v2.0
- NFS Support (for Production)
- QoS Support (Option)
- Erasure Coding
- Improve compatibility S3-APIs#7
LeoProject/LeoFS is sponsored by Rakuten, Inc. and Rakuten Institute of Technology.