Floyd 中文
Floyd is an C++ library based on Raft consensus protocol.
- Raft is a consensus algorithm which is easy to understand;
- Floyd is an library that could be easily embeded into users' application;
- Floyd support consistency between cluster nodes by APIs like Read/Write/Delete;
- Also we support direct access to data without consistency: DirtyRead/DirtyWrite;
- Also some query and debug managment APIs： GetLeader/GetServerStatus/set_log_level
- Floyd has provided high available store for Meta cluster of Zeppelin , which is a huge distributed key-value storage.
- The list will goes on.
When we want to coordinate services, ZooKeeper is always a good choice.
- But we have to maintain another service.
- We must use its' SDK at the same time.
In our opion, a single service is much more simple than two services. As a result, an embeded library could be a better choice.
- APIs and usage
| type | API | Status |
|---|---|---|
| Consensus | Read | support |
| Consensus | Write | support |
| Consensus | Delete | support |
| Local | DirtyRead | support |
| Local | DirtyWrite | support |
| Query | GetLeader | support |
| Query | GetServerStatus | support |
| Debug | set_log_level | support |
- Raft fetaures
| Language | Leader election + Log Replication | Membership Changes | Log Compaction |
|---|---|---|---|
| C++ | Yes | No | No |
-
Dependencies
-
Get source code and submodules recursively.
git clone --recursive https://github.com/Qihoo360/floyd.git- Compile and get the libfloyd.a library
make
Then right now there is three examples in the example directory, go and compile in the corresponding directory
contains many cases wrapped floyd into small example
Get all simple example will make command, then every example will start floyd with five node
make
- t is a single thread wirte tool to get performance
- t1 is multi thread program to get performance, in this case, all the writes is from the leader node
- t2 is an example test node join and leave
- t4 is an example used to see the message passing by each node in a stable situation
- t5 used to test single mode floyd, including starting a node and writing data
- t6 is the same as t1 except that all the writes is from the follower node
- t7 test write 3 node and then join the other 2 node case
raftis is a consensus server with 5 nodes and supporting redis protocol(get/set command). raftis is an example of building a consensus cluster with floyd(floyd is a simple implementation of raft protocol). It's very simple and intuitive. we can test raftis with redis-cli, benchmark with redis redis-benchmark tools.
compile raftis with command make and then start with run.sh
make && sh run.sh
#!/bin/sh
# start with five node
./output/bin/raftis "127.0.0.1:8901,127.0.0.1:8902,127.0.0.1:8903,127.0.0.1:8904,127.0.0.1:8905" "127.0.0.1" 8901 "./data1/" 6379 &
./output/bin/raftis "127.0.0.1:8901,127.0.0.1:8902,127.0.0.1:8903,127.0.0.1:8904,127.0.0.1:8905" "127.0.0.1" 8902 "./data2/" 6479 &
./output/bin/raftis "127.0.0.1:8901,127.0.0.1:8902,127.0.0.1:8903,127.0.0.1:8904,127.0.0.1:8905" "127.0.0.1" 8903 "./data3/" 6579 &
./output/bin/raftis "127.0.0.1:8901,127.0.0.1:8902,127.0.0.1:8903,127.0.0.1:8904,127.0.0.1:8905" "127.0.0.1" 8904 "./data4/" 6679 &
./output/bin/raftis "127.0.0.1:8901,127.0.0.1:8902,127.0.0.1:8903,127.0.0.1:8904,127.0.0.1:8905" "127.0.0.1" 8905 "./data5/" 6779 &
└─[$] ./src/redis-benchmark -t set -n 1000000 -r 100000000 -c 20
====== SET ======
1000000 requests completed in 219.76 seconds
20 parallel clients
3 bytes payload
keep alive: 1
0.00% <= 2 milliseconds
0.00% <= 3 milliseconds
8.72% <= 4 milliseconds
95.39% <= 5 milliseconds
95.96% <= 6 milliseconds
99.21% <= 7 milliseconds
99.66% <= 8 milliseconds
99.97% <= 9 milliseconds
99.97% <= 11 milliseconds
99.97% <= 12 milliseconds
99.97% <= 14 milliseconds
99.97% <= 15 milliseconds
99.99% <= 16 milliseconds
99.99% <= 17 milliseconds
99.99% <= 18 milliseconds
99.99% <= 19 milliseconds
99.99% <= 26 milliseconds
99.99% <= 27 milliseconds
100.00% <= 28 milliseconds
100.00% <= 29 milliseconds
100.00% <= 30 milliseconds
100.00% <= 61 milliseconds
100.00% <= 62 milliseconds
100.00% <= 63 milliseconds
100.00% <= 63 milliseconds
4550.31 requests per second
A simple consensus kv example contain server and client builded with floyd
- email: g-infra-bada@360.cn
- QQ Group: 294254078
- WeChat public: 360基础架构组