andrewlee302 / distributed-system

Creative and educational project for distributed system

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Distributed System Course

Go Report Card MIT license GoDoc

The fantastic experiment for education on distributed system, including the ubiquitous communication over the Web, classic techniques for scaling and efficient storage and a popular application case, aims to incredibly capture the essences of the difficult but useful distributed system theory, such as the two-phase protocol and the paxos consensus protocol. It covers the common technique issues almost in all the distributed systems, including communication, data consistency, parallism, concurrence, replication. The techniques take attentions on the performance, fault-tolerance, scaling and user-friendliness, which are important metrics for distributed systems.

Modules or library

  1. HTTP library over TCP and Unix domain socket
  2. 2PC library.
  3. Tiny key-value storage module.
  4. Transcation-supported shopping web service module over the sharded key-value storage.
  5. Paxos library.
  6. Key-value storage module over paxos.
  7. Utility for the resouce pool.
  8. A final system, including web service, sharded and replicated key-value storage.

Testing

Every package has its unit test for functions and performance. (TODO) The final system will be tested in a container-style way.

Tips for students

  1. "// You may add code here". Not necessary, but you can do it.
  2. "// TODO Your code here". Necessary.

About

Creative and educational project for distributed system

License:MIT License


Languages

Language:Go 90.7%Language:Python 8.6%Language:Shell 0.6%