pj-mill / distributed-systems

A look at the Apache ZooKeeper coordination service for distributed services including distributed messaging brokers with kafka and a distributed search engine using TF-IDF Algorithm

Project work based on course - Distributed Systems & Cloud Computing with Java by Michael Pogrebinsky

Additional Resources

Apache Zookeeper

Hadoop Zookeeper

Kafka

HAProxy

HAProxy Configuration

Protocol Buffers

MongDB Replication

MongoDB Java Driver

MongoDB Sharding

MongoDB Indexes

Scope

1. Cluster Coordination & Leader Election with Apache Zookeeper
2. Watchers, Triggers & Failure Detection
3. Leader Re-Election (Auto Healing)
4. Scalability & Fault Tolerence
5. Cluster management through Service Registry & Discovery
6. Load Balancing Strategies wityh HAProxy (Static & Dynamic Loading Balancing Algorithms)
7. Message brokers, topics, producers & consumers with Kafka
8. Publish / Subscribe pattern
9. Serialisation / Deserialization with JSON & Protocol Buffers
10. Database sharding and replication with MongoDB

Sample Screenshots

Topic Creation (Kafka)

Producing Messages (Kafka)

Consuming Messages (Kafka)

Fault Tolerence (Kafka)

Search Queries

Search Results