Skip to content

Latest commit

 

History

History
79 lines (51 loc) · 1.99 KB

README.md

File metadata and controls

79 lines (51 loc) · 1.99 KB

marmot-reduce

🦫 - A little distributed system (Map Reduce simplified)

Marmot-Reduce is a simplified distributed system inspired by the MapReduce programming model. It allows you to perform distributed computations across multiple clients connected to a server. This project is designed to be educational and fun, providing a hands-on experience with distributed systems and concurrent programming in Go.

Follow the Adventure

All project notes and updates are available in notes.md.

Features

Server

  • Interactive menu to manage operations.
  • Display connected clients in real time.
  • Ping clients to check their availability.
  • Update Distant client, sending new version of client
  • Proper connection management, preventing resource leaks.
  • Distributed execution of calculations:
    • Letter counting in a text.
    • Checking if a number is prime.
    • PI estimation using Monte Carlo algorithm
    • Free fall simulation

Client

  • Persistent connection:
    • If the connection is lost, the client automatically attempts to reconnect.
    • It continues until the server sends an exit message.
    • It can self update himself with new version sent by server

Installation and Execution

Prerequisites

  • Go (1.18 or higher) installed on your machine.

Running the Project

  1. Navigate to the sources directory:

    cd sources

  2. Start the server:

    go run ./ server

  3. Start one or more clients:

    go run ./

How It Works

  1. Start the server: it waits for client connections.
  2. Clients connect: each client registers with the server.
  3. The server can send commands to clients: ping, execute calculations, etc.
  4. Clients respond and return results.
  5. If a client disconnects, it automatically attempts to reconnect.
  6. The server can properly close all connections before shutting down.

License

This project is open-source and licensed under MIT.