2 min read
Distributed Filesystem Simulator

A Rust-based mini distributed file store simulator that models the core components of large-scale storage systems like the Google File System. It splits files into fixed-size chunks, computes SHA-256 hashes for integrity, applies lossless LZ4 compression, and manages configurable replication across in-memory nodes. Through XOR-based parity recovery, it can simulate node failures and reconstruct missing data.

Featuring a straightforward CLI for putting and getting files across simulated storage nodes, the simulator also demonstrates how data is split into chunks, hashed, and managed via a simple catalog. It lets you run a multi-node cluster locally, benchmark throughput and storage overhead, and log detailed performance metrics.