<aside> <img src="/icons/info-alternate_green.svg" alt="/icons/info-alternate_green.svg" width="40px" />

Developed a simplified implementation of the Google File System (GFS), one of the most influential distributed storage systems in modern computing. This project provided hands-on experience with distributed system design principles, fault tolerance mechanisms, and large-scale data management challenges.

</aside>

Architecture & Design

• Master-Slave Architecture: Implemented the core GFS design with a single master node managing metadata and multiple chunkservers handling data storage
• Chunk-based Storage: Designed a system that splits files into fixed-size chunks (64MB) distributed across multiple storage nodes
• Metadata Management: Created a master server responsible for maintaining file system namespace, access control, and chunk location mapping

Technical Implementation

• Network Communication: Built robust client-server and server-server communication protocols using TCP/UDP sockets
• Concurrency Control: Implemented thread-safe operations and proper synchronization mechanisms for concurrent file access
• Data Integrity: Added checksums and validation mechanisms to detect and recover from data corruption
• Logging & Recovery: Created write-ahead logging for metadata operations to ensure system recovery after failures