PANews reported on February 28 that according to DeepSeek’s announcement, on the fifth day of Open Source Week, its Fire-Flyer file system (3FS) was officially open sourced. As a high-performance parallel file system, 3FS can make full use of modern SSDs and RDMA networks to achieve high-speed data access and improve the efficiency of AI model training and reasoning.
3FS Key Performance Indicators:
Achieved 6.6 TiB/s total read throughput in a 180-node cluster;
Achieved 3.66 TiB/minute throughput on a 25-node GraySort benchmark;
The peak query throughput of a single-node KVCache exceeds 40+ GiB/s.
3FS adopts a separate architecture, supports data preprocessing, data set loading, checkpoint storage/recovery, embedded vector search and reasoning KVCache query, and has strong consistency semantics. DeepSeek simultaneously launched the Smallpond data processing framework to further optimize 3FS data management capabilities.
