| February 21, 2010 8:00 PM PST | |
by Michael Hebenstreit, Bob Hayes
Although the size of the file system with 3.7 Terabyte is rather small, it’s performance characteristics are impressive. Writing and reading a 50GB file using dd we achieved single rank performance of 1.5GB/s write, 1.3GB/s read. In aggregated multi rank performance using up to 64 clients we achieved up to 17GB/s read and 13GB/s write. The write performance on the Bonnie test confirmed this reaching 12GB/s, while the read tests achieved over 20GB/s. Iozone gave even higher results.
These measurements also reinforce the author’s opinion that benchmarking of Cluster File Systems should be put on a more solid ground as these IO performance results vary widely with the application used, and currently no standard benchmark comparable with Linpack or Stream exists.
Executive summary
The Intel Customer Response Team Data Center (called CRT-DC) located in DuPont/Washington created a high performance cluster file system based on commercial off-the-shelf servers (COTS) and Intel SSD disks. The software stack is based on Redhat Linux, OFED and Lustre.Although the size of the file system with 3.7 Terabyte is rather small, it’s performance characteristics are impressive. Writing and reading a 50GB file using dd we achieved single rank performance of 1.5GB/s write, 1.3GB/s read. In aggregated multi rank performance using up to 64 clients we achieved up to 17GB/s read and 13GB/s write. The write performance on the Bonnie test confirmed this reaching 12GB/s, while the read tests achieved over 20GB/s. Iozone gave even higher results.
These measurements also reinforce the author’s opinion that benchmarking of Cluster File Systems should be put on a more solid ground as these IO performance results vary widely with the application used, and currently no standard benchmark comparable with Linpack or Stream exists.
Download Entire Article
Download Performance characterization Lustre file system based upon Intel Solid State Disks [PDF 406KB]For more complete information about compiler optimizations, see our Optimization Notice.
Comments (0) 
Trackbacks (0)
Leave a comment 
To obtain technical support, please go to Software Support.