Research on Technology of Data Storage and Access in High-throughput Simulation

Aiming at the massive data processing requirements of simulation application in the big data environment, the concept and reference structure of high-throughput simulation were proposed and defined in accordance with the architecture and technical characteristics of high-throughput big data computing. For the problem of data access bottleneck in high-throughput simulation, a high-throughput simulation data storage and access system was designed based on distributed memory file system, and the non-volatile memory was integrated to improve the throughput of data access. The experimental results of typical simulation applications show that the high-throughput simulation storage system with distributed memory file system and non-volatile memory can effectively improve the data storage and access performance of high-throughput simulation.