Leveraging Pre-Built Catalogs and Object-Level Scheduling to Eliminate I/O Bottlenecks in HPC Environments

Leveraging Pre-Built Catalogs and Object-Level Scheduling to Eliminate I/O Bottlenecks in HPC Environments

Modern High-Performance Computing (HPC) environments face mounting challenges due to the shift from large to small file datasets, along with an increasing number of users and parallelized applications. As HPC systems rely on Parallel File Systems (PFS), such as Lustre for data processing, performanc...

Full description

Saved in:
Bibliographic Details
Main Authors: Seoyeong Lee, Junghwan Park, Yoochan Kim, Safdar Jamil, Awais Khan, Seung Woo Son, Jae-Kook Lee, Do-Sik An, Taeyoung Hong, Youngjae Kim
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
HPC
I/O
parallel file system
parallel processing
Online Access:https://ieeexplore.ieee.org/document/10935346/
Tags: Add Tag
No Tags, Be the first to tag this record!

Internet

https://ieeexplore.ieee.org/document/10935346/

Similar Items