Log-Less Metadata Management on Metadata Server for Parallel File Systems
This paper presents a novel metadata management mechanism on the metadata server (MDS) for parallel and distributed file systems. In this technique, the client file system backs up the sent metadata requests, which have been handled by the metadata server, so that the MDS does not need to log metada...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2014-01-01
|
| Series: | The Scientific World Journal |
| Online Access: | http://dx.doi.org/10.1155/2014/813521 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832562603439685632 |
|---|---|
| author | Jianwei Liao Guoqiang Xiao Xiaoning Peng |
| author_facet | Jianwei Liao Guoqiang Xiao Xiaoning Peng |
| author_sort | Jianwei Liao |
| collection | DOAJ |
| description | This paper presents a novel metadata management mechanism on the metadata server (MDS) for parallel and distributed file systems. In this technique, the client file system backs up the sent metadata requests, which have been handled by the metadata server, so that the MDS does not need to log metadata changes to nonvolatile storage for achieving highly available metadata service, as well as better performance improvement in metadata processing. As the client file system backs up certain sent metadata requests in its memory, the overhead for handling these backup requests is much smaller than that brought by the metadata server, while it adopts logging or journaling to yield highly available metadata service. The experimental results show that this newly proposed mechanism can significantly improve the speed of metadata processing and render a better I/O data throughput, in contrast to conventional metadata management schemes, that is, logging or journaling on MDS. Besides, a complete metadata recovery can be achieved by replaying the backup logs cached by all involved clients, when the metadata server has crashed or gone into nonoperational state exceptionally. |
| format | Article |
| id | doaj-art-5c764b2f086b4bf88fedbd881578d9ad |
| institution | Kabale University |
| issn | 2356-6140 1537-744X |
| language | English |
| publishDate | 2014-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | The Scientific World Journal |
| spelling | doaj-art-5c764b2f086b4bf88fedbd881578d9ad2025-02-03T01:22:14ZengWileyThe Scientific World Journal2356-61401537-744X2014-01-01201410.1155/2014/813521813521Log-Less Metadata Management on Metadata Server for Parallel File SystemsJianwei Liao0Guoqiang Xiao1Xiaoning Peng2College of Computer and Information Science, Southwest University of China, Beibei, Chongqing 400715, ChinaCollege of Computer and Information Science, Southwest University of China, Beibei, Chongqing 400715, ChinaHuaiHua College of Computer Science and Technology, Huaihua, Hunan 418008, ChinaThis paper presents a novel metadata management mechanism on the metadata server (MDS) for parallel and distributed file systems. In this technique, the client file system backs up the sent metadata requests, which have been handled by the metadata server, so that the MDS does not need to log metadata changes to nonvolatile storage for achieving highly available metadata service, as well as better performance improvement in metadata processing. As the client file system backs up certain sent metadata requests in its memory, the overhead for handling these backup requests is much smaller than that brought by the metadata server, while it adopts logging or journaling to yield highly available metadata service. The experimental results show that this newly proposed mechanism can significantly improve the speed of metadata processing and render a better I/O data throughput, in contrast to conventional metadata management schemes, that is, logging or journaling on MDS. Besides, a complete metadata recovery can be achieved by replaying the backup logs cached by all involved clients, when the metadata server has crashed or gone into nonoperational state exceptionally.http://dx.doi.org/10.1155/2014/813521 |
| spellingShingle | Jianwei Liao Guoqiang Xiao Xiaoning Peng Log-Less Metadata Management on Metadata Server for Parallel File Systems The Scientific World Journal |
| title | Log-Less Metadata Management on Metadata Server for Parallel File Systems |
| title_full | Log-Less Metadata Management on Metadata Server for Parallel File Systems |
| title_fullStr | Log-Less Metadata Management on Metadata Server for Parallel File Systems |
| title_full_unstemmed | Log-Less Metadata Management on Metadata Server for Parallel File Systems |
| title_short | Log-Less Metadata Management on Metadata Server for Parallel File Systems |
| title_sort | log less metadata management on metadata server for parallel file systems |
| url | http://dx.doi.org/10.1155/2014/813521 |
| work_keys_str_mv | AT jianweiliao loglessmetadatamanagementonmetadataserverforparallelfilesystems AT guoqiangxiao loglessmetadatamanagementonmetadataserverforparallelfilesystems AT xiaoningpeng loglessmetadatamanagementonmetadataserverforparallelfilesystems |