A hybrid memory trace collection and analysis toolkit for big data applications

The rise of in-memory computing framework represented by Spark,the gradual deepening of new non-volatile memory research and the increasingly severe data security situation made the existing memory behavior analysis tools unable to meet the demand for big data applications.A software-hardware hybrid...

Full description

Saved in:
Bibliographic Details
Main Authors: Zuojun LI, Haiyang PAN, Mingyu CHEN, Yungang BAO
Format: Article
Language:zho
Published: China InfoCom Media Group 2019-07-01
Series:大数据
Subjects:
Online Access:http://www.j-bigdataresearch.com.cn/thesisDetails#10.11959/j.issn.2096-0271.2019031
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The rise of in-memory computing framework represented by Spark,the gradual deepening of new non-volatile memory research and the increasingly severe data security situation made the existing memory behavior analysis tools unable to meet the demand for big data applications.A software-hardware hybrid memory trace collection and analysis toolkit for big data applications was proposed.Based on the basic memory trace collected by hardware,the memory behavior information with rich semantic information can be obtained quickly,accurately and undistorted by combining software information synchronization and offline annotation.It also provides an implementation method for real-time security monitoring of large data access.Finally,a group of real big data applications were analyzed by this toolkit.
ISSN:2096-0271