Novel Ensemble Approach with Incremental Information Level and Improved Evidence Theory for Attribute Reduction

With the development of intelligent technology, data in practical applications show exponential growth in quantity and scale. Extracting the most distinguished attributes from complex datasets becomes a crucial problem. The existing attribute reduction approaches focus on the correlation between att...

Full description

Saved in:
Bibliographic Details
Main Authors: Peng Yu, Yifeng Zheng, Ziwen Liu, Baoya Wei, Wenjie Zhang, Ziqiong Lin, Zhehan Li
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/27/1/94
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832588491433705472
author Peng Yu
Yifeng Zheng
Ziwen Liu
Baoya Wei
Wenjie Zhang
Ziqiong Lin
Zhehan Li
author_facet Peng Yu
Yifeng Zheng
Ziwen Liu
Baoya Wei
Wenjie Zhang
Ziqiong Lin
Zhehan Li
author_sort Peng Yu
collection DOAJ
description With the development of intelligent technology, data in practical applications show exponential growth in quantity and scale. Extracting the most distinguished attributes from complex datasets becomes a crucial problem. The existing attribute reduction approaches focus on the correlation between attributes and labels without considering the redundancy. To address the above problem, we propose an ensemble approach based on an incremental information level and improved evidence theory for attribute reduction (IILE). Firstly, the incremental information level reduction measure comprehensively assesses attributes based on reduction capability and redundancy level. Then, an improved evidence theory and approximate reduction methods are employed to fuse multiple reduction results, thereby obtaining an approximately globally optimal and a most representative subset of attributes. Eventually, using different metrics, experimental comparisons are performed on eight datasets to confirm that our proposal achieved better than other methods. The results show that our proposal can obtain more relevant attribute sets by using the incremental information level and improved evidence theory.
format Article
id doaj-art-80cae097b2fc44429a5780d0bf6c5e64
institution Kabale University
issn 1099-4300
language English
publishDate 2025-01-01
publisher MDPI AG
record_format Article
series Entropy
spelling doaj-art-80cae097b2fc44429a5780d0bf6c5e642025-01-24T13:31:59ZengMDPI AGEntropy1099-43002025-01-012719410.3390/e27010094Novel Ensemble Approach with Incremental Information Level and Improved Evidence Theory for Attribute ReductionPeng Yu0Yifeng Zheng1Ziwen Liu2Baoya Wei3Wenjie Zhang4Ziqiong Lin5Zhehan Li6School of Computer Science, Minnan Normal University, Zhangzhou 363000, ChinaSchool of Computer Science, Minnan Normal University, Zhangzhou 363000, ChinaSchool of Computer Science, Minnan Normal University, Zhangzhou 363000, ChinaSchool of Computer Science, Minnan Normal University, Zhangzhou 363000, ChinaSchool of Computer Science, Minnan Normal University, Zhangzhou 363000, ChinaSchool of Computer Science, Minnan Normal University, Zhangzhou 363000, ChinaSchool of Computer Science, Minnan Normal University, Zhangzhou 363000, ChinaWith the development of intelligent technology, data in practical applications show exponential growth in quantity and scale. Extracting the most distinguished attributes from complex datasets becomes a crucial problem. The existing attribute reduction approaches focus on the correlation between attributes and labels without considering the redundancy. To address the above problem, we propose an ensemble approach based on an incremental information level and improved evidence theory for attribute reduction (IILE). Firstly, the incremental information level reduction measure comprehensively assesses attributes based on reduction capability and redundancy level. Then, an improved evidence theory and approximate reduction methods are employed to fuse multiple reduction results, thereby obtaining an approximately globally optimal and a most representative subset of attributes. Eventually, using different metrics, experimental comparisons are performed on eight datasets to confirm that our proposal achieved better than other methods. The results show that our proposal can obtain more relevant attribute sets by using the incremental information level and improved evidence theory.https://www.mdpi.com/1099-4300/27/1/94machine learningattribute reductioninformation theoryevidence theory
spellingShingle Peng Yu
Yifeng Zheng
Ziwen Liu
Baoya Wei
Wenjie Zhang
Ziqiong Lin
Zhehan Li
Novel Ensemble Approach with Incremental Information Level and Improved Evidence Theory for Attribute Reduction
Entropy
machine learning
attribute reduction
information theory
evidence theory
title Novel Ensemble Approach with Incremental Information Level and Improved Evidence Theory for Attribute Reduction
title_full Novel Ensemble Approach with Incremental Information Level and Improved Evidence Theory for Attribute Reduction
title_fullStr Novel Ensemble Approach with Incremental Information Level and Improved Evidence Theory for Attribute Reduction
title_full_unstemmed Novel Ensemble Approach with Incremental Information Level and Improved Evidence Theory for Attribute Reduction
title_short Novel Ensemble Approach with Incremental Information Level and Improved Evidence Theory for Attribute Reduction
title_sort novel ensemble approach with incremental information level and improved evidence theory for attribute reduction
topic machine learning
attribute reduction
information theory
evidence theory
url https://www.mdpi.com/1099-4300/27/1/94
work_keys_str_mv AT pengyu novelensembleapproachwithincrementalinformationlevelandimprovedevidencetheoryforattributereduction
AT yifengzheng novelensembleapproachwithincrementalinformationlevelandimprovedevidencetheoryforattributereduction
AT ziwenliu novelensembleapproachwithincrementalinformationlevelandimprovedevidencetheoryforattributereduction
AT baoyawei novelensembleapproachwithincrementalinformationlevelandimprovedevidencetheoryforattributereduction
AT wenjiezhang novelensembleapproachwithincrementalinformationlevelandimprovedevidencetheoryforattributereduction
AT ziqionglin novelensembleapproachwithincrementalinformationlevelandimprovedevidencetheoryforattributereduction
AT zhehanli novelensembleapproachwithincrementalinformationlevelandimprovedevidencetheoryforattributereduction