HAML-IRL: Overcoming the Imbalanced Record Linkage Problem Using Hybrid Active Machine Learning
Traditional active machine learning (AML) methods employed in Record Linkage (RL) or Entity Resolution (ER) tasks often struggle with model stability, slow convergence, and handling imbalanced data. Our study introduces a novel hybrid Active Machine Learning approach to address RL, overcoming the ch...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Scientific Research Support Fund of Jordan (SRSF) and Princess Sumaya University for Technology (PSUT)
2025-04-01
|
| Series: | Jordanian Journal of Computers and Information Technology |
| Subjects: | |
| Online Access: | http://www.ejmanager.com/fulltextpdf.php?mno=220477 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | Traditional active machine learning (AML) methods employed in Record Linkage (RL) or Entity Resolution (ER) tasks often struggle with model stability, slow convergence, and handling imbalanced data. Our study introduces a novel hybrid Active Machine Learning approach to address RL, overcoming the challenges of limited labeled data and imbalanced classes. By combining and balancing informativeness, which selects record pairs to reduce model uncertainty, and representativeness, which ensures the chosen pairs reflect the overall dataset patterns, our hybrid approach, called Hybrid Active Machine Learning for Imbalanced Record Linkage (HAML-IRL), demonstrates significant advancements.HAML-IRL achieves an average 12% improvement in F1-scores across eleven real-world datasets, including structured, textual, and dirty data, when compared to state-of-the-art AML methods. Our approach also requires up to 60% - 85% fewer labeled samples dependening on the datasets, accelerates model convergence, and offers superior stability across iterations, making it a robust and efficient solution for real-world record linkage tasks. [JJCIT 2025; 11(2.000): 151-169] |
|---|---|
| ISSN: | 2413-9351 2415-1076 |