Feature Reweighting-Based Factorization Machine for Effective Learning Latent Representation

Factorization machines (FMs) are widely employed as supervised predictors in collaborative recommendation. FMs can efficiently model second-order feature interactions through inner products, which is beneficial for mitigating the negative effects of data sparsity. However, existing research has larg...

Full description

Saved in:
Bibliographic Details
Main Authors: Xiebing Chen, Bilian Chen, Yue Wang, Langcai Cao
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10978851/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849323704806277120
author Xiebing Chen
Bilian Chen
Yue Wang
Langcai Cao
author_facet Xiebing Chen
Bilian Chen
Yue Wang
Langcai Cao
author_sort Xiebing Chen
collection DOAJ
description Factorization machines (FMs) are widely employed as supervised predictors in collaborative recommendation. FMs can efficiently model second-order feature interactions through inner products, which is beneficial for mitigating the negative effects of data sparsity. However, existing research has largely overlooked the potential correlations and attributes among features in FMs. These inherent relationships between features can enhance our understanding and facilitate the modeling of meaningful feature representations. To address this gap and capture intrinsic correlation information in the data, we propose a novel model named Feature Reweighting-based Factorization Machine (FRFM) in this paper. Specifically, we incorporate similarity into FM and quantify the strength of interactions between features using a similarity calculation method based on mutual information. We then introduce a feature reweighting strategy to effectively learn latent representations, ensuring that similar features exhibit comparable first-order weights and second-order embedding vectors based on their similarity. By assigning different weights to different feature pairs, FRFM adeptly captures the potential correlations and attributes among features within the model. Furthermore, FRFM can be seamlessly integrated into other models to enhance their performance. Extensive experiments conducted on six real-world datasets demonstrate the advantages of our proposed FRFM compared to the state-of-the-art methods.
format Article
id doaj-art-33e293a95e7b4d6bb3ac2a0d676bd73e
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-33e293a95e7b4d6bb3ac2a0d676bd73e2025-08-20T03:48:57ZengIEEEIEEE Access2169-35362025-01-0113752047521910.1109/ACCESS.2025.356489510978851Feature Reweighting-Based Factorization Machine for Effective Learning Latent RepresentationXiebing Chen0Bilian Chen1https://orcid.org/0000-0001-5805-072XYue Wang2Langcai Cao3https://orcid.org/0000-0001-6388-1413Department of Automation, Xiamen University, Xiamen, ChinaDepartment of Automation, Xiamen University, Xiamen, ChinaDepartment of Automation, Xiamen University, Xiamen, ChinaDepartment of Automation, Xiamen University, Xiamen, ChinaFactorization machines (FMs) are widely employed as supervised predictors in collaborative recommendation. FMs can efficiently model second-order feature interactions through inner products, which is beneficial for mitigating the negative effects of data sparsity. However, existing research has largely overlooked the potential correlations and attributes among features in FMs. These inherent relationships between features can enhance our understanding and facilitate the modeling of meaningful feature representations. To address this gap and capture intrinsic correlation information in the data, we propose a novel model named Feature Reweighting-based Factorization Machine (FRFM) in this paper. Specifically, we incorporate similarity into FM and quantify the strength of interactions between features using a similarity calculation method based on mutual information. We then introduce a feature reweighting strategy to effectively learn latent representations, ensuring that similar features exhibit comparable first-order weights and second-order embedding vectors based on their similarity. By assigning different weights to different feature pairs, FRFM adeptly captures the potential correlations and attributes among features within the model. Furthermore, FRFM can be seamlessly integrated into other models to enhance their performance. Extensive experiments conducted on six real-world datasets demonstrate the advantages of our proposed FRFM compared to the state-of-the-art methods.https://ieeexplore.ieee.org/document/10978851/Classificationfactorization machinesfeature reweightingmachine learningrecommendation
spellingShingle Xiebing Chen
Bilian Chen
Yue Wang
Langcai Cao
Feature Reweighting-Based Factorization Machine for Effective Learning Latent Representation
IEEE Access
Classification
factorization machines
feature reweighting
machine learning
recommendation
title Feature Reweighting-Based Factorization Machine for Effective Learning Latent Representation
title_full Feature Reweighting-Based Factorization Machine for Effective Learning Latent Representation
title_fullStr Feature Reweighting-Based Factorization Machine for Effective Learning Latent Representation
title_full_unstemmed Feature Reweighting-Based Factorization Machine for Effective Learning Latent Representation
title_short Feature Reweighting-Based Factorization Machine for Effective Learning Latent Representation
title_sort feature reweighting based factorization machine for effective learning latent representation
topic Classification
factorization machines
feature reweighting
machine learning
recommendation
url https://ieeexplore.ieee.org/document/10978851/
work_keys_str_mv AT xiebingchen featurereweightingbasedfactorizationmachineforeffectivelearninglatentrepresentation
AT bilianchen featurereweightingbasedfactorizationmachineforeffectivelearninglatentrepresentation
AT yuewang featurereweightingbasedfactorizationmachineforeffectivelearninglatentrepresentation
AT langcaicao featurereweightingbasedfactorizationmachineforeffectivelearninglatentrepresentation