Domain-Invariant Label Propagation With Adaptive Graph Regularization
As an effective machine learning paradigm, domain adaptation (DA) learning aims to enhance the learning performance of the target domain by utilizing other relevant but distinct domain(s) (referred to as the source domain(s)). The existing mainstream methods for DA mainly learn discriminative domain...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10777088/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841533424593010688 |
|---|---|
| author | Yanning Zhang Jianwen Tao Liangda Yan |
| author_facet | Yanning Zhang Jianwen Tao Liangda Yan |
| author_sort | Yanning Zhang |
| collection | DOAJ |
| description | As an effective machine learning paradigm, domain adaptation (DA) learning aims to enhance the learning performance of the target domain by utilizing other relevant but distinct domain(s) (referred to as the source domain(s)). The existing mainstream methods for DA mainly learn discriminative domain-invariant feature representations by combining the “pseudo labels” of the target domain to better achieve knowledge transfer. However, most existing methods alternate the optimization learning of domain-invariant features and the updating of the “pseudo labels” into two different stages, which makes them difficult to achieve optimal learning performance. In order to achieve joint optimization learning of updating the “pseudo labels” and domain-invariant feature representations, a framework of Domain-Invariant Label prOpagation (DILO) with adaptive graph regularization is proposed. By combining semi-supervised knowledge adaptation and label propagation on domain data, DILO jointly optimizes domain-invariant feature representations and target learning tasks in a unified framework, allowing these two objectives to mutually benefit. Specifically, by introducing the concept of soft labels, a joint distribution measurement model is established to simultaneously alleviate both marginal and conditional distribution differences between different domains; constructing an adaptive probability graph model to enhance the robustness of label propagation. Moreover, a robust <inline-formula> <tex-math notation="LaTeX">$\sigma $ </tex-math></inline-formula>-norm is applied to domain joint distribution measurement and inductive learning models to form a unified objective optimization formulation. An effective optimization algorithm is proposed for addressing the optimization problem of DILO. Compared with several representative DA methods, the proposed method achieved better or comparable robustness in adaptation learning on four cross-domain visual datasets. |
| format | Article |
| id | doaj-art-93921c38616a487b89d176787fa2bd1b |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-93921c38616a487b89d176787fa2bd1b2025-01-16T00:01:52ZengIEEEIEEE Access2169-35362024-01-011219072819074510.1109/ACCESS.2024.351088910777088Domain-Invariant Label Propagation With Adaptive Graph RegularizationYanning Zhang0Jianwen Tao1https://orcid.org/0000-0003-1402-4970Liangda Yan2Institute of Artificial Intelligence Application, Ningbo Polytechnic, Ningbo, ChinaInstitute of Artificial Intelligence Application, Ningbo Polytechnic, Ningbo, ChinaSchool of Electronic Information, Zhejiang Business Technology Institute, Ningbo, Zhejiang, ChinaAs an effective machine learning paradigm, domain adaptation (DA) learning aims to enhance the learning performance of the target domain by utilizing other relevant but distinct domain(s) (referred to as the source domain(s)). The existing mainstream methods for DA mainly learn discriminative domain-invariant feature representations by combining the “pseudo labels” of the target domain to better achieve knowledge transfer. However, most existing methods alternate the optimization learning of domain-invariant features and the updating of the “pseudo labels” into two different stages, which makes them difficult to achieve optimal learning performance. In order to achieve joint optimization learning of updating the “pseudo labels” and domain-invariant feature representations, a framework of Domain-Invariant Label prOpagation (DILO) with adaptive graph regularization is proposed. By combining semi-supervised knowledge adaptation and label propagation on domain data, DILO jointly optimizes domain-invariant feature representations and target learning tasks in a unified framework, allowing these two objectives to mutually benefit. Specifically, by introducing the concept of soft labels, a joint distribution measurement model is established to simultaneously alleviate both marginal and conditional distribution differences between different domains; constructing an adaptive probability graph model to enhance the robustness of label propagation. Moreover, a robust <inline-formula> <tex-math notation="LaTeX">$\sigma $ </tex-math></inline-formula>-norm is applied to domain joint distribution measurement and inductive learning models to form a unified objective optimization formulation. An effective optimization algorithm is proposed for addressing the optimization problem of DILO. Compared with several representative DA methods, the proposed method achieved better or comparable robustness in adaptation learning on four cross-domain visual datasets.https://ieeexplore.ieee.org/document/10777088/Domain adaptationmaximum mean discrepancyadaptive graph Laplacianlabel propagation |
| spellingShingle | Yanning Zhang Jianwen Tao Liangda Yan Domain-Invariant Label Propagation With Adaptive Graph Regularization IEEE Access Domain adaptation maximum mean discrepancy adaptive graph Laplacian label propagation |
| title | Domain-Invariant Label Propagation With Adaptive Graph Regularization |
| title_full | Domain-Invariant Label Propagation With Adaptive Graph Regularization |
| title_fullStr | Domain-Invariant Label Propagation With Adaptive Graph Regularization |
| title_full_unstemmed | Domain-Invariant Label Propagation With Adaptive Graph Regularization |
| title_short | Domain-Invariant Label Propagation With Adaptive Graph Regularization |
| title_sort | domain invariant label propagation with adaptive graph regularization |
| topic | Domain adaptation maximum mean discrepancy adaptive graph Laplacian label propagation |
| url | https://ieeexplore.ieee.org/document/10777088/ |
| work_keys_str_mv | AT yanningzhang domaininvariantlabelpropagationwithadaptivegraphregularization AT jianwentao domaininvariantlabelpropagationwithadaptivegraphregularization AT liangdayan domaininvariantlabelpropagationwithadaptivegraphregularization |