Change-Point Estimation and Detection for Mixture of Linear Regression Models

This paper studies the estimation and detection problems in the mixture of linear regression models with change point. An improved Expectation–Maximization (EM) algorithm is devised specifically for multi-classified mixture data with change points. Under appropriate conditions, the large-sample prop...

Full description

Saved in:
Bibliographic Details
Main Authors: Wenzhi Zhao, Tian Cheng, Zhiming Xia
Format: Article
Language:English
Published: MDPI AG 2025-05-01
Series:Axioms
Subjects:
Online Access:https://www.mdpi.com/2075-1680/14/6/402
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849435125952020480
author Wenzhi Zhao
Tian Cheng
Zhiming Xia
author_facet Wenzhi Zhao
Tian Cheng
Zhiming Xia
author_sort Wenzhi Zhao
collection DOAJ
description This paper studies the estimation and detection problems in the mixture of linear regression models with change point. An improved Expectation–Maximization (EM) algorithm is devised specifically for multi-classified mixture data with change points. Under appropriate conditions, the large-sample properties of the estimator are rigorously proven. This improved EM algorithm not only precisely locates the change points but also yields accurate parameter estimates for each class. Additionally, a detector grounded in the score function is proposed to identify the presence of change points in mixture data. The limiting distributions of the test statistics under both the null and alternative hypotheses are systematically derived. Extensive simulation experiments are conducted to assess the effectiveness of the proposed method, and comparative analyses with the conventional EM algorithm are performed. The results clearly demonstrate that the EM algorithm without considering change points exhibits poor performance in classifying data, often resulting in the misclassification or even omission of certain classes. In contrast, the estimation method introduced in this study showcases remarkable accuracy and robustness, with favorable empirical sizes and powers.
format Article
id doaj-art-8e63ed938fbe47cb8ec512dc6b2b7c4b
institution Kabale University
issn 2075-1680
language English
publishDate 2025-05-01
publisher MDPI AG
record_format Article
series Axioms
spelling doaj-art-8e63ed938fbe47cb8ec512dc6b2b7c4b2025-08-20T03:26:25ZengMDPI AGAxioms2075-16802025-05-0114640210.3390/axioms14060402Change-Point Estimation and Detection for Mixture of Linear Regression ModelsWenzhi Zhao0Tian Cheng1Zhiming Xia2School of Science, Xi’an Polytechnic University, Xi’an 710048, ChinaSchool of Mathematics, Northwest University, Xi’an 710127, ChinaSchool of Mathematics, Northwest University, Xi’an 710127, ChinaThis paper studies the estimation and detection problems in the mixture of linear regression models with change point. An improved Expectation–Maximization (EM) algorithm is devised specifically for multi-classified mixture data with change points. Under appropriate conditions, the large-sample properties of the estimator are rigorously proven. This improved EM algorithm not only precisely locates the change points but also yields accurate parameter estimates for each class. Additionally, a detector grounded in the score function is proposed to identify the presence of change points in mixture data. The limiting distributions of the test statistics under both the null and alternative hypotheses are systematically derived. Extensive simulation experiments are conducted to assess the effectiveness of the proposed method, and comparative analyses with the conventional EM algorithm are performed. The results clearly demonstrate that the EM algorithm without considering change points exhibits poor performance in classifying data, often resulting in the misclassification or even omission of certain classes. In contrast, the estimation method introduced in this study showcases remarkable accuracy and robustness, with favorable empirical sizes and powers.https://www.mdpi.com/2075-1680/14/6/402change pointmixture of linear regression modelmulti-classificationEM algorithm
spellingShingle Wenzhi Zhao
Tian Cheng
Zhiming Xia
Change-Point Estimation and Detection for Mixture of Linear Regression Models
Axioms
change point
mixture of linear regression model
multi-classification
EM algorithm
title Change-Point Estimation and Detection for Mixture of Linear Regression Models
title_full Change-Point Estimation and Detection for Mixture of Linear Regression Models
title_fullStr Change-Point Estimation and Detection for Mixture of Linear Regression Models
title_full_unstemmed Change-Point Estimation and Detection for Mixture of Linear Regression Models
title_short Change-Point Estimation and Detection for Mixture of Linear Regression Models
title_sort change point estimation and detection for mixture of linear regression models
topic change point
mixture of linear regression model
multi-classification
EM algorithm
url https://www.mdpi.com/2075-1680/14/6/402
work_keys_str_mv AT wenzhizhao changepointestimationanddetectionformixtureoflinearregressionmodels
AT tiancheng changepointestimationanddetectionformixtureoflinearregressionmodels
AT zhimingxia changepointestimationanddetectionformixtureoflinearregressionmodels