Estimating Models and Evaluating their Efficiency under Multicollinearity in Multiple Linear Regression: A Comparative Study

Multicollinearity between independent variables occurs in multiple linear regression analysis characterized by high correlations, which complicates discerning individual variable effect, impacting model accuracy, stability, and interpretation of relationships. The research aims to diagnose the mult...

Full description

Saved in:
Bibliographic Details
Main Author: Saman Hussein Mahmood
Format: Article
Language:Arabic
Published: Salahaddin University-Erbil 2024-10-01
Series:Zanco Journal of Humanity Sciences
Online Access:https://zancojournal.su.edu.krd/index.php/JAHS/article/view/2278
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Multicollinearity between independent variables occurs in multiple linear regression analysis characterized by high correlations, which complicates discerning individual variable effect, impacting model accuracy, stability, and interpretation of relationships. The research aims to diagnose the multicollinearity problem between explanatory variables in the linear regression model and identifying the variables causing this problem based on the variance inflation factor (VIF), then estimation and evaluate the performance of three alternative methods, which are Ridge regression, principal components analysis, and Feedforward Neural Networks (FFNN) models with one and two hidden layers and application of the models to compressive strength data for high-performance concrete. The results showed that Ridge regression and PCA effectively addressed multicollinearity problem, but the single hidden layer model FFNN showed superior predictive accuracy in estimating the compressive strength of high-performance concrete when comparing RMSE, MAE, and R2 values.
ISSN:2412-396X