Comparisons between Resampling Techniques in Linear Regression: A Simulation Study
The classic methods used in estimating the parameters in linear regression need to fulfill some assumptions. If the assumptions are not fulfilled, the conclusion is questionable. Resampling is one of the ways to avoid such problems. The study aims to compare resampling techniques in linear regressio...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Mathematics Department UIN Maulana Malik Ibrahim Malang
2022-10-01
|
| Series: | Cauchy: Jurnal Matematika Murni dan Aplikasi |
| Subjects: | |
| Online Access: | https://ejournal.uin-malang.ac.id/index.php/Math/article/view/14550 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850198703025946624 |
|---|---|
| author | Anwar Fitrianto Punitha Linganathan |
| author_facet | Anwar Fitrianto Punitha Linganathan |
| author_sort | Anwar Fitrianto |
| collection | DOAJ |
| description | The classic methods used in estimating the parameters in linear regression need to fulfill some assumptions. If the assumptions are not fulfilled, the conclusion is questionable. Resampling is one of the ways to avoid such problems. The study aims to compare resampling techniques in linear regression. The original data used in the study is clean, without any influential observations, outliers and leverage points. The ordinary least square method was used as the primary method to estimate the parameters and then compared with resampling techniques. The variance, p-value, bias, and standard error are used as a scale to estimate the best method among random bootstrap, residual bootstrap and delete-one Jackknife. After all the analysis took place, it was found that random bootstrap did not perform well while residual and delete-one Jackknife works quite well. Random bootstrap, residual bootstrap, and Jackknife estimate better than ordinary least square. Is was found that residual bootstrap works well in estimating the parameter in the small sample. At the same time, it is suggested to use Jackknife when the sample size is big because Jackknife is more accessible to apply than residual bootstrap and Jackknife works well when the sample size is big. |
| format | Article |
| id | doaj-art-d86ad2517c854ef28800e522715aeafa |
| institution | OA Journals |
| issn | 2086-0382 2477-3344 |
| language | English |
| publishDate | 2022-10-01 |
| publisher | Mathematics Department UIN Maulana Malik Ibrahim Malang |
| record_format | Article |
| series | Cauchy: Jurnal Matematika Murni dan Aplikasi |
| spelling | doaj-art-d86ad2517c854ef28800e522715aeafa2025-08-20T02:12:49ZengMathematics Department UIN Maulana Malik Ibrahim MalangCauchy: Jurnal Matematika Murni dan Aplikasi2086-03822477-33442022-10-017334535310.18860/ca.v7i3.145506567Comparisons between Resampling Techniques in Linear Regression: A Simulation StudyAnwar Fitrianto0Punitha Linganathan1Department of Statistics, IPB UniversityDepartment of Mathematics Universiti Putra MalaysiaThe classic methods used in estimating the parameters in linear regression need to fulfill some assumptions. If the assumptions are not fulfilled, the conclusion is questionable. Resampling is one of the ways to avoid such problems. The study aims to compare resampling techniques in linear regression. The original data used in the study is clean, without any influential observations, outliers and leverage points. The ordinary least square method was used as the primary method to estimate the parameters and then compared with resampling techniques. The variance, p-value, bias, and standard error are used as a scale to estimate the best method among random bootstrap, residual bootstrap and delete-one Jackknife. After all the analysis took place, it was found that random bootstrap did not perform well while residual and delete-one Jackknife works quite well. Random bootstrap, residual bootstrap, and Jackknife estimate better than ordinary least square. Is was found that residual bootstrap works well in estimating the parameter in the small sample. At the same time, it is suggested to use Jackknife when the sample size is big because Jackknife is more accessible to apply than residual bootstrap and Jackknife works well when the sample size is big.https://ejournal.uin-malang.ac.id/index.php/Math/article/view/14550jackknifelinearregressionresamplingresampling |
| spellingShingle | Anwar Fitrianto Punitha Linganathan Comparisons between Resampling Techniques in Linear Regression: A Simulation Study Cauchy: Jurnal Matematika Murni dan Aplikasi jackknife linear regression resampling resampling |
| title | Comparisons between Resampling Techniques in Linear Regression: A Simulation Study |
| title_full | Comparisons between Resampling Techniques in Linear Regression: A Simulation Study |
| title_fullStr | Comparisons between Resampling Techniques in Linear Regression: A Simulation Study |
| title_full_unstemmed | Comparisons between Resampling Techniques in Linear Regression: A Simulation Study |
| title_short | Comparisons between Resampling Techniques in Linear Regression: A Simulation Study |
| title_sort | comparisons between resampling techniques in linear regression a simulation study |
| topic | jackknife linear regression resampling resampling |
| url | https://ejournal.uin-malang.ac.id/index.php/Math/article/view/14550 |
| work_keys_str_mv | AT anwarfitrianto comparisonsbetweenresamplingtechniquesinlinearregressionasimulationstudy AT punithalinganathan comparisonsbetweenresamplingtechniquesinlinearregressionasimulationstudy |