Utilizing Statistical Tests for Comparing Machine Learning Algorithms
The mean result of machine learning models is determined by utilizing k-fold cross-validation. The algorithm with the best average performance should surpass those with the poorest. But what if the difference in average outcomes is the consequence of a statistical anomaly? To conduct whether or not...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Sulaimani Polytechnic University
2021-07-01
|
| Series: | Kurdistan Journal of Applied Research |
| Subjects: | |
| Online Access: | https://kjar.spu.edu.iq/index.php/kjar/article/view/630 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823861368540889088 |
|---|---|
| author | Hozan Khalid Hamarashid |
| author_facet | Hozan Khalid Hamarashid |
| author_sort | Hozan Khalid Hamarashid |
| collection | DOAJ |
| description | The mean result of machine learning models is determined by utilizing k-fold cross-validation. The algorithm with the best average performance should surpass those with the poorest. But what if the difference in average outcomes is the consequence of a statistical anomaly? To conduct whether or not the mean result differences between two algorithms is genuine then statistical hypothesis test is utilized. Using statistical hypothesis testing, this study will demonstrate how to compare machine learning algorithms. The output of several machine learning algorithms or simulation pipelines is compared during model selection. The model that performs the best based on your performance measure becomes the last model, which can be utilized to make predictions on new data. With classification and regression prediction models it can be conducted by utilizing traditional machine learning and deep learning methods. The difficulty is to identify whether or not the difference between two models is accurate.
|
| format | Article |
| id | doaj-art-ceb1fd53930c43859354fde6646c6a08 |
| institution | Kabale University |
| issn | 2411-7684 2411-7706 |
| language | English |
| publishDate | 2021-07-01 |
| publisher | Sulaimani Polytechnic University |
| record_format | Article |
| series | Kurdistan Journal of Applied Research |
| spelling | doaj-art-ceb1fd53930c43859354fde6646c6a082025-02-09T20:59:52ZengSulaimani Polytechnic UniversityKurdistan Journal of Applied Research2411-76842411-77062021-07-016110.24017/science.2021.1.8630Utilizing Statistical Tests for Comparing Machine Learning AlgorithmsHozan Khalid Hamarashid0Information Technology Department, Computer Science Institute, Sulaimani Polytechnic University, Sulaimani, IraqThe mean result of machine learning models is determined by utilizing k-fold cross-validation. The algorithm with the best average performance should surpass those with the poorest. But what if the difference in average outcomes is the consequence of a statistical anomaly? To conduct whether or not the mean result differences between two algorithms is genuine then statistical hypothesis test is utilized. Using statistical hypothesis testing, this study will demonstrate how to compare machine learning algorithms. The output of several machine learning algorithms or simulation pipelines is compared during model selection. The model that performs the best based on your performance measure becomes the last model, which can be utilized to make predictions on new data. With classification and regression prediction models it can be conducted by utilizing traditional machine learning and deep learning methods. The difficulty is to identify whether or not the difference between two models is accurate. https://kjar.spu.edu.iq/index.php/kjar/article/view/630machine learning, machine learning assessment, statistical tests, machine learning algorithm, machine learning comparison. |
| spellingShingle | Hozan Khalid Hamarashid Utilizing Statistical Tests for Comparing Machine Learning Algorithms Kurdistan Journal of Applied Research machine learning, machine learning assessment, statistical tests, machine learning algorithm, machine learning comparison. |
| title | Utilizing Statistical Tests for Comparing Machine Learning Algorithms |
| title_full | Utilizing Statistical Tests for Comparing Machine Learning Algorithms |
| title_fullStr | Utilizing Statistical Tests for Comparing Machine Learning Algorithms |
| title_full_unstemmed | Utilizing Statistical Tests for Comparing Machine Learning Algorithms |
| title_short | Utilizing Statistical Tests for Comparing Machine Learning Algorithms |
| title_sort | utilizing statistical tests for comparing machine learning algorithms |
| topic | machine learning, machine learning assessment, statistical tests, machine learning algorithm, machine learning comparison. |
| url | https://kjar.spu.edu.iq/index.php/kjar/article/view/630 |
| work_keys_str_mv | AT hozankhalidhamarashid utilizingstatisticaltestsforcomparingmachinelearningalgorithms |