A Cost of Misclassification Adjustment Approach for Estimating Optimal Cut-Off Point for Classification

Classification is one of the main areas of machine learning, where the target variable is usually categorical with at least two levels. This study focuses on deducing an optimal cut-off point for continuous outcomes (e.g., predicted probabilities) resulting from binary classifiers. To achieve this a...

Full description

Saved in:
Bibliographic Details
Main Authors: O.-A. Ampomah, R. Minkah, G. Kallah-Dagadu, E. N. N. Nortey
Format: Article
Language:English
Published: Wiley 2024-01-01
Series:Journal of Probability and Statistics
Online Access:http://dx.doi.org/10.1155/2024/8082372
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Classification is one of the main areas of machine learning, where the target variable is usually categorical with at least two levels. This study focuses on deducing an optimal cut-off point for continuous outcomes (e.g., predicted probabilities) resulting from binary classifiers. To achieve this aim, the study modified univariate discriminant functions by incorporating the error cost of misclassification penalties involved. By doing so, we can systematically shift the cut-off point within its measurement range till the optimal point is obtained. Extensive simulation studies were conducted to investigate the performance of the proposed method in comparison with existing classification methods under the binary logistic and Bayesian quantile regression frameworks. The simulation results indicate that logistic regression models incorporating the proposed method outperform the existing ordinary logistic regression and Bayesian regression models. We illustrate the proposed method with a practical dataset from the finance industry that assesses default status in home equity.
ISSN:1687-9538