Information-theoretic bounds for accuracy of letter encoding and pattern recognition via ensembles of datasets M.M. Lange 1, A.M. Lange 1

In this paper, we study stochastic models for discrete letter encoding and object classification via ensembles of different modality datasets. For these models, the minimal values of the average mutual information between a given ensemble of datasets and the corresponding set of possible decisions a...

Full description

Saved in:
Bibliographic Details
Main Authors: M.M. Lange, A.M. Lange
Format: Article
Language:English
Published: Samara National Research University 2024-06-01
Series:Компьютерная оптика
Subjects:
Online Access:https://www.computeroptics.ru/eng/KO/Annot/KO48-3/480318e.html
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we study stochastic models for discrete letter encoding and object classification via ensembles of different modality datasets. For these models, the minimal values of the average mutual information between a given ensemble of datasets and the corresponding set of possible decisions are constructed as the appropriate monotonic decreasing functions of a given admissible error probability. We present examples of such functions constructed for a scheme of coding independent letters represented by pairs of observation values with possible errors as well as for a scheme of classifying composite objects given by pairs of face and signature images. The inversions of the obtained functions yield the lower bounds for the error probability for any amount of processed information. So, these functions can be considered as the appropriate bifactor fidelity criteria for source coding and object classification decisions. Moreover, the obtained functions are similar to the rate distortion function known in the information theory.
ISSN:0134-2452
2412-6179