Estimating the Significance of Computer Model Factors Based on a Simple Neural Network

Introduction. The existing means of computer technology provide an opportunity to develop models of any complexity. This circumstance provokes developers of computer models of complex systems to excessive detailing. Among experienced specialists in computer modeling, there is an opinion that sometim...

Full description

Saved in:
Bibliographic Details
Main Authors: Volodymyr Pepelyaev, Nataliia Oriekhova, Ihor Lukyanov
Format: Article
Language:English
Published: V.M. Glushkov Institute of Cybernetics 2024-12-01
Series:Кібернетика та комп'ютерні технології
Subjects:
Online Access:http://cctech.org.ua/13-vertikalnoe-menyu-en/651-abstract-24-4-3-arte
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850104568370692096
author Volodymyr Pepelyaev
Nataliia Oriekhova
Ihor Lukyanov
author_facet Volodymyr Pepelyaev
Nataliia Oriekhova
Ihor Lukyanov
author_sort Volodymyr Pepelyaev
collection DOAJ
description Introduction. The existing means of computer technology provide an opportunity to develop models of any complexity. This circumstance provokes developers of computer models of complex systems to excessive detailing. Among experienced specialists in computer modeling, there is an opinion that sometimes at the preliminary stage of model development, the number of insignificant factors can reach 80%. Such an increase in dimensionality not only significantly complicates the implementation of computer experiments, but can also have a significant impact on the understanding of the interaction of important factors that determine the basis and essence of the functioning of a complex system. Therefore, it is no less important for further model research, and especially for the optimization of a complex system, to determine insignificant factors. The purpose of the work is to develop an algorithm for determining insignificant factors in the presence of a set of training data, in which the number of data samples is relatively small and exceeds the number of factors by only 2-3 times. For this, a neural network model implementing regression created using the Keras library was used. Artificially created datasets were used to conduct experiments to determine network parameters (number of layers, number of hidden neurons in a layer, as well as the number of learning epochs). The results. The resulting neural network model demonstrated effective performance on test data sets. The model was then used to determine the significance of factors in sets of initial populations for a multipopulational genetic algorithm (MGA) study. Conclusions. The proposed algorithm based on a simple neural network allows to correctly and quickly determine insignificant factors in a set of initial populations for the study of MGA, containing from 8 to 10 populations (250 - 300 samples). Since the initial weights of the neural network are chosen randomly, the results of different runs on the same set of data are slightly different. Therefore, in the general case of evaluating the significance of factors of a computer model, several runs must be made to obtain more reliable results.
format Article
id doaj-art-9a974aa2ab4b4fe9964d19c63df2d700
institution DOAJ
issn 2707-4501
2707-451X
language English
publishDate 2024-12-01
publisher V.M. Glushkov Institute of Cybernetics
record_format Article
series Кібернетика та комп'ютерні технології
spelling doaj-art-9a974aa2ab4b4fe9964d19c63df2d7002025-08-20T02:39:18ZengV.M. Glushkov Institute of CyberneticsКібернетика та комп'ютерні технології2707-45012707-451X2024-12-014324210.34229/2707-451X.24.4.310-34229-2707-451X-24-4-3Estimating the Significance of Computer Model Factors Based on a Simple Neural NetworkVolodymyr Pepelyaev0https://orcid.org/0009-0009-3169-1776Nataliia Oriekhova1Ihor Lukyanov2V.M. Glushkov Institute of Cybernetics of the NAS of Ukraine, KyivV.M. Glushkov Institute of Cybernetics of the NAS of Ukraine, KyivV.M. Glushkov Institute of Cybernetics of the NAS of Ukraine, KyivIntroduction. The existing means of computer technology provide an opportunity to develop models of any complexity. This circumstance provokes developers of computer models of complex systems to excessive detailing. Among experienced specialists in computer modeling, there is an opinion that sometimes at the preliminary stage of model development, the number of insignificant factors can reach 80%. Such an increase in dimensionality not only significantly complicates the implementation of computer experiments, but can also have a significant impact on the understanding of the interaction of important factors that determine the basis and essence of the functioning of a complex system. Therefore, it is no less important for further model research, and especially for the optimization of a complex system, to determine insignificant factors. The purpose of the work is to develop an algorithm for determining insignificant factors in the presence of a set of training data, in which the number of data samples is relatively small and exceeds the number of factors by only 2-3 times. For this, a neural network model implementing regression created using the Keras library was used. Artificially created datasets were used to conduct experiments to determine network parameters (number of layers, number of hidden neurons in a layer, as well as the number of learning epochs). The results. The resulting neural network model demonstrated effective performance on test data sets. The model was then used to determine the significance of factors in sets of initial populations for a multipopulational genetic algorithm (MGA) study. Conclusions. The proposed algorithm based on a simple neural network allows to correctly and quickly determine insignificant factors in a set of initial populations for the study of MGA, containing from 8 to 10 populations (250 - 300 samples). Since the initial weights of the neural network are chosen randomly, the results of different runs on the same set of data are slightly different. Therefore, in the general case of evaluating the significance of factors of a computer model, several runs must be made to obtain more reliable results.http://cctech.org.ua/13-vertikalnoe-menyu-en/651-abstract-24-4-3-arteset of initial populationssignificance of factorsneural networklearning epochs
spellingShingle Volodymyr Pepelyaev
Nataliia Oriekhova
Ihor Lukyanov
Estimating the Significance of Computer Model Factors Based on a Simple Neural Network
Кібернетика та комп'ютерні технології
set of initial populations
significance of factors
neural network
learning epochs
title Estimating the Significance of Computer Model Factors Based on a Simple Neural Network
title_full Estimating the Significance of Computer Model Factors Based on a Simple Neural Network
title_fullStr Estimating the Significance of Computer Model Factors Based on a Simple Neural Network
title_full_unstemmed Estimating the Significance of Computer Model Factors Based on a Simple Neural Network
title_short Estimating the Significance of Computer Model Factors Based on a Simple Neural Network
title_sort estimating the significance of computer model factors based on a simple neural network
topic set of initial populations
significance of factors
neural network
learning epochs
url http://cctech.org.ua/13-vertikalnoe-menyu-en/651-abstract-24-4-3-arte
work_keys_str_mv AT volodymyrpepelyaev estimatingthesignificanceofcomputermodelfactorsbasedonasimpleneuralnetwork
AT nataliiaoriekhova estimatingthesignificanceofcomputermodelfactorsbasedonasimpleneuralnetwork
AT ihorlukyanov estimatingthesignificanceofcomputermodelfactorsbasedonasimpleneuralnetwork