Comparison of the efficiency of zero and first order minimization methods in neural networks

To minimize the objective function in neural networks, first-order methods are usually used, which involve the repeated calculation of the gradient. The number of variables in modern neural networks can be many thousands and even millions. Numerous experiments show that the analytical calculation ti...

Full description

Saved in:
Bibliographic Details
Main Authors: E. A. Gubareva, S. I. Khashin, E. S. Shemyakova
Format: Article
Language:English
Published: Publishing House of the State University of Management 2022-12-01
Series:Вестник университета
Subjects:
Online Access:https://vestnik.guu.ru/jour/article/view/3952
Tags: Add Tag
No Tags, Be the first to tag this record!