Training hybrid neural networks with multimode optical nonlinearities using digital twins

The ability to train ever-larger neural networks brings artificial intelligence to the forefront of scientific and technical discoveries. However, their exponentially increasing size creates a proportionally greater demand for energy and computational hardware. Incorporating complex physical events...

Full description

Saved in:
Bibliographic Details
Main Authors: Oguz Ilker, Suter Louis J.E., Hsieh Jih-Liang, Yildirim Mustafa, Dinc Niyazi Ulas, Moser Christophe, Psaltis Demetri
Format: Article
Language:English
Published: De Gruyter 2025-04-01
Series:Nanophotonics
Subjects:
Online Access:https://doi.org/10.1515/nanoph-2025-0002
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The ability to train ever-larger neural networks brings artificial intelligence to the forefront of scientific and technical discoveries. However, their exponentially increasing size creates a proportionally greater demand for energy and computational hardware. Incorporating complex physical events in networks as fixed, efficient computation modules can address this demand by decreasing the complexity of trainable layers. Here, we utilize ultrashort pulse propagation in multimode fibers, which perform large-scale nonlinear transformations, for this purpose. Training the hybrid architecture is achieved through a neural model that differentiably approximates the optical system. The training algorithm updates the neural simulator and backpropagates the error signal over this proxy to optimize layers preceding the optical one. Our experimental results achieve state-of-the-art image classification accuracies and simulation fidelity. Moreover, the framework demonstrates exceptional resistance to experimental drifts. By integrating low-energy physical systems into neural networks, this approach enables scalable, energy-efficient AI models with significantly reduced computational demands.
ISSN:2192-8614