NeuroPong: the event-based camera driven embedded neuromorphic system

Neuromorphic computing is a novel style of computing that features low-power spiking neural networks (SNNs) as the main compute components. It is an event-driven computational paradigm that naturally pairs with event-based cameras and their asynchronous event output. In this work, we present NeuroPo...

Full description

Saved in:
Bibliographic Details
Main Authors: Charles P Rizzo, Bryson Gullett, Alex M Crumley, Maxwell E Marcum, Mason R Hyman, Carter Earheart-Brown, Julia Steed, Frank Standaert, Catherine D Schuman, James S Plank
Format: Article
Language:English
Published: IOP Publishing 2025-01-01
Series:Neuromorphic Computing and Engineering
Subjects:
Online Access:https://doi.org/10.1088/2634-4386/add0db
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Neuromorphic computing is a novel style of computing that features low-power spiking neural networks (SNNs) as the main compute components. It is an event-driven computational paradigm that naturally pairs with event-based cameras and their asynchronous event output. In this work, we present NeuroPong, a novel closed-loop neuromorphic hardware system composed of an event-based camera, a neuromorphic system, and an Atari 2600 console. The system facilitates the implementation of SNN Atari agents capable of playing Atari games in real time using event camera capture as input. We perform a small parameter optimization experiment to examine how software agents translate to hardware, discuss some of the challenges intrinsic to the hardware system, and propose some future improvements of the system and its components.
ISSN:2634-4386