Artificial intelligence-controlled pole balancing using an Arduino board

Automation Process (AP) is an important issue in the current digitized world and, in general, represents an increase in the quality of productivity when compared with manual control. Balance is a natural human capacity as it relates to complex operations and intelligence. Balance Control presents a...

Full description

Saved in:
Bibliographic Details
Main Authors: José Luis Revelo Orellana, Oscar Chang
Format: Article
Language:English
Published: Escuela Superior Politécnica del Litoral 2021-11-01
Series:Revista Tecnológica
Subjects:
Online Access:https://rte.espol.edu.ec/index.php/tecnologica/article/view/852
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Automation Process (AP) is an important issue in the current digitized world and, in general, represents an increase in the quality of productivity when compared with manual control. Balance is a natural human capacity as it relates to complex operations and intelligence. Balance Control presents an extra challenge in automation processes, due to the many variables that may be involved.  This work presents a physical balancing pole where a Reinforcement Learning (RL) agent can explore the environment, sense its position through accelerometers, and wirelessly communicate and eventually learns by itself how to keep the pole balanced under noise disturbance. The agent uses RL principles to explore and learn new positions and corrections that lead toward more significant rewards in terms of pole equilibrium. By using a Q-matrix, the agent explores future conditions and acquires policy information that makes it possible to maintain stability. An Arduino microcontroller processes all training and testing. With the help of sensors, servo motors, wireless communications, and artificial intelligence, components merge into a system that consistently recovers equilibrium under random position changes. The obtained results prove that through RL, an agent can learn by itself to use generic sensors, actuators and solve balancing problems even under the limitations that a microcontroller presents.
ISSN:0257-1749
1390-3659