Tunable Energy-Efficient Approximate Circuits for Self-Powered AI and Autonomous Edge Computing Systems

Artificial Intelligence is applied in various domains of compute-intensive applications ranging from image recognition healthcare to statistical analysis. Additionally, recent advancements in Deep Neural Network (DNN) running on millions of devices for various AI tasks deliver an accuracy comparable...

Full description

Saved in:
Bibliographic Details
Main Authors: Shubham Garg, Kanika Monga, Nitin Chaturvedi, S. Gurunarayanan
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10912512/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849775074993766400
author Shubham Garg
Kanika Monga
Nitin Chaturvedi
S. Gurunarayanan
author_facet Shubham Garg
Kanika Monga
Nitin Chaturvedi
S. Gurunarayanan
author_sort Shubham Garg
collection DOAJ
description Artificial Intelligence is applied in various domains of compute-intensive applications ranging from image recognition healthcare to statistical analysis. Additionally, recent advancements in Deep Neural Network (DNN) running on millions of devices for various AI tasks deliver an accuracy comparable to human levels. However, the accuracy in computations came with an additional cost of increased computational resources and power consumption in traditional computing units. Moreover, this problem becomes more complex while deploying computationally intensive heavy machine learning (ML) models on energy-constrained edge devices. Approximate computing has emerged as a promising paradigm for error-tolerant AI/ML applications deployed on energy-constrained edge devices where the complexity of hardware computing units can be reduced by optimizing circuit logic while slightly trading off computational accuracy. Therefore, we propose novel approximate compressors to design multiply and accumulate (MAC) hardware unit of Deep Neural Network and Convolutional Neural Network (DNN/CNN) that achieve energy-efficient and faster computations with slightly reduced precision. We also propose tunable compressors and MAC unit that support switching between two approximation modes to enable runtime adjustment of energy efficiency and accuracy for energy-autonomous edge devices. We validated and verified the design of the proposed approximate circuit at 7nm and 55nm technology nodes. The simulation result for the tunable compressor shows an average reduction of 49 % in energy consumption, and 30 % in delay compared to the state-of-the-art compressor. In addition, an average reduction of 36 % in energy consumption and 18 % in delay was observed for the MAC unit compared with the conventional MAC. To analyze the impact on the accuracy of the final output, we evaluated the error matrices for the approximate MAC unit and observed a low MRED (mean relative error distance) of 0.19. Furthermore, we implemented a simple CNN for pattern detection and integrated our proposed solution to validate its benefits, achieving 15% lower power consumption and 7% lower area overhead without functionality loss.
format Article
id doaj-art-604dc81691db4e05a3ca4d6dca161d58
institution DOAJ
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-604dc81691db4e05a3ca4d6dca161d582025-08-20T03:01:32ZengIEEEIEEE Access2169-35362025-01-0113436074363010.1109/ACCESS.2025.354845810912512Tunable Energy-Efficient Approximate Circuits for Self-Powered AI and Autonomous Edge Computing SystemsShubham Garg0https://orcid.org/0000-0002-0971-1680Kanika Monga1https://orcid.org/0000-0001-8993-8772Nitin Chaturvedi2https://orcid.org/0000-0001-6365-5459S. Gurunarayanan3https://orcid.org/0000-0001-5596-4964Birla Institute of Technology and Science Pilani, Pilani, IndiaBirla Institute of Technology and Science Pilani, Pilani, IndiaBirla Institute of Technology and Science Pilani, Pilani, IndiaBirla Institute of Technology and Science Pilani, Pilani, IndiaArtificial Intelligence is applied in various domains of compute-intensive applications ranging from image recognition healthcare to statistical analysis. Additionally, recent advancements in Deep Neural Network (DNN) running on millions of devices for various AI tasks deliver an accuracy comparable to human levels. However, the accuracy in computations came with an additional cost of increased computational resources and power consumption in traditional computing units. Moreover, this problem becomes more complex while deploying computationally intensive heavy machine learning (ML) models on energy-constrained edge devices. Approximate computing has emerged as a promising paradigm for error-tolerant AI/ML applications deployed on energy-constrained edge devices where the complexity of hardware computing units can be reduced by optimizing circuit logic while slightly trading off computational accuracy. Therefore, we propose novel approximate compressors to design multiply and accumulate (MAC) hardware unit of Deep Neural Network and Convolutional Neural Network (DNN/CNN) that achieve energy-efficient and faster computations with slightly reduced precision. We also propose tunable compressors and MAC unit that support switching between two approximation modes to enable runtime adjustment of energy efficiency and accuracy for energy-autonomous edge devices. We validated and verified the design of the proposed approximate circuit at 7nm and 55nm technology nodes. The simulation result for the tunable compressor shows an average reduction of 49 % in energy consumption, and 30 % in delay compared to the state-of-the-art compressor. In addition, an average reduction of 36 % in energy consumption and 18 % in delay was observed for the MAC unit compared with the conventional MAC. To analyze the impact on the accuracy of the final output, we evaluated the error matrices for the approximate MAC unit and observed a low MRED (mean relative error distance) of 0.19. Furthermore, we implemented a simple CNN for pattern detection and integrated our proposed solution to validate its benefits, achieving 15% lower power consumption and 7% lower area overhead without functionality loss.https://ieeexplore.ieee.org/document/10912512/Approximate computing (Ax-C)n:k compressorhardware optimizationerror-tolerant applicationstunable circuit
spellingShingle Shubham Garg
Kanika Monga
Nitin Chaturvedi
S. Gurunarayanan
Tunable Energy-Efficient Approximate Circuits for Self-Powered AI and Autonomous Edge Computing Systems
IEEE Access
Approximate computing (Ax-C)
n:k compressor
hardware optimization
error-tolerant applications
tunable circuit
title Tunable Energy-Efficient Approximate Circuits for Self-Powered AI and Autonomous Edge Computing Systems
title_full Tunable Energy-Efficient Approximate Circuits for Self-Powered AI and Autonomous Edge Computing Systems
title_fullStr Tunable Energy-Efficient Approximate Circuits for Self-Powered AI and Autonomous Edge Computing Systems
title_full_unstemmed Tunable Energy-Efficient Approximate Circuits for Self-Powered AI and Autonomous Edge Computing Systems
title_short Tunable Energy-Efficient Approximate Circuits for Self-Powered AI and Autonomous Edge Computing Systems
title_sort tunable energy efficient approximate circuits for self powered ai and autonomous edge computing systems
topic Approximate computing (Ax-C)
n:k compressor
hardware optimization
error-tolerant applications
tunable circuit
url https://ieeexplore.ieee.org/document/10912512/
work_keys_str_mv AT shubhamgarg tunableenergyefficientapproximatecircuitsforselfpoweredaiandautonomousedgecomputingsystems
AT kanikamonga tunableenergyefficientapproximatecircuitsforselfpoweredaiandautonomousedgecomputingsystems
AT nitinchaturvedi tunableenergyefficientapproximatecircuitsforselfpoweredaiandautonomousedgecomputingsystems
AT sgurunarayanan tunableenergyefficientapproximatecircuitsforselfpoweredaiandautonomousedgecomputingsystems