Improving Neural Network Efficiency Using Piecewise Linear Approximation of Activation Functions

Activation functions play a pivotal role in Neural Networks by enabling the modeling of complex non-linear relationships within data. However, the computational cost associated with certain activation functions, such as the hyperbolic tangent (tanh) and its gradient, can be substantial. In this stu...

Full description

Saved in:
Bibliographic Details
Main Authors: Pavan Reddy, Aditya Sanjay Gujral
Format: Article
Language:English
Published: LibraryPress@UF 2025-05-01
Series:Proceedings of the International Florida Artificial Intelligence Research Society Conference
Online Access:https://journals.flvc.org/FLAIRS/article/view/139005
Tags: Add Tag
No Tags, Be the first to tag this record!