Formal Language Recognition by Hard Attention Transformers: Perspectives from Circuit Complexity

Formal Language Recognition by Hard Attention Transformers: Perspectives from Circuit Complexity

Saved in:

Bibliographic Details
Main Authors:	Yiding Hao, Dana Angluin, Robert Frank
Format:	Article
Language:	English
Published:	The MIT Press 2022-08-01
Series:	Transactions of the Association for Computational Linguistics
Online Access:	http://dx.doi.org/10.1162/tacl_a_00490
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

What Formal Languages Can Transformers Express? A Survey
by: Lena Strobl, et al.
Published: (2024-05-01)

Enhancing Cross-Language Multimodal Emotion Recognition With Dual Attention Transformers
by: Syed Aun Muhammad Zaidi, et al.
Published: (2024-01-01)

A lightweight transformer with linear self‐attention for defect recognition
by: Yuwen Zhai, et al.
Published: (2024-09-01)

Effective Partitioning Method With Predictable Hardness for CircuitSAT
by: Konstantin Chukharev, et al.
Published: (2025-01-01)

Trends in Language Formalization in Architecture
by: Franklim Morais Pereira
Published: (2014-12-01)

Micro-Expression Recognition Using Convolutional Variational Attention Transformer (ConVAT) With Multihead Attention Mechanism
by: Hafiz Khizer Bin Talib, et al.
Published: (2025-01-01)

CircuitHD: Brain-Inspired Hyperdimensional Computing for Circuit Recognition
by: Paul R. Genssler, et al.
Published: (2024-01-01)

A Static Sign Language Recognition Method Enhanced with Self-Attention Mechanisms
by: Yongxin Wang, et al.
Published: (2024-10-01)

Benchmarking Quantum Circuit Transformation With QKNOB Circuits
by: Sanjiang Li, et al.
Published: (2025-01-01)

WTASR: Wavelet Transformer for Automatic Speech Recognition of Indian Languages
by: Tripti Choudhary, et al.
Published: (2023-03-01)

Fusion Attention for Action Recognition: Integrating Sparse-Dense and Global Attention for Video Action Recognition
by: Hyun-Woo Kim, et al.
Published: (2024-10-01)

Conceptual commonsense-aware attentive modeling with pre-trained masked language models for humor recognition
by: Yuta Sasaki, et al.
Published: (2024-12-01)

Computers, Language and Speech: Formal Theories and Statistical Data
by: Karen I. B. Spärck Jones, et al.
Published: (2021-03-01)

Linguistics And Informatics, The Role Of Formal Grammar In Language Processing
by: Yakout BACHIR
Published: (2024-12-01)

ANTITHETICAL PERSPECTIVE OF LEGAL FORMALISM AND LEGAL REALISM
by: Horatiu MARGOI
Published: (2017-05-01)

AFT-SAM: Adaptive Fusion Transformer with a Sparse Attention Mechanism for Audio–Visual Speech Recognition
by: Na Che, et al.
Published: (2024-12-01)

Experimental Research on Brittleness and Rockburst Proneness of Three Kinds of Hard Rocks under Uniaxial Compression
by: Rongchao Xu, et al.
Published: (2021-01-01)

The use of formal languages for business rules realisation in information systems
by: Olegas Vasilecas, et al.
Published: (2005-12-01)

The formal Laplace-Borel transform of Fliess operators and the composition product
by: Yaqin Li, et al.
Published: (2006-01-01)

Review of Lagrangian formalism in biology: recent advances and perspectives
by: Diana T. Pham, et al.
Published: (2024-12-01)

FORMAL ASPECTS OF SUBSTANTIATION OF THE COMPLEX RECLAMATIONS COMPOSITION AND THE STRATEGY OF THEIR PLACEMENT
by: Yuri P. Dobrachev, et al.
Published: (2024-11-01)

Innovative Framework for Historical Architectural Recognition in China: Integrating Swin Transformer and Global Channel–Spatial Attention Mechanism
by: Jiade Wu, et al.
Published: (2025-01-01)

Emotion recognition in conversations based on discourse parsing and graph attention network
by: HAO Xiulan, et al.
Published: (2024-05-01)

The Production of Complex Thin Film Circuits
by: V. Needham
Published: (1977-01-01)

American Sign Language Recognition Model Using Complex Zernike Moments and Complex-Valued Deep Neural Networks
by: Selda Bayrak, et al.
Published: (2024-01-01)

Transforming English language learning: Advanced speech recognition with MLP-LSTM for personalized education
by: Myagmarsuren Orosoo, et al.
Published: (2025-01-01)

Hard diffraction in SHERPA
by: Frank Krauss, et al.
Published: (2024-09-01)

Elements of Formal Semantics: An Introduction to the Mathematical Theory of Meaning in Natural Language
by: Michael Yoshitaka Erlewine
Published: (2021-03-01)

RETRACTED: Formal representation of the predicate structure based on the neurocognitive architecture
by: Boziev Alberd, et al.
Published: (2024-01-01)

Rebar Recognition Using Multi-Hyperbolic Attention in Faster R-CNN
by: Chuan Li, et al.
Published: (2025-01-01)

Active Hard Sample Learning for Violation Action Recognition in Power Grid Operation
by: Lingwen Meng, et al.
Published: (2025-01-01)

Multiscale attention-over-attention network for retinal disease recognition in OCT radiology images
by: Abdulmajeed M. Alenezi, et al.
Published: (2024-11-01)

Saturated Transformers are Constant-Depth Threshold Circuits
by: William Merrill, et al.
Published: (2022-08-01)

MPSA-Conformer-CTC/Attention: A High-Accuracy, Low-Complexity End-to-End Approach for Tibetan Speech Recognition
by: Changlin Wu, et al.
Published: (2024-10-01)

Understanding the PULSAR effect in combined radiotherapy and immunotherapy using transformer-based attention mechanisms
by: Hao Peng, et al.
Published: (2024-12-01)

Multitask Learning with Local Attention for Tibetan Speech Recognition
by: Hui Wang, et al.
Published: (2020-01-01)

Adversarial Robust Modulation Recognition Guided by Attention Mechanisms
by: Quanhai Zhan, et al.
Published: (2025-01-01)

Convolutional Attention Based Mechanism for Facial Microexpression Recognition
by: Hafiz Khizer Bin Talib, et al.
Published: (2025-01-01)

Digital models and natural language – New perspectives for interpreting complexity
by: Anna Osello, et al.
Published: (2024-12-01)

Attention-Based CNN Fusion Model for Emotion Recognition During Walking Using Discrete Wavelet Transform on EEG and Inertial Signals
by: Yan Zhao, et al.
Published: (2024-03-01)