SMITIN: Self-Monitored Inference-Time INtervention for Generative Music Transformers

SMITIN: Self-Monitored Inference-Time INtervention for Generative Music Transformers

We introduce Self-Monitored Inference-Time INtervention (SMITIN), an approach for controlling an autoregressive generative music transformer using classifier probes. These simple logistic regression probes are trained on the output of each attention head in the transformer using a small dataset of a...

Full description

Saved in:
Bibliographic Details
Main Authors: Junghyun Koo, Gordon Wichern, Francois G. Germain, Sameer Khurana, Jonathan Le Roux
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Open Journal of Signal Processing
Subjects:
Classifier probes
multi-head attention
music information retrieval
music transformer
Online Access:https://ieeexplore.ieee.org/document/10856829/
Tags: Add Tag
No Tags, Be the first to tag this record!
Be the first to leave a comment!
You must be logged in first

Similar Items