SMCLM: Semantically Meaningful Causal Language Modeling for Autoregressive Paraphrase Generation

This article introduces semantically meaningful causal language modeling (SMCLM), a self-supervised method of training autoregressive models to generate semantically equivalent text. Our approach involves using semantically meaningful text representation as an initial embedding in the autoregressive...

Full description

Saved in:
Bibliographic Details
Main Authors: Michal Perelkiewicz, Slawomir Dadas, Rafal Poswiata
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/11068992/
Tags: Add Tag
No Tags, Be the first to tag this record!