The fine art of fine-tuning: A structured review of advanced LLM fine-tuning techniques

The fine art of fine-tuning: A structured review of advanced LLM fine-tuning techniques

Transformer-based models have consistently demonstrated superior accuracy compared to various traditional models across a range of downstream tasks. However, due to their large nature, training or fine-tuning them for specific tasks has heavy computational and memory demands. This causes the creatio...

Full description

Saved in:
Bibliographic Details
Main Authors: Samar Pratap, Alston Richard Aranha, Divyanshu Kumar, Gautam Malhotra, Anantharaman Palacode Narayana Iyer, Shylaja S.S.
Format: Article
Language:English
Published: Elsevier 2025-06-01
Series:Natural Language Processing Journal
Subjects:
Adapter
FFT
LLM
LoRA
MoE
PEFT
Online Access:http://www.sciencedirect.com/science/article/pii/S2949719125000202
Tags: Add Tag
No Tags, Be the first to tag this record!

Similar Items

Similar Items