Long-context inference optimization for large language models: a survey

Long-context inference optimization for large language models: a survey

Show other versions (1)

With the rapid development of large language model (LLM) technology, the demand for processing long-text inputs has been increasing. However, long-text inference faces challenges such as high memory consumption and latency. To improve the efficiency of LLMs in long-text inference, a comprehensive re...

Full description

Saved in:
Bibliographic Details
Main Authors: TAO Wei, WANG Jianzong, ZHANG Xulong, QU Xiaoyang
Format: Article
Language:zho
Published: China InfoCom Media Group 2025-01-01
Series:大数据
Subjects:
large language model
long-context inference
model optimization
computation optimization
system optimization
Online Access:http://www.j-bigdataresearch.com.cn/thesisDetails#10.11959/j.issn.2096-0271.2024xxx
Tags: Add Tag
No Tags, Be the first to tag this record!

Internet

http://www.j-bigdataresearch.com.cn/thesisDetails#10.11959/j.issn.2096-0271.2024xxx

Similar Items