BALI—A Benchmark for Accelerated Language Model Inference

BALI—A Benchmark for Accelerated Language Model Inference

The rise of Large Language Models (LLMs) has revolutionized natural language processing, enabling advancements across diverse applications, including chatbots, live translators, content generation, virtual assistants, and domain-specific automation tools. These applications rely on real-time or near...

Full description

Saved in:
Bibliographic Details
Main Authors: Lena Jurkschat, Preetam Gattogi, Sahar Vahdati, Jens Lehmann
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
LLM inference
transformer decoder
LLM inference benchmarking
generation speed
performance analysis
inference standardization
Online Access:https://ieeexplore.ieee.org/document/11026002/
Tags: Add Tag
No Tags, Be the first to tag this record!

Internet

https://ieeexplore.ieee.org/document/11026002/

Similar Items