ResDecode: Accelerating Large Language Models Inference via Residual Decoding Heads by Ziqian Zeng, Jiahong Yu, Qianshi Pang, Zihao Wang, Huiping Zhuang, Fan Yu, Hongen Shao, Xiaofeng Zou

Subjects: “…speculative decoding…”
Get full text

Accelerating the inference of string generation-based chemical reaction models for industrial applications by Mikhail Andronov, Natalia Andronova, Michael Wand, Jürgen Schmidhuber, Djork-Arné Clevert

Subjects: Get full text