SimpleScale: Simplifying the Training of an LLM Model Using 1024 GPUs by Tianfa Li, Jingshan Pan, Siwei Ma, Aleksandr Raikov, Alexander Arkhipov

“…This paper develops SimpleScale for building LLMs based on FSDP and Slurm, which is a simple and efficient training system that includes the training agent, the efficient parallel strategy, the optimal step of checkpoint, and so on. …”
Get full text

GeoGraphRAG: A graph-based retrieval-augmented generation approach for empowering large language models in automated geospatial modeling by Jianyuan Liang, Shuyang Hou, Haoyue Jiao, Yaxian Qing, Anqi Zhao, Zhangxiao Shen, Longgang Xiang, Huayi Wu

“…Specifically, GeoGraphRAG utilizes LLMs as intelligent agents to identify user demands, retrieve relevant subgraphs from external graph knowledge base, and injects both structural and semantic information into the LLM. …”
Get full text