Fostering collective intelligence in CPSS: an LLM-driven multi-agent cooperative tuning framework
Cyber-Physical-Social Systems (CPSS) have emerged as a transformative paradigm in recent years, embracing computational processes, physical systems, and human social interactions within an integrated architectural framework. Advances in artificial intelligence technologies are targeted at addressing...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-06-01
|
| Series: | Frontiers in Physics |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fphy.2025.1613499/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849426787666231296 |
|---|---|
| author | Rongjun Chen Rongjun Chen Chengbo He |
| author_facet | Rongjun Chen Rongjun Chen Chengbo He |
| author_sort | Rongjun Chen |
| collection | DOAJ |
| description | Cyber-Physical-Social Systems (CPSS) have emerged as a transformative paradigm in recent years, embracing computational processes, physical systems, and human social interactions within an integrated architectural framework. Advances in artificial intelligence technologies are targeted at addressing the complexity of CPSS design, especially in modeling human reactions in cyber-physical environment. Notably, LLM-based agents have shown significant potential, and numerous studies have leveraged multi-agent collaboration frameworks to solve reasoning tasks. Some approaches achieve multi-agent collaboration through a debate or communication setting. However, these approaches only use the existing capabilities of LLMs, fail to enhance their problem-solving performance. Other works incorporate the responses of other LLMs into their training trajectories to train individual LLMs in a reinforcement learning setting. We argue that effective collaboration should align not only in input information but also in consistent optimization objectives. Furthermore, in current cooperative frameworks, some LLMs tend to redundantly repeat others’ viewpoints, contributing minimally to solve problems. In this paper, inspired by multi-agent reinforcement learning research, we propose MACT, a Multi-Agent Cooperative Tuning framework to joint train multiple LLMs, ensuring that the optimization of each agent aligns directly with the objective of the global task. We equip each agent with a critic network to facilitate individual optimization. Furthermore, to encourage different agents to complement each other and contribute to the overall task, we employ a mixing network that ensures the value of each agent is monotonically consistent with the total value. Experimental results reveal that our method significantly enhances cooperative problem-solving capabilities in the LLM multi-agent framework, which set strong evidence for the modeling of human reaction within CPSS. |
| format | Article |
| id | doaj-art-0f37ba41bbaf4cacbee73f986882890c |
| institution | Kabale University |
| issn | 2296-424X |
| language | English |
| publishDate | 2025-06-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Physics |
| spelling | doaj-art-0f37ba41bbaf4cacbee73f986882890c2025-08-20T03:29:15ZengFrontiers Media S.A.Frontiers in Physics2296-424X2025-06-011310.3389/fphy.2025.16134991613499Fostering collective intelligence in CPSS: an LLM-driven multi-agent cooperative tuning frameworkRongjun Chen0Rongjun Chen1Chengbo He2Guangdong Provincial Key Laboratory of Quantum Engineering and Quantum Materials, School of Electronic Science and Engineering (School of Microelectronics), South China Normal University, Foshan, Guangdong, ChinaGuangdong Provincial Key Laboratory of Intelligent Information Processing, Shenzhen, Guangdong, ChinaGuangdong Provincial Key Laboratory of Quantum Engineering and Quantum Materials, School of Electronic Science and Engineering (School of Microelectronics), South China Normal University, Foshan, Guangdong, ChinaCyber-Physical-Social Systems (CPSS) have emerged as a transformative paradigm in recent years, embracing computational processes, physical systems, and human social interactions within an integrated architectural framework. Advances in artificial intelligence technologies are targeted at addressing the complexity of CPSS design, especially in modeling human reactions in cyber-physical environment. Notably, LLM-based agents have shown significant potential, and numerous studies have leveraged multi-agent collaboration frameworks to solve reasoning tasks. Some approaches achieve multi-agent collaboration through a debate or communication setting. However, these approaches only use the existing capabilities of LLMs, fail to enhance their problem-solving performance. Other works incorporate the responses of other LLMs into their training trajectories to train individual LLMs in a reinforcement learning setting. We argue that effective collaboration should align not only in input information but also in consistent optimization objectives. Furthermore, in current cooperative frameworks, some LLMs tend to redundantly repeat others’ viewpoints, contributing minimally to solve problems. In this paper, inspired by multi-agent reinforcement learning research, we propose MACT, a Multi-Agent Cooperative Tuning framework to joint train multiple LLMs, ensuring that the optimization of each agent aligns directly with the objective of the global task. We equip each agent with a critic network to facilitate individual optimization. Furthermore, to encourage different agents to complement each other and contribute to the overall task, we employ a mixing network that ensures the value of each agent is monotonically consistent with the total value. Experimental results reveal that our method significantly enhances cooperative problem-solving capabilities in the LLM multi-agent framework, which set strong evidence for the modeling of human reaction within CPSS.https://www.frontiersin.org/articles/10.3389/fphy.2025.1613499/fullcyber-physical-social systems (CPSS)large language models (LLM)generative artificial intelligence (GAI)LLM agentsmulti-agent systems (MAS)reinforcement learning |
| spellingShingle | Rongjun Chen Rongjun Chen Chengbo He Fostering collective intelligence in CPSS: an LLM-driven multi-agent cooperative tuning framework Frontiers in Physics cyber-physical-social systems (CPSS) large language models (LLM) generative artificial intelligence (GAI) LLM agents multi-agent systems (MAS) reinforcement learning |
| title | Fostering collective intelligence in CPSS: an LLM-driven multi-agent cooperative tuning framework |
| title_full | Fostering collective intelligence in CPSS: an LLM-driven multi-agent cooperative tuning framework |
| title_fullStr | Fostering collective intelligence in CPSS: an LLM-driven multi-agent cooperative tuning framework |
| title_full_unstemmed | Fostering collective intelligence in CPSS: an LLM-driven multi-agent cooperative tuning framework |
| title_short | Fostering collective intelligence in CPSS: an LLM-driven multi-agent cooperative tuning framework |
| title_sort | fostering collective intelligence in cpss an llm driven multi agent cooperative tuning framework |
| topic | cyber-physical-social systems (CPSS) large language models (LLM) generative artificial intelligence (GAI) LLM agents multi-agent systems (MAS) reinforcement learning |
| url | https://www.frontiersin.org/articles/10.3389/fphy.2025.1613499/full |
| work_keys_str_mv | AT rongjunchen fosteringcollectiveintelligenceincpssanllmdrivenmultiagentcooperativetuningframework AT rongjunchen fosteringcollectiveintelligenceincpssanllmdrivenmultiagentcooperativetuningframework AT chengbohe fosteringcollectiveintelligenceincpssanllmdrivenmultiagentcooperativetuningframework |