LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulation

  • 2024-12-13 03:33:38
  • Yijun Liu, Wu Liu, Xiaoyan Gu, Yong Rui, Xiaodong He, Yongdong Zhang
  • 0

Abstract

The believable simulation of multi-user behavior is crucial for understandingcomplex social systems. Recently, large language models (LLMs)-based AI agentshave made significant progress, enabling them to achieve human-likeintelligence across various tasks. However, real human societies are oftendynamic and complex, involving numerous individuals engaging in multimodalinteractions. In this paper, taking e-commerce scenarios as an example, wepresent LMAgent, a very large-scale and multimodal agents society based onmultimodal LLMs. In LMAgent, besides freely chatting with friends, the agentscan autonomously browse, purchase, and review products, even perform livestreaming e-commerce. To simulate this complex system, we introduce aself-consistency prompting mechanism to augment agents' multimodalcapabilities, resulting in significantly improved decision-making performanceover the existing multi-agent system. Moreover, we propose a fast memorymechanism combined with the small-world model to enhance system efficiency,which supports more than 10,000 agent simulations in a society. Experiments onagents' behavior show that these agents achieve comparable performance tohumans in behavioral indicators. Furthermore, compared with the existingLLMs-based multi-agent system, more different and valuable phenomena areexhibited, such as herd behavior, which demonstrates the potential of LMAgentin credible large-scale social behavior simulations.