Abstract

Human languages have evolved to be structured through repeated languagelearning and use. These processes introduce biases that operate during languageacquisition and shape linguistic systems toward communicative efficiency. Inthis paper, we investigate whether the same happens if artificial languages areoptimised for implicit biases of Large Language Models (LLMs). To this end, wesimulate a classical referential game in which LLMs learn and use artificiallanguages. Our results show that initially unstructured holistic languages areindeed shaped to have some structural properties that allow two LLM agents tocommunicate successfully. Similar to observations in human experiments,generational transmission increases the learnability of languages, but can atthe same time result in non-humanlike degenerate vocabularies. Taken together,this work extends experimental findings, shows that LLMs can be used as toolsin simulations of language evolution, and opens possibilities for futurehuman-machine experiments in this field.