Abstract

Large language model (LLM) agents have evolved to intelligently processinformation, make decisions, and interact with users or tools. A key capabilityis the integration of long-term memory capabilities, enabling these agents todraw upon historical interactions and knowledge. However, the growing memorysize and need for semantic structuring pose significant challenges. In thiswork, we propose an autonomous memory augmentation approach, MemInsight, toenhance semantic data representation and retrieval mechanisms. By leveragingautonomous augmentation to historical interactions, LLM agents are shown todeliver more accurate and contextualized responses. We empirically validate theefficacy of our proposed approach in three task scenarios; conversationalrecommendation, question answering and event summarization. On the LLM-REDIALdataset, MemInsight boosts persuasiveness of recommendations by up to 14%.Moreover, it outperforms a RAG baseline by 34% in recall for LoCoMo retrieval.Our empirical results show the potential of MemInsight to enhance thecontextual performance of LLM agents across multiple tasks.