Abstract

Knowledge tagging for questions is vital in modern intelligent educationalapplications, including learning progress diagnosis, practice questionrecommendations, and course content organization. Traditionally, theseannotations have been performed by pedagogical experts, as the task demands notonly a deep semantic understanding of question stems and knowledge definitionsbut also a strong ability to link problem-solving logic with relevant knowledgeconcepts. With the advent of advanced natural language processing (NLP)algorithms, such as pre-trained language models and large language models(LLMs), pioneering studies have explored automating the knowledge taggingprocess using various machine learning models. In this paper, we investigatethe use of a multi-agent system to address the limitations of previousalgorithms, particularly in handling complex cases involving intricateknowledge definitions and strict numerical constraints. By demonstrating itssuperior performance on the publicly available math question knowledge taggingdataset, MathKnowCT, we highlight the significant potential of an LLM-basedmulti-agent system in overcoming the challenges that previous methods haveencountered. Finally, through an in-depth discussion of the implications ofautomating knowledge tagging, we underscore the promising results of deployingLLM-based algorithms in educational contexts.