Abstract

Large language models (LLMs) have been widely used for various tasks andapplications. However, LLMs and fine-tuning are limited to the pre-traineddata. For example, ChatGPT's world knowledge until 2021 can be outdated orinaccurate. To enhance the capabilities of LLMs, Retrieval-Augmented Generation(RAG), is proposed to augment LLMs with additional, new, latest details andinformation to LLMs. While RAG offers the correct information, it may not bestpresent it, especially to different population groups with personalizations.Reinforcement Learning from Human Feedback (RLHF) adapts to user needs byaligning model responses with human preference through feedback loops. Inreal-life applications, such as mental health problems, a dynamic andfeedback-based model would continuously adapt to new information and offerpersonalized assistance due to complex factors fluctuating in a dailyenvironment. Thus, we propose an Online Reinforcement Learning-basedRetrieval-Augmented Generation (OnRL-RAG) system to detect and personalize theresponding systems to mental health problems, such as stress, anxiety, anddepression. We use an open-source dataset collected from 2028 College Studentswith 28 survey questions for each student to demonstrate the performance of ourproposed system with the existing systems. Our system achieves superiorperformance compared to standard RAG and simple LLM via GPT-4o, GPT-4o-mini,Gemini-1.5, and GPT-3.5. This work would open up the possibilities of real-lifeapplications of LLMs for personalized services in the everyday environment. Theresults will also help researchers in the fields of sociology, psychology, andneuroscience to align their theories more closely with the actual human dailyenvironment.