Abstract

Ensuring the reliability and effectiveness of software release decisions iscritical, particularly in safety-critical domains like automotive systems.Precise analysis of release validation data, often presented in tabular form,plays a pivotal role in this process. However, traditional methods that rely onmanual analysis of extensive test datasets and validation metrics are prone todelays and high costs. Large Language Models (LLMs) offer a promisingalternative but face challenges in analytical reasoning, contextualunderstanding, handling out-of-scope queries, and processing structured testdata consistently; limitations that hinder their direct application insafety-critical scenarios. This paper introduces GateLens, an LLM-based toolfor analyzing tabular data in the automotive domain. GateLens translatesnatural language queries into Relational Algebra (RA) expressions and thengenerates optimized Python code. It outperforms the baseline system onbenchmarking datasets, achieving higher F1 scores and handling complex andambiguous queries with greater robustness. Ablation studies confirm thecritical role of the RA module, with performance dropping sharply when omitted.Industrial evaluations reveal that GateLens reduces analysis time by over 80%while maintaining high accuracy and reliability. As demonstrated by presentedresults, GateLens achieved high performance without relying on few-shotexamples, showcasing strong generalization across various query types fromdiverse company roles. Insights from deploying GateLens with a partnerautomotive company offer practical guidance for integrating AI into criticalworkflows such as release validation. Results show that by automating testresult analysis, GateLens enables faster, more informed, and dependable releasedecisions, and can thus advance software scalability and reliability inautomotive systems.