VeriMind: Agentic LLM for Automated Verilog Generation with a Novel Evaluation Metric

  • 2025-03-24 15:14:06
  • Bardia Nadimi, Ghali Omar Boutaib, Hao Zheng
  • 0

Abstract

Designing Verilog modules requires meticulous attention to correctness,efficiency, and adherence to design specifications. However, manually writingVerilog code remains a complex and time-consuming task that demands both expertknowledge and iterative refinement. Leveraging recent advancements in largelanguage models (LLMs) and their structured text generation capabilities, wepropose VeriMind, an agentic LLM framework for Verilog code generation thatsignificantly automates and optimizes the synthesis process. Unlike traditionalLLM-based code generators, VeriMind employs a structured reasoning approach:given a user-provided prompt describing design requirements, the system firstformulates a detailed train of thought before the final Verilog code isgenerated. This multi-step methodology enhances interpretability, accuracy, andadaptability in hardware design. In addition, we introduce a novel evaluationmetric-pass@ARC-which combines the conventional pass@k measure with AverageRefinement Cycles (ARC) to capture both success rate and the efficiency ofiterative refinement. Experimental results on diverse hardware design tasksdemonstrated that our approach achieved up to $8.3\%$ improvement on pass@kmetric and $8.1\%$ on pass@ARC metric. These findings underscore thetransformative potential of agentic LLMs in automated hardware design, RTLdevelopment, and digital system synthesis.