GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generation
PaperFirst seen 9/3/2026
Last seen 9/3/2026
Evidence 13 chunks
NEIGHBORHOOD
37 nodes · 53 edgesgraph · GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generation · depth=1
RELATIONSHIPS
36 connectionsThe paper uses the ScaleRTL dataset as the source of RTL codes for evaluation and training.
The paper cites Decomposed Prompting to motivate its two-stage task decomposition.
The paper introduces a two-stage framework for test plan generation and testbench execution.
The paper proposes GRPO-SMu as a novel RL training method.
The paper presents a novel tree-based branching mutation strategy for training data curation.
The paper uses supervised fine-tuning as part of its training methodology.
The paper applies reinforcement learning to teach LLMs from verification outcomes.
The paper uses mutation testing to generate buggy RTL variants for evaluation and training.
The paper uses a random test generator to validate mutations and evaluate testbenches.
The paper uses a nuanced reward model operating on a 0-3 scale to distinguish test plan quality.
The paper benchmarks DeepSeek-R1 on RTL verification stimuli generation.
The paper benchmarks Claude-4.0-Sonnet on RTL verification stimuli generation.
The paper uses and evaluates DeepSeek-R1-distill-Qwen-7B as its base small language model.
The paper uses LLaMA-3.1-405B for stage 2 testbench generation and SFT data curation.
ScaleRTL: scaling LLMs with reasoning data and test-time compute for accurate RTL code generation mentions → 100% 2e
The paper cites and uses the ScaleRTL paper's dataset.
BugGen: a self-correcting multi-agent LLM pipeline for realistic RTL bug synthesis mentions → 100% 2e
The paper cites BugGen for its approach to RTL bug synthesis and compares against it.
The paper uses CVDP benchmark for deriving fine-grained mutation operators.
The paper cites DAPO for its token-level loss approach and adapts it for sparse reward handling.
The paper lists Dimple Vijay Kochar as a co-author affiliated with MIT.
The paper evaluates ScaleRTL-32B as an RTL-specific fine-tuned baseline.
The paper lists Haoxing Ren as a co-author affiliated with NVIDIA Research.
The paper lists Brucek Khailany as a co-author affiliated with NVIDIA Research.
The paper lists Chenhui Deng as a co-author affiliated with NVIDIA Research.
The paper's first author is affiliated with MIT.
Multiple co-authors of the paper are affiliated with NVIDIA Research.
DeepSeekMath: pushing the limits of mathematical reasoning in open language models mentions → 100% 1e
The paper cites DeepSeekMath as the origin of the GRPO technique.
The paper uses Claude3.7-Sonnet for SFT data curation and reasoning trace generation.
The paper lists Nathaniel Pinckney as a co-author affiliated with NVIDIA Research.
The paper uses a testbench template as a skeleton stub in stage 2 to reduce syntax errors.
The paper trains DeepSeek-R1-distill-Qwen-7B on the curated SFT training dataset.
The paper uses the GRPO-SMu training dataset constructed via tree-based mutation strategy.
The paper uses functional equivalence checking to validate mutations.
The paper cites VeriContaminated for data contamination concerns.
The paper cites VerilogEval as a benchmark for RTL code generation.
RTLLM: an open-source benchmark for design RTL generation with large language model mentions → 90% 1e
The paper cites RTLLM as a related benchmark for RTL code generation.
The paper cites VeriDebug as related work on bug insertion for dataset building.