Skip to content
STIMSMITH

Testcase Generation

Concept

Testcase generation is the production of test cases or testsets for validation. The provided evidence covers two major settings: software test-driven development, where recent work generates tests from natural-language requirements using language models or reinforcement learning, and RISC-V instruction-set-simulator verification, where coverage-guided fuzzing and tools such as RISC-V Torture generate instruction testsets.

First seen 5/28/2026
Last seen 5/31/2026
Evidence 9 chunks
Wiki v1

WIKI

Overview

Testcase generation refers to producing test cases or testsets that can be executed to validate a system. In the supplied evidence, the concept appears in two main contexts: software test-driven development (TDD), where requirements can be used as input for text-to-testcase generation, and instruction-set-simulator (ISS) verification, where generated instruction programs are used to expose simulator errors.

Text-to-testcase generation for software

READ FULL ARTICLE →

NEIGHBORHOOD

No graph connections found for this entity yet. It may appear in future ingestion runs.

explore full graph →

RELATIONSHIPS

4 connections
Verifying Instruction Set Simulators using Coverage-guided Fuzzing ← uses 100% 2e
The paper focuses on improving the testcase generation process via fuzzing.
riscv-torture ← uses 100% 2e
RISC-V Torture is a testcase generator for RISC-V ISS verification.
TurboFuzz ← implements 95% 1e
TurboFuzz implements test case generation as part of its verification loop.
TurboFuzz ← uses 90% 1e
TurboFuzz improves test case quality through various mechanisms.

LINKED ENTITIES

2 links
Verifying Instruction Set Simulators using Coverage-guided Fuzzing USES Extracted graph relationship
riscv-torture USES Extracted graph relationship

CITATIONS

11 sources
11 citations — click to expand
[1] In TDD, test cases are written from requirements before implementation code, motivating text-to-testcase generation from requirements rather than source code. PyTester: Deep Reinforcement Learning for Text-to-Testcase Generation
[2] The fine-tuned GPT-3.5 text-to-testcase approach generated 7,000 test cases and reported 78.5% syntactic correctness, 67.09% requirement alignment, and 61.7% code coverage. Enhancing Large Language Models for Text-to-Testcase Generation
[3] PyTester uses deep reinforcement learning for text-to-testcase generation and is reported to outperform larger language models on the APPS benchmark. PyTester: Deep Reinforcement Learning for Text-to-Testcase Generation
[4] The ISS coverage-guided fuzzing workflow first generates a testset and then executes each testcase on the ISS under test and reference ISSs, comparing the results. Verifying Instruction Set Simulators using Coverage-guided Fuzzing
[5] ISS testcases initialize registers to predefined values and write register results to memory so execution output can be dumped and compared. Verifying Instruction Set Simulators using Coverage-guided Fuzzing
[6] The coverage-guided ISS fuzzer adds a testcase to the testset when execution feedback shows increased coverage. Verifying Instruction Set Simulators using Coverage-guided Fuzzing
[7] Functional coverage complements code coverage in the ISS fuzzing approach and is intended to improve thoroughness for computational errors depending on operand values and structure. Verifying Instruction Set Simulators using Coverage-guided Fuzzing
[8] The ISS paper compares official RISC-V ISA directed tests and the RISC-V Torture testcase generator with the coverage-guided fuzzer. Verifying Instruction Set Simulators using Coverage-guided Fuzzing
[9] RISC-V Torture receives no execution feedback, so its generated tests are independent; increasing its testset from 1,000 to 10,000 tests only slightly increased coverage in the reported comparison. Verifying Instruction Set Simulators using Coverage-guided Fuzzing
[10] The coverage-guided fuzzer detected all previously shown errors and found six additional errors, including errors in ISS-UT, Spike, and Forvis. Verifying Instruction Set Simulators using Coverage-guided Fuzzing
[11] The ISS paper concludes that fuzzing is useful for triggering corner cases and error cases and can complement other testcase generation techniques. Verifying Instruction Set Simulators using Coverage-guided Fuzzing