Benchmarks used as tests

Tool

External benchmarks acquired from other companies, industry-standard tests, applications and operating systems, and vendor acceptance suites are repurposed as test inputs in Transmeta's Crusoe hardware, software, and development workflow. They complement hand-written tests and automated instruction- and system-level test generators for both VLIW and x86 verification.

First seen 9/21/2026

Last seen 9/21/2026

Evidence 1 chunks

Wiki v1

WIKI

Benchmarks used as tests

In the Transmeta Crusoe hardware, software, and development workflow, externally sourced benchmarks form one category of test inputs alongside hand-written tests and automatically generated instruction- and system-level tests. Tests are organized into two broad suites: a VLIW test suite written entirely in-house, and an x86 test suite that combines in-house tests with externally supplied tests.

Sources of external tests

READ FULL ARTICLE →

NEIGHBORHOOD

No graph connections found for this entity yet. It may appear in future ingestion runs.

explore full graph →

RELATIONSHIPS

1 connections

Automated test farm ← uses 60% 1e

Benchmarks are used as tests within the testing regimen; the farm is the automated facility to run long and batch tests, including benchmarks.

LINKED ENTITIES

1 links

Automated test farm USES Extracted graph relationship

CITATIONS

7 sources

7 citations — click to expand

[1] External tests in the x86 suite include tests bought from other companies, industry-standard tests, applications and OSes used as tests, and acceptance suites used by individual makers. Transmeta Crusoe Hardware, Software, and Development

[2] VLIW tests are all written in-house while x86 tests include both in-house and external tests. Transmeta Crusoe Hardware, Software, and Development

[3] Some benchmarks have a checkable results file, but many do not; crashes and failure to complete are nonetheless treated as checkable failures. Transmeta Crusoe Hardware, Software, and Development

[4] Benchmarks are not designed for fault isolation, but some failures are easy to diagnose, can expose bugs not found by any other test, and are therefore at least triaged. Transmeta Crusoe Hardware, Software, and Development

[5] Automated instruction-level and system-level test generators are used for both VLIW and x86 testing, alongside traditional hand-written tests and real workloads. Transmeta Crusoe Hardware, Software, and Development

[6] In-house farm hardware and software allow automated initialization of CMS, the BIOS, and the hard disk drive, so any machine can be reallocated, configured, and used for purposes such as batch testing. Transmeta Crusoe Hardware, Software, and Development

[7] Video-output pattern-matching tools were developed to evaluate tests but sometimes produced false failures, so video frames were kept for human review. Transmeta Crusoe Hardware, Software, and Development