Package dev.omnist.conformance
Class Track1Runner
java.lang.Object
dev.omnist.conformance.Track1Runner
Track 1 of the conformance harness: runs the compiled
omnist CLI as a real
subprocess against the fixture-based test suite (omnist-spec ยง8.5) and compares its
stdout/stderr/exit-code against each fixture's expected result.-
Method Summary
Modifier and TypeMethodDescriptionstatic intHow many of the fixtures counted by the lastrunTrack1(java.nio.file.Path, java.nio.file.Path)were the_referee-self-test/*cases (omnist-j#110): the other ports do not fold these into their Track 1 headline, so the per-port-comparable figure is the tally minus this.static int[]Runs every fixture underfixturesDiragainst the CLI jar built fromrepoDirand returns the tally.
-
Method Details
-
refereeSelfTestCount
public static int refereeSelfTestCount()How many of the fixtures counted by the lastrunTrack1(java.nio.file.Path, java.nio.file.Path)were the_referee-self-test/*cases (omnist-j#110): the other ports do not fold these into their Track 1 headline, so the per-port-comparable figure is the tally minus this.- Returns:
- the number of referee self-test fixtures seen
-
runTrack1
Runs every fixture underfixturesDiragainst the CLI jar built fromrepoDirand returns the tally.- Parameters:
fixturesDir- directory containing the Track 1 fixture filesrepoDir- the repo root, used to locatetarget/omnist-j-*.jar- Returns:
- a 3-element array
{pass, fail, skip} - Throws:
Exception- if a fixture cannot be read or the CLI subprocess cannot be launched
-