Conformance
Outline
This page is an outline. The structure is settled; the prose is not written.
Where it stands
| suite | scoreable | passing |
|---|---|---|
| YAML test suite, decoder | 371 | 371 |
YAML test suite, ToJSON | 274 | 272 |
| reference-parser oracle | 393 | 393 |
The generated corpus covers 605 buckets over 14684 cases, of which 567 agree with the oracle.
What the page must answer
- What is being measured, and against what?
- What does “scoreable” exclude, and why?
- Where do I look when my document is handled differently from another parser?
Sections
- The three yardsticks: the YAML test suite, a reference parser used as an oracle, and a generated corpus
- What is deliberately not conformant, if anything
- How to report a document that decodes wrongly
Warning
Every number on this page comes from metrics.yaml. Never type a score into
prose — use siteparam, so one edit moves every page.