Pass/fail grid
Every model against every test.
Definition · Updated Nov 2, 2026
A pass/fail grid crosses models with eval suites and marks each cell pass, flaky or fail. Weak spots and flaky tests show at once. Use it for model evals, browser tests and any matrix of checks.
Pay once. Every update included.
Live preview
Sample data: five models across eight suites from math to safety, pass, flaky and fail
- Data shape
- A result per item and test
- Good for
- Model evals, test matrices
- Avoid when
- Results are scores, not outcomes
- Sizes
- XS, S, M and L, re-laid out from the data
Anatomy
Inspect it like the Figma file.
The same layers, names and tokens as the component. Select one to read its size, fill and style.
Layers
099 / Pass/fail grid
- Layer
- pass
- Type
- Vector
- Size
- 29 × 29
- Stroke
- status/success
- Group
- Marks · 84
Layers
099 / Pass/fail grid
- Layer
- pass
- Type
- Vector
- Size
- 12 × 12
- Stroke
- status/success
- Group
- Marks · 84
Layers
099 / Pass/fail grid
- Layer
- cell
- Type
- Rectangle
- Size
- 16 × 16
- Fill
- status/danger-bg
- Radius
- 5
- Group
- Marks · 84
Sizes
Re-laid out, never scaled.
The same data at XS, S, M and L. Every size is redrawn from the data, so text and line weights never shrink.
M against S
Width360 px480 px
Plot328 px440 px
Labels1313
Marks8484
Height212 px246 px
Same tokens at every size: text styles, 1 px lines and mark radius stay put.
When to use
Where does each model fail?
Three signs it fits, and three signs another type fits better.
Are there several models?
Two versions compared.
Yes: Keep the pass/fail grid
Is it tests, not permissions?
Roles against actions.
Yes: Keep the pass/fail grid
Code and Figma
One name in Figma and in code.
Every Figma property is a prop with the same name and values. One command installs it.
Figma
chart/099-pass-fail-evals
npx shadcn add @chartory/pass-fail-gridimport { PassFailGrid } from "@/components/chartory/pass-fail-grid"import { evalGrid } from "./eval-grid"export function EvalGrid() { return ( <PassFailGrid data={evalGrid} size="m" legend={true} /> )}Hearth widget
Pass/fail grid as a widget.
The chart in a Hearth card with a hero number and two blocks. One token set, light and dark.
EmberPreset
ChartoryDefault preset
Pick the blocks, the size and the preset for your own widget.
Read the Hearth widget docsFAQ
Pass/fail grid questions.
What people ask before they put a pass/fail grid in a dashboard.
Something else?
hello@usechartory.comThe test passed on some runs and failed on others. It has its own colour so it is not mistaken for a real pass.
Short suite names (MATH, CODE, LAW, MED, SQL, VIS, TOOL, SAFE), so eight columns fit.
One data object in the sample’s shape: a result per item and test. The docs page lists every field and links its JSON Schema; the sample data comes with the component, so you can start from it and swap in your own.
Series take the preset’s data colours in order, and states such as up, down or warning take its status colours. Change the preset in Figma or in code to recolour every chart at once.
XS, S, M and L, in light and dark. Each size is laid out again from the data, so text and lines keep their size.
Yes. It plays in when it scrolls into view, and when the data changes every mark moves from its old place to its new one. With reduced motion on, it does not move.
Yes. The React component is free in the public registry in Hearth, no token needed; Signal comes with Code and Complete. The Figma component comes with Figma and Complete.
Ask for it by name. The MCP server tells the agent what data it needs and runs the same command: npx shadcn add @chartory/pass-fail-grid. You review the diff.
Related types
Other ways to show schedule and status.
The same question, a different shape of answer. Every type ships in Figma and in code.
Same family
Schedule and status
19 types in Chartory answer this question.