Chart every program's exact-match rate on the model page - #171
Merged
Conversation
One thin bar per output group, best first, with the program's share of the headline weight beside it, so a reader sees all 18 programs at a glance and why the unweighted rates do not average to the headline (the dollar-heavy tax lines carry most of the weight and are where models miss most). The existing table stays as a collapsible tabular twin. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Below the theme's `sm` breakpoint (48rem) the label, rate and share now share one line and the bar takes the full row width beneath them, so a 320px viewport gives the track 288px instead of zero. Labels wrap there instead of truncating. From `sm` up the four columns stay on one line, the label column is capped at 14rem and the bar track keeps a 6rem minimum, so long labels truncate before the bar shrinks. Adds a test pinning the responsive classes; browser probes at 320, 360, 656, 768 and 1280px confirmed the track widths and no horizontal overflow. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
The model page listed all 18 programs in a table sorted hardest-first, but nothing let a reader take in a model's whole profile at a glance or see why the unweighted rates do not average to the headline. It now shows one thin bar per output group, best first, with the program's share of the headline weight beside each bar, and keeps the table as a collapsible tabular twin.
app/src/lib/programChart.ts:programBars(bench, model)joinsprogramRowswith each output group's share ofglobalWeights.household(summed by output group) and sorts by exact-match rate descending;formatShareprints the share.app/src/components/ProgramBars.tsx: plain HTML list, one row per program: label, a track with the exact-match fill (bg-primaryonbg-surface, rounded end, 2px gap), the rate in mono text, the weight share in muted text; each row'stitlecarries the within-1% rate and output count. Single series, so no legend; text wears text tokens, never the series color.For Claude Fable 5.1 this shows the story behind its 86.9% headline: eligibility flags at 96–100% carry a third of the weight, but federal income tax at 69% carries 19% and state income tax at 63% carries 6%.
Tests
app/tests/programChart.test.ts: 18 bars, descending, federal tax at 69.0% with a 19% share, shares summing to 1; the rendered list has 18 rows with the rate, share and title text.bun run lint && bun run test && bun run buildpass.🤖 Generated with Claude Code