feat(dashboard): storyboard count as canonical compliance headline#4374
Merged
feat(dashboard): storyboard count as canonical compliance headline#4374
Conversation
Adds an "X / Y storyboards passing" element between the SDK headline
("2 silent" etc.) and the track pills, with a tooltip explaining the
relationship:
storyboards = canonical conformance unit
(each applicable specialism + protocol baseline +
universal check is one storyboard, pass or fail)
track pills = SDK's coarse roll-up that can read as "passing" even
when underlying storyboards are partial — useful for
quick glance but misleading in isolation
Track pills gain their own tooltip pointing readers at the Verification
panel for per-storyboard detail.
Resolves the Evgeny-shape disconnect from escalation #329: track
summary showed "2 silent / 30 of 30 scenarios passing" while the
agent's signal_owned specialism storyboard was 1/5 steps. With the
data flowing correctly after PR #4364, this surface change closes the
loop on the adtech-product reviewer's "deprecate track summary on the
public dashboard, keep it operator-only" call by making the storyboard
count visually prominent and clarifying that the SDK track pills are
debug context.
Push A item 4 of 4 in the compliance reporting fidelity initiative.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds an "X / Y storyboards passing" headline element on the dashboard agent card, with a tooltip that names the canonical / debug relationship between storyboard counts and SDK track pills.
Push A item 4 of 4 in the compliance reporting fidelity initiative.
Why
Escalation #329 surfaced a real product gap: track summary showed "2 silent" (correct per SDK silent-track semantics — no negative observations) while the agent's
signal_ownedspecialism storyboard was 1/5 steps. The dashboard had no surface to communicate which number to trust. With #4364 making storyboard data flow correctly, this change closes the loop visually:What changed
<div class="agent-storyboard-summary">between the headline and track pills. RendersX / Y storyboards passingwith a tooltip explaining the canonical-ness whenstoryboards_total > 0.<div class="agent-tracks">) gains atitleattribute pointing readers at the Verification panel for the per-storyboard view.Test plan
Out of scope (potential follow-ups)
🤖 Generated with Claude Code