Repository navigation
[AIGTWY-4880] Add native budget and model evidence for CUJ5 - #915
Closed
andy-xu-db wants to merge 1 commit into
Closed
andy-xu-db wants to merge 1 commit into
andy-xu-db wants to merge 1 commit into
Conversation
This was referenced Sep 30, 2026
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
September 30, 2026 20:16
2a43691 to
8ab0906
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
September 30, 2026 20:16
3d11500 to
3757625
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
September 30, 2026 20:26
8ab0906 to
bae3286
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
September 30, 2026 20:26
3757625 to
a9beae9
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
September 30, 2026 20:39
bae3286 to
79a23dd
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
September 30, 2026 20:39
a9beae9 to
edf1288
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
September 30, 2026 20:49
79a23dd to
7b6553e
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
September 30, 2026 20:49
edf1288 to
caddcd4
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 14:38
7b6553e to
ef0dfb4
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
2 times, most recently
from
October 1, 2026 15:05
4ff6751 to
989bf6d
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 15:05
ef0dfb4 to
3830958
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 1, 2026 15:09
989bf6d to
bf245ba
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 15:09
3830958 to
b2c5c7c
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 1, 2026 16:24
bf245ba to
bf3e3ac
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
2 times, most recently
from
October 1, 2026 16:29
5f28dfc to
131af08
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
2 times, most recently
from
October 1, 2026 16:37
d1505fc to
5e656bd
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 16:37
131af08 to
5a8abeb
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 1, 2026 17:17
5e656bd to
715d107
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 17:17
5a8abeb to
9e8519f
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 1, 2026 18:51
715d107 to
b890d33
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 18:51
9e8519f to
3ffdb7f
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 18:56
3ffdb7f to
c7ccaa6
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 1, 2026 18:56
b890d33 to
d0e1889
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 20:24
d320e1d to
07a1c94
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 1, 2026 20:24
b9ad28e to
2546e7c
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 20:29
07a1c94 to
b47bd5b
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 1, 2026 20:29
2546e7c to
568d966
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 20:33
b47bd5b to
b3c3946
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
2 times, most recently
from
October 1, 2026 20:38
f15cef7 to
fb45b7f
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 20:38
b3c3946 to
ff50a7b
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 1, 2026 20:43
fb45b7f to
34c8692
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 20:43
ff50a7b to
bf72d55
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 1, 2026 20:47
34c8692 to
5df19cb
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 1, 2026 20:47
bf72d55 to
fa66168
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 1, 2026 20:57
5df19cb to
6a96c46
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
2 times, most recently
from
October 2, 2026 13:36
b07e258 to
6eaabe9
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
4 times, most recently
from
October 2, 2026 14:04
158b51f to
0fcc784
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 2, 2026 14:26
6eaabe9 to
cf56ee8
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
2 times, most recently
from
October 2, 2026 15:42
98540a1 to
6126184
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
2 times, most recently
from
October 2, 2026 16:49
56fa5f9 to
c848559
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 2, 2026 16:49
6126184 to
24833d7
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-evidence
branch
from
October 2, 2026 17:03
24833d7 to
3ecec0e
Compare
andy-xu-db
force-pushed
the
andy-xu-db/stack/andy/aigtwy-4880-budget-fixture
branch
from
October 2, 2026 17:03
c848559 to
6c4f77a
Compare
Collaborator
Author
|
Consolidated into #911, which now contains the complete CUJ5 integration test change as one commit against main. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🥞 Stacked PR
Summary
Add independent evidence helpers for CUJ5's budget-driven smart-default journeys. They verify the selected native-agent process, completed task request model, displayed budget values, and recommendation.
Changes
ug usagewith backend spend, limit, percentage, and meter values using their display rounding.Configuration
The concrete CUJ5 target is declared by the workflow in PR #911. PR #913 forwards that metadata to pytest and keeps it out of native agent environments.
Verification
The complete stack passed 119 focused tests. Evidence cases cover terminal formatting, native process identification, root-session filtering, model spelling normalization, and rejection of missing, mismatched, or later Codex turn contexts. The seven-case live run verified completed-task model correlation for both native agents.