Register one UK full-build graph with all-geography calibration

[juaristi22]

UK population construction and calibration currently span source-spine, national and joint-local drivers, with transformations and acceptance evidence outside the executable graph. This change registers one full build from canonical raw FRS sources through geographic replication, target compilation, calibration, optional exact-count sizing, gates, diagnostics and checked export.

Stacked on #893 at 1cebe3547543bf2917a7af7362bfbb22a05bf964; review against microcosm-us-launch-integration-20260909.

• Calibrate all applicable geographic levels together by default. --target-geographies country explicitly filters the same graph. Pool copies K, exported household count k and target scope remain independent; failed support or fit checks never narrow scope automatically.
• Remove executable frs_hmrc_retained_leaves and hmrc_spi_income stages; retain the canonical spine replacements already present in Consolidate the US survey graph build and enrichment pipeline #893. Retire independent national/joint-local scientific drivers. Legacy command names route into the new full-build/readiness interfaces, but retired flags fail explicitly: these are entry-point shims, not compatibility with old invocation scripts. Use microcosm-build-uk / tools/build_uk_full.py for the maintained build interface.
• Reuse shared execution, typed artifacts, target selection, ordered sparse problem/result codecs, gate evidence and staged file publication. Add explicit same-kind weight-update contracts and correct pandas index alignment for graph writes on sampled populations.
• Preserve UK source/model boundaries, seeds, sampling before cloning, geographic draws, identifiers and solver/selection algorithms. Include the full national register, band edges, independent source pins and national/local checks. Chronicle census cells supply household targets; regional rows remain in calibration while country totals control country-wins reconciliation.
• Restore stage, fit, gate and diagnostic evidence from verified storage. Retain source-phase manifests after downstream exceptions. Checked H5 readback precedes an immutable candidate package and unsigned certification-readiness artifact with explicit missing comparisons.

The coverage manifest also drops the historical pre-spine hmrc_cgt_gains entry, which already declared hmrc_cgt_gains_spine as its replacement. Canonical CGT coverage remains required at build, with pinned source verification, capital-gains output/rewrite checks, the conserved-mass receipt and all 76 published facts fenced from calibration. This removes validation of the old certified-input-H5 route, not canonical CGT construction.

The context mutation guard now includes immutable frame metadata, mass records and declared column order. _context_digest checks for input mutation around kernel execution; it does not directly construct node keys. The shared implementation source changes deliberately change implementation and cache identities. The H1 parity refresh also resolves inherited stale implementation pins: direct input and numerical fixture bytes remain unchanged, and old/new node identities were independently reconstructed. The PR workflow now runs for non-main base branches so stacked PRs receive CI; that trigger remains after merge.

The latest parent adds supplied-parent US export verification and moves US atomic assignment after initial cloning, with a typed geography-gate artifact consumed before financial fitting. Its shared artifact is opt-in. The UK graph retains its existing ladder and assignment method; adopting shared atomic assignment and changing UK stage order remain subsequent work.

Validation includes direct-versus-graph target/matrix/solver parity, required replay, real preflight refusal before solving/export, CLI failure/export evidence, and UK source-spine H2 parity. UK regression runs covered 2,018 distinct cases; corrected fixture cases passed fresh reruns, and the inherited licensed-reference mismatch below remains explicit. Both UK engine and UK-spine jobs passed on the preceding pushed head.

On the merged source, all 521 source-provenance audit cases, 89 shared/UK adapter checks and nine previously failing survey/default/manifest cases pass. Python 3.13 and 3.14 produce identical 438 audit contracts and 1,071 references. All six wheels were rebuilt: 475 Python files and 155 resources match source, wheel and installation, and all 54 installed versions match the lock. The engine-free wheel environment passes 125 shared/UK/export checks; canonical CLI help retains the all-geography default.

All 69 affected parent US acceptance cases pass across seven files, including export comparison, post-clone identity, financial/population graph execution, age-calibration replay and origin-budget integrity checks.

The final ordered regression passes all 101 cases: the complete 58-case PUF file followed by all 43 affected survey/budget cases from CI. All cases execute without skips, errors or failures. An observer checks every teardown and confirms zero changes to sealed producer identities or source bytes.

The reviewed repairs and merged parent are pushed at 051fb972b19d319d58277bd63306d0d0e0947ce2. GitHub CI on this exact head is running; local acceptance does not substitute for its final result.

CI repairs cover issues introduced by this stack and failures in the moving parent:

• Keep synthetic context fixtures consistent with declared column-order metadata; register the shared weight-update implementation; update only independently reconstructed current identity expectations and lock admission.
• Admit eight exact public parameter CSVs needed by the locked US engine only after origin, version, installed-record and content checks. Preserve network, child-process and unlisted-data refusals. All 127 bootstrap controls and 43 maintained seed/loader/inventory checks pass; the complete guarded Linux diagnostic passes on 051fb972, with all 65 source stamps verified against that exact commit. Its output remains candidate-only. Align the expected module list with all 44 maintained calibration modules.
• Reconstruct four omitted solver-default options in independent survey diagnostics while retaining exact comparison and numerical expectations. Repair stale fixture/API expectations and check optional ACS dependencies at their actual fixture boundary; all 422 engine cases execute and pass.
• Classify current source/model preparation separately from population operators. Bind reviewed functions, callers and finite selector definitions; preserve the raw population-operator scan, exact gate-accessor restrictions and adversarial controls. The static audit documents its limits and adds no whole-module provenance exemption.
• Restore a mocked PUF resolver through pytest cleanup instead of reloading its whole production module. The previous teardown changed 82 sealed function identities and caused later budget checks to fail. The repaired predecessor leaves zero identity changes in source and installed wheels; production integrity checks remain intact.

One local test with a licensed cached eFRS file exposes an inherited reference mismatch: the frozen extraction uses PolicyEngine-UK 2.89.0, while both parent and current locks use 2.97.0. The unchanged parent generator reproduces the difference against the pinned H5. The historical reference remains unchanged.

A native f001 smoke reached the UC capital-coherence donor-support refusal, reproduced by a direct call to the maintained helper. The available ladder has the older digest. A full native run against the corrected ladder and native certification remain outstanding; this PR does not publish or certify a production dataset. The maintained command, operation inventory and migration boundaries are documented in docs/uk-full-build-graph.md.

Reconciliation update (2026-09-14, head 434fb64d)

The branch is fast-forwarded onto the current microcosm-us-launch-integration-20260909 head (2300e56b, zero behind main) plus the #918 head (072c2e88, charter amendments 25 and 26). Until #893 takes #918, the diff against the base shows #918's graph changes as well as this PR's; none of the graph-package edits below are this PR's own.

Resolution rules for the 34 conflicting files:

• Graph package, its tests, the charter and the interface lock: Add weight updates and frame context to graph kernels #918's side. This PR's earlier draft of WeightUpdate and the frame-context fields, its test_weight_update.py, its charter section and its B2/kernel-contract edits are dropped. context_frame and uk.full.normalize call Add weight updates and frame context to graph kernels #918's signatures unchanged.
• US-owned tests and tools/spec_seed_identity_diagnostics.py: Consolidate the US survey graph build and enrichment pipeline #893's side. The "CI repairs" bullets above that describe US test fixes from 10 September (the parameter-CSV admission and its VerifiedParameterAssets test, the PUF monkeypatch restore, the survey-diagnostics reconstruction, the us_spine_stage_contracts.json fixture) are superseded by Consolidate the US survey graph build and enrichment pipeline #893's own later fixes and are no longer in this branch.
• UK files this PR rewrote into shims or cut down: this PR's side, with the HEAD-side changes ported into the new modules: Add the frs_relationships UK spine stage and rebind the ONS household-composition cells (#791) #903's frs_relationships transform in uk_runtime/spine_build.py and its ons_household_type enum-domain gate artifact through one shared uk_spine_gate_artifacts() used by the spine gate kernel, the final gates and the driver test; Publish calibration hierarchy schema 8 #855's schema-8 hierarchy carried through the target-registry artifact and the local target surface.
• Stage roster: 29, this PR's 28 plus frs_relationships from Add the frs_relationships UK spine stage and rebind the ONS household-composition cells (#791) #903; the frs_hmrc_retained_leaves / hmrc_spi_income pair stays retired.
• run_graph(population_retention="lazy") is dropped from full_build_cli: the shared executor on main has no retention mode (see the Consolidate the US survey graph build and enrichment pipeline #893 reconciliation record). The full build now holds every population version until the run ends; memory on a K-clone build under eager retention is unmeasured.
• Pins regenerated on the merged tree: the calibrate H1 parity pin, the H2 uk_spine.json fixture, the UK country-bundle spec digest, the UK release-input coverage manifest, APPROVED_UV_LOCK_SHA256 / LOCK_SHA256 for the merged uv.lock, and the microcosm.graph/kernel.py contract in the US implementation inventory.

Shared-package change (flagged): microcosm-calibrate gains TargetSpec.to_dict / TargetSpec.from_dict, the one dict codec for a spec carried by any artifact. TargetRegistry.to_json / from_json and the UK full-build target-registry artifact use it; registry bytes and content versions are unchanged. Raised because the UK reader had to repeat the schema-8 hierarchy decode that #855 put inline in from_json.

Verification on the reconciled tree: graph suite 775/775; spec-engine, lock and merge-touched US tests 1242 passed plus a 72-test confirmation lane; UK full-build, evidence, adapter and calibrate tests 415 passed plus 51 on the six files the fixes touched; registry codec tests 30/30; tools/spec_engine_coverage.py --check 42156/42156 and 41/41; tools/ci_test_groups.py --verify ok; ruff check clean. The engine and wheels CI shards were not run locally. A native full build against the committed references has not been run on this head; it waits for the Chronicle schema fix that lands on main next and the rebase that picks it up.

Deferred by design, to be decided once the stage reordering fixes how weights flow into calibration: adopting the US origin-budget (per-household grouped bounds) for the UK solve, including its reference weight; and declaring the executor design cap on the calibrated node.