Backfill the crystal language cost record: engine and corpus rows (Part of #5781) by squid-protocol · Pull Request #6704 · squid-protocol/gitgalaxy

squid-protocol · 2026-10-26T02:32:33Z

Part of #5781. Slice 2: crystal cost-log backfill.

Adds two rows to gitgalaxy/standards/language_addition_costs.jsonl via record_language_cost.py --manual:

engine (issue Language support: F# (.fs/.fsi/.fsx) and Crystal (.cr) files are not mapped at all (fsharp-doom 18 files, doo-cr 43 files) #5623): from PR Crystal: add the .cr language profile (Part of #5623) #5695 (.cr profile, 2026-10-20 06:01Z to 06:15Z) and Crystal: status doc and language_status row (Part of #5623) #5705 (status doc, 08:02Z to 08:12Z); tokens and cost unmeasured, no transcript.
corpus (issue keyword-rosetta: Crystal (crystal) has no control folder; author data/crystal/ and backfill its cost record #5781): keyword-rosetta PR The Router Prefix Blindspot (False Positives) for full_api_network_map #163; start time, tokens and cost unmeasured (transcript compacted).

language_addition_audit.py --lang crystal (KEYWORD_ROSETTA_PATH = checkout of PR #163's branch) prints no "no control folder" warning and ends OK: all 5 registration invariants hold across 71 languages. Two warnings remain, both listed below.

Class / Sibling gaps

Class: language-addition cost-ledger rows (engine + corpus half) for a language added without them. Crystal: both now recorded. Other members of the class are handled by their own PRs (#6652 acs, #6655 postgresql, #6657 zscript).
Sibling gaps:

fidelity_table.py FIDELITY_PROVENANCE pins 51 corpus languages; rosetta has 52 with crystal. Re-pin (corpus_sha + count) after keyword-rosetta PR The Router Prefix Blindspot (False Positives) for full_api_network_map #163 merges, since it needs the merged sha.
crystal missing from _CLASS_START_NAMED_EXTRACTION_LANGS (detector.py); needs the harden-class-start-extraction pass.
Engine api rule for top-level crystal def (ledger entry crystal-api-rule-top-level-def in PR The Router Prefix Blindspot (False Positives) for full_api_network_map #163).
calls_out reads the Array(Int32) type restriction as a call.

Remaining slices

Fidelity re-pin after rosetta #163 merges (1 generated file).

Cross-repo: companion keyword-rosetta PR #163 (not merged, owner's call). Either order is fine; the re-pin runs after #163.

🤖 Generated with Claude Code

Golden re-bless (fix round)

doom_rosetta_check.py --only dartdoom,doom-scheme --update --yes: 37 dartdoom and 20 doom-scheme file func_hash changes, the same counts CI reported. Attributed to main's #6700 (Scheme case clauses, Dart break/continue), which did not re-bless these two doom-rosetta goldens. No engine change in this PR. If #6705 or another PR re-blesses them first, take main's on merge.

…rt of #5781) Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

…rows) Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

squid-shepherd · 2026-10-26T02:33:48Z

No description provided.

squid-shepherd · 2026-10-26T02:33:50Z

No description provided.

github-actions · 2026-10-26T02:35:48Z

🐦‍⬛ Muninn Security Scan

✅ No security issues found.

🐦‍⬛ Powered by Muninn · Skald Lab

squid-shepherd · 2026-10-26T02:36:04Z

PR #6704 @ 261fdbb: 17 failed check(s)

== crucible (failure) -- real
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716693/job/121369246812
repro: tests/tools/box/heavy-run.sh python -m pytest -q tests/cics_crucible && tests/tools/box/heavy-run.sh python tests/tools/cics_crucible.py --ci --out /tmp/gitgalaxy-scratch/ci-digest/cics
errors:
Traceback (most recent call last):
FileNotFoundError: [Errno 2] No such file or directory: '/home/runner/work/_temp/shards/cics-crucible-shard-*/results.json'
##[error]Process completed with exit code 1.
log tail:
pythonLocation: /opt/hostedtoolcache/Python/3.12.15/x64
PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.12.15/x64/lib/pkgconfig
Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.12.15/x64
Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.12.15/x64
Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.12.15/x64
LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.12.15/x64/lib
##[endgroup]
No files were found with the provided path: /home/runner/work/_temp/cics_crucible. No artifacts will be uploaded.
##[group]Run echo "measure: cancelled, runner-tests: cancelled"
echo "measure: cancelled, runner-tests: cancelled"
[ "cancelled" = "success" ] && [ "cancelled" = "success" ]
shell: /usr/bin/bash -e {0}
env:
GITGALAXY_LICENSE_KEY: COMMUNITY_FREE_TIER
PYTHONUTF8: 1
pythonLocation: /opt/hostedtoolcache/Python/3.12.15/x64
PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.12.15/x64/lib/pkgconfig
Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.12.15/x64
Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.12.15/x64
Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.12.15/x64
LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.12.15/x64/lib
##[endgroup]
measure: cancelled, runner-tests: cancelled
##[error]Process completed with exit code 1.
Post job cleanup.
[command]/usr/bin/git version
git version 2.55.0
Temporarily overriding HOME='/home/runner/work/_temp/edb685b8-8644-4489-8c44-cb7db292a5ef' before making global git config changes
Adding repository directory to the temporary git global config as a safe directory
[command]/usr/bin/git config --global --add safe.directory /home/runner/work/gitgalaxy/gitgalaxy/gitgalaxy
Removing SSH command configuration
[command]/usr/bin/git config --local --name-only --get-regexp core.sshCommand
[command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
Removing HTTP extra header
[command]/usr/bin/git config --local --name-only --get-regexp http.https://github.com/.extraheader
[command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http.https://github.com/.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
Removing includeIf entries pointing to credentials config files
[command]/usr/bin/git config --local --name-only --get-regexp ^includeIf.gitdir:
[command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url
Cleaning up orphan processes

== db2 (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716705/job/121369248257
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== db2 ${{ matrix.shard }} (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716745/job/121369246827
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== det (failure) -- real
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716745/job/121369247918
repro: tests/tools/box/heavy-run.sh python tests/tools/proof_sweep.py --det-only --skip-db2 --cases --work /tmp/gitgalaxy-scratch/ci-digest/sweep
errors:
##[error]Process completed with exit code 1.
log tail:
compression-level: 6
overwrite: false
include-hidden-files: false
archive: true
env:
pythonLocation: /opt/hostedtoolcache/Python/3.12.15/x64
PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.12.15/x64/lib/pkgconfig
Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.12.15/x64
Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.12.15/x64
Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.12.15/x64
LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.12.15/x64/lib
##[endgroup]
With the provided path, there will be 175 files uploaded
Artifact name is valid!
Root directory input is valid!
Uploading artifact: det-sweep-ledger.zip
Beginning upload of artifact content to blob storage
Uploaded bytes 151774
Finished uploading artifact content to blob storage!
SHA256 digest of uploaded artifact is 9978bef75e6f56a0a3d9d093b64d66fff1bd6bac0b5d787912c2258ceb07a269
Finalizing artifact upload
Artifact det-sweep-ledger successfully finalized. Artifact ID 12624535989
Artifact det-sweep-ledger has been successfully uploaded! Final size is 151774 bytes. Artifact ID is 12624535989
Artifact download URL: https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716745/artifacts/12624535989
Post job cleanup.
[command]/usr/bin/git version
git version 2.55.0
Temporarily overriding HOME='/home/runner/work/_temp/754dd599-460e-4519-bfb3-ec1dc63a7a4d' before making global git config changes
Adding repository directory to the temporary git global config as a safe directory
[command]/usr/bin/git config --global --add safe.directory /home/runner/work/gitgalaxy/gitgalaxy
Removing SSH command configuration
[command]/usr/bin/git config --local --name-only --get-regexp core.sshCommand
[command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
Removing HTTP extra header
[command]/usr/bin/git config --local --name-only --get-regexp http.https://github.com/.extraheader
[command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http.https://github.com/.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
Removing includeIf entries pointing to credentials config files
[command]/usr/bin/git config --local --name-only --get-regexp ^includeIf.gitdir:
[command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url
Cleaning up orphan processes

== full-suite (failure) -- real
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716775/job/121369247531
repro: python -m pytest -q tests
errors:
##[error]Process completed with exit code 1.
log tail:
Commit: 21505ad2541d5be6135ed84fc33697146cf75b8e
Build Date: 2026-10-21T00:45:21Z
Worker ID: {a3207750-3ef3-4b07-b0de-5692d9ca0a8c}
Region: westcentralus
Cloud: Azure
##[endgroup]
##[group]Operating System
Ubuntu
24.04.5
LTS
##[endgroup]
##[group]Runner Image
Image: ubuntu-24.04
Version: 20261012.334.1
Included Software: https://github.com/actions/runner-images/blob/ubuntu24/20261012.334/images/ubuntu/Ubuntu2404-Readme.md
Image Release: https://github.com/actions/runner-images/releases/tag/ubuntu24%2F20261012.334
##[endgroup]
##[group]GITHUB_TOKEN Permissions
Contents: read
Metadata: read
##[endgroup]
Secret source: Actions
Cache mode: write
Prepare workflow directory
Prepare all required actions
Complete job name: full-suite
##[group]Run echo "full-suite parts: $PARTS (tested-tree skip: $SKIP, suite plan: $PLAN)"
echo "full-suite parts: $PARTS (tested-tree skip: $SKIP, suite plan: $PLAN)"
# #4935: "skipped" is a pass only when the gate proved this tree green on the PR; otherwise it is a failure.
# #6278: or when the suite plan proved the PR changes only prose no test or engine code opens (mode skip).
test "$PARTS" = "success" || { test "$PARTS" = "skipped" && { test "$SKIP" = "true" || test "$PLAN" = "skip"; }; }
shell: /usr/bin/bash -e {0}
env:
PARTS: cancelled
SKIP:
PLAN:
##[endgroup]
full-suite parts: cancelled (tested-tree skip: , suite plan: )
##[error]Process completed with exit code 1.
Cleaning up orphan processes

== full-suite part ${{ matrix.group }}/${{ needs.shard-plan.outputs.splits }} (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716775/job/121369248227
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== ground-truth (failure) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716689/job/121369246922
repro: python tests/tools/pr_gates.py --ratchets --only-ratchets ground-truth (when a ground-truth part failed too, run that part's repro)
errors:
##[error]Process completed with exit code 1.
log tail:
##[endgroup]
##[group]Operating System
Ubuntu
24.04.5
LTS
##[endgroup]
##[group]Runner Image
Image: ubuntu-24.04
Version: 20261012.334.1
Included Software: https://github.com/actions/runner-images/blob/ubuntu24/20261012.334/images/ubuntu/Ubuntu2404-Readme.md
Image Release: https://github.com/actions/runner-images/releases/tag/ubuntu24%2F20261012.334
##[endgroup]
##[group]GITHUB_TOKEN Permissions
Contents: read
Metadata: read
##[endgroup]
Secret source: Actions
Cache mode: write
Prepare workflow directory
Prepare all required actions
Complete job name: ground-truth
##[group]Run echo "ground-truth warm: $WARM, parts: $PARTS (tested-tree skip: $SKIP, plan mode: $MODE, layout: $LAYOUT, warm planned: $PLANNED_WARM)"
echo "ground-truth warm: $WARM, parts: $PARTS (tested-tree skip: $SKIP, plan mode: $MODE, layout: $LAYOUT, warm planned: $PLANNED_WARM)"
# #4935: "skipped" is a pass only when the gate proved this tree green on the PR; otherwise it is a failure
# #5164: ... or when the plan found no ground-truth input in the PR (mode none). An empty mode is not none.
ok() { test "$1" = "success" || { test "$1" = "skipped" && { test "$SKIP" = "true" || test "$MODE" = "none"; }; }; }
# #5543: ... or when the layout needs no warm job (a cache hit on the scans, or the busy layout): the parts then warm for themselves
{ ok "$WARM" || { test "$WARM" = "skipped" && test "$PLANNED_WARM" = "false"; }; } && ok "$PARTS"
shell: /usr/bin/bash -e {0}
env:
WARM: cancelled
PARTS: cancelled
SKIP:
MODE:
PLANNED_WARM:
LAYOUT:
##[endgroup]
ground-truth warm: cancelled, parts: cancelled (tested-tree skip: , plan mode: , layout: , warm planned: )
##[error]Process completed with exit code 1.
Cleaning up orphan processes

== ground-truth part ${{ matrix.shard }} (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716689/job/121369248173
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== ground-truth-warm (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716689/job/121369247480
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== measure (shard ${{ matrix.shard }}/${{ matrix.total }}) (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716693/job/121369247509
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== plan the suite parts (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716775/job/121369248646
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== publish-history (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716689/job/121369266092
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== shard ${{ matrix.group }}/3 (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716705/job/121369248030
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== shard ${{ matrix.shard }} (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716745/job/121369246803
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== shard ${{ matrix.shard }} (${{ matrix.loc }} LOC) (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716744/job/121369248177
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== store the suite's durations (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716775/job/121369249015
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

== suite time budget (#5166) (cancelled) -- infra
https://github.com/squid-protocol/gitgalaxy/actions/runs/40259716775/job/121369248911
repro: python tests/tools/pr_gates.py --fast
log tail:
(log unavailable: gh: HTTP 404)

…gine change (Part of #5781) Drift came from main (#6700: Scheme case clauses, Dart break/continue), not this PR. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

squid-shepherd · 2026-10-26T03:05:07Z

No description provided.

squid-shepherd · 2026-10-26T03:10:42Z

No description provided.

squid-protocol and others added 2 commits October 25, 2026 22:32

Backfill the crystal language cost record: engine and corpus rows (Pa…

cf90477

…rt of #5781) Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

Merge origin/main (language_addition_costs.jsonl: keep both appended …

261fdbb

…rows) Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

squid-protocol added the shepherd:merge Maintainer: merge when green (auto-merge, squash). Guide: docs/ci.md label Oct 26, 2026

squid-shepherd Bot marked this pull request as ready for review October 26, 2026 02:33

squid-shepherd Bot enabled auto-merge (squash) October 26, 2026 02:36

Re-bless doom-rosetta goldens dartdoom and doom-scheme for #6700's en…

a1cc559

…gine change (Part of #5781) Drift came from main (#6700: Scheme case clauses, Dart break/continue), not this PR. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

squid-protocol added shepherd:merge Maintainer: merge when green (auto-merge, squash). Guide: docs/ci.md and removed shepherd:merge Maintainer: merge when green (auto-merge, squash). Guide: docs/ci.md labels Oct 26, 2026

squid-shepherd Bot removed the shepherd:needs-fix Bot: a real failure on this head; see the digest comment. Guide: docs/ci.md label Oct 26, 2026

squid-shepherd Bot merged commit 3acc75b into main Oct 26, 2026
63 checks passed

squid-shepherd Bot deleted the churn/5781-20261025T1830Z branch October 26, 2026 03:23

Navigation Menu

Repository navigation

Backfill the crystal language cost record: engine and corpus rows (Part of #5781) - #6704

Backfill the crystal language cost record: engine and corpus rows (Part of #5781)#6704
squid-shepherd[bot] merged 3 commits into
mainfrom
churn/5781-20261025T1830Z

squid-protocol commented Oct 26, 2026 •

edited

Loading

Uh oh!

squid-shepherd Bot commented Oct 26, 2026

Uh oh!

squid-shepherd Bot commented Oct 26, 2026

Uh oh!

github-actions Bot commented Oct 26, 2026

Uh oh!

squid-shepherd Bot commented Oct 26, 2026

Uh oh!

squid-shepherd Bot commented Oct 26, 2026

Uh oh!

squid-shepherd Bot commented Oct 26, 2026

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

squid-protocol commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Class / Sibling gaps

Remaining slices

Golden re-bless (fix round)

Uh oh!

squid-shepherd Bot commented Oct 26, 2026

Uh oh!

squid-shepherd Bot commented Oct 26, 2026

Uh oh!

github-actions Bot commented Oct 26, 2026

🐦‍⬛ Muninn Security Scan

Uh oh!

squid-shepherd Bot commented Oct 26, 2026

Uh oh!

squid-shepherd Bot commented Oct 26, 2026

Uh oh!

squid-shepherd Bot commented Oct 26, 2026

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

squid-protocol commented Oct 26, 2026 •

edited

Loading