Skip to content

docs(skills): stop mutate.sh on a check.sh tool error and refuse a second --fact - #689

Merged
ThomasK33 merged 2 commits into
mainfrom
skill-lane-followups
Nov 5, 2026
Merged

ThomasK33 merged 2 commits into
mainfrom
skill-lane-followups

Conversation

@ThomasK33

@ThomasK33 ThomasK33 commented Nov 5, 2026 •

Copy link
Copy Markdown
Member

Why

verify-lane-schedule must claim only what it checks, and a reader must be able to rerun its Validation steps. The final review of #677 found three small gaps, and this PR fixes them.

What

  • mutate.sh now runs each config it uses unmodified before its first break. When check.sh cannot run at all there (exit 3, for example a missing Java or a TLC error), mutate.sh stops with exit 3 before any break, and prints check.sh's own error line or TLC's Error: line. Before, it printed "BASELINE ... does not pass unmodified" and exited 1, which reads like a model failure, and it ran the LaneSchedule.cfg baseline only after the first break.
  • check.sh refuses a second --fact with exit 3. Before, --fact A=FALSE --fact B=FALSE silently flipped only B.
  • SKILL.md lists PushClaimExpiresAt among the S3-WAL push-lane protocol columns that toRepoUpstream copies. worker_push.go reads it.

Validation

  • JAVA=/nonexistent/java mutate.sh --model: exit 3, with "check.sh could not run on unmodified Liveness.cfg (exit 3, ...): check.sh: needs Java 11+".
  • A scratch worktree with MaxRetries removed from LaneSchedule.cfg: mutate.sh exits 3 with "Error: The constant parameter MaxRetries is not assigned a value by the configuration file.", prints no break line, and leaves git diff empty.
  • check.sh --fingerprints-only --fact ClaimMarksDue=FALSE --fact RetryRemarks=FALSE: exit 3, "--fact takes one fact per run".
  • mutate.sh --model and mutate.sh: both COUNT: 9/9, and git status showed only the uncommitted skill files afterwards.
  • check.sh --fingerprints-only: exit 0. shellcheck (check.sh, mutate.sh) and scripts/check-doc-links.py pass.

No product code changes.

Refs #677


Generated with xum • Model: anthropic:claude-opus-5-5 • Thinking: high

…cond --fact

mutate.sh exits 3 with check.sh's error when check.sh cannot run on an
unmodified config, instead of reporting a failing baseline. check.sh
refuses a second --fact. SKILL.md lists PushClaimExpiresAt among the lane
columns toRepoUpstream copies.

_Generated with [`xum`](https://github.com/coder/xum) • Model: `anthropic:claude-opus-5-5` • Thinking: `high`_

Change-Id: Iba285f22612ee8e06fa1cd717d958cdbdab043df
Signed-off-by: Thomas Kosiewski <tk@coder.com>
@ThomasK33

Copy link
Copy Markdown
Member Author

@codex review

@ThomasK33

Copy link
Copy Markdown
Member Author

@codex security review

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Nov 5, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-11-05T22:10:22.805151Z ee5a3fb Manual request
🔒 Security Review ✅ Completed 2026-11-05T22:10:16.944036Z ee5a3fb Manual request
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. What shall we delve into next?

Reviewed commit: f24716d15f

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@chatgpt-codex-connector

Copy link
Copy Markdown

🛡️ Codex Security Review

Security review completed. No security issues were found in this pull request.

Reviewed commit: f24716d15f

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

…real error

mutate.sh now runs every config's unmodified baseline before it edits any
file, so a check.sh exit 3 stops the run before the first break. Its exit-3
message quotes check.sh's own error line or TLC's Error: line instead of the
last output line. SKILL.md calls the toRepoUpstream columns the push-lane
protocol columns.

_Generated with [`xum`](https://github.com/coder/xum) • Model: `anthropic:claude-opus-5-5` • Thinking: `high`_

Change-Id: I9eb7f9311cfc39909e88b7a50c6cc1f68355d303
Signed-off-by: Thomas Kosiewski <tk@coder.com>
@ThomasK33

Copy link
Copy Markdown
Member Author

@codex review

@ThomasK33

Copy link
Copy Markdown
Member Author

@codex security review

@chatgpt-codex-connector

Copy link
Copy Markdown

🛡️ Codex Security Review

Security review completed. No security issues were found in this pull request.

Reviewed commit: ee5a3fbfa2

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Nice work!

Reviewed commit: ee5a3fbfa2

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@ThomasK33
ThomasK33 added this pull request to the merge queue Nov 5, 2026
Merged via the queue into main with commit 6490d41 Nov 5, 2026
11 checks passed
@ThomasK33
ThomasK33 deleted the skill-lane-followups branch November 5, 2026 23:17
ThomasK33 added a commit that referenced this pull request Nov 6, 2026
Change-Id: Ib57fdfb972853f6f778efdd69495112629eb8181
Signed-off-by: Thomas Kosiewski <tk@coder.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant