Skip to content

Propose a doc-status gate before the draft PR - #180

Open
KjellKod wants to merge 1 commit into
mainfrom
idea/doc-status-before-draft-pr
Open

KjellKod wants to merge 1 commit into
mainfrom
idea/doc-status-before-draft-pr

Conversation

@KjellKod

@KjellKod KjellKod commented Sep 23, 2026 •

Copy link
Copy Markdown
Owner

⭐ Why this matters

Quest stamps a status: on the documents it writes, at authoring time, and
nothing ever updates it. Shipped work therefore keeps announcing that it is
unmerged, and agents read that as fact.

  • Stops Quest manufacturing a phantom backlog of already-finished work.
  • Removes a class of confidently-wrong context that agents cannot detect.

Summary

Adds an idea proposing that any housekeeping documentation a Quest touched must
describe the state being delivered before the draft PR is created, with an
explicit opt-out for records that deliberately preserve a point-in-time view.

  • Idea only. No behavior, script, or skill changes.

Changes

  • Ideas: adds ideas/2026-09-22-quest-doc-status-before-draft-pr.md and its
    row in the ideas/README.md Governance and Enforcement index.

Validation

  • Read the idea at ideas/2026-09-22-quest-doc-status-before-draft-pr.md
    and judge whether the gate belongs at draft-PR time (option A), in
    pr-shepherd at merge (option B), or as a CI lint (option C). The
    document argues for A with C as a safety net.
  • Confirm the index entry renders in the Governance and Enforcement
    table in ideas/README.md.

Watch for: the four open questions at the end are genuinely open, in particular
whether the gate should block draft-PR creation or only warn. Blocking risks a
documentation field stopping delivery; warning risks being ignored.

Notes

  • Evidence is from a downstream repository, quoted as a status-versus-reality
    table. Seven records claimed unmerged work that had shipped, verified against
    merged PRs and against the code being present on main.
  • Deliberately does not propose a closed status: vocabulary. Quest does not
    own downstream repositories' documentation conventions.
     ▐▛███▜▌
    ▝▜█████▛▘
      ▘▘ ▝▝
Quest/Co-Authored by
Co-Authored-By: Claude Opus 5 (1M context) 
in collaboration with KjellKod

Review in cubic

A Quest writes housekeeping documentation as it goes and stamps each
document with a status at authoring time. Nothing updates it, so a
record says "delivered as draft PR, not merged" forever, including long
after the PR merged.

Observed in a downstream repo: seven implementation records all claimed
unmerged work that had shipped, and the same mechanism had left the
README telling visitors the product was not for sale months after it
became purchasable.

This matters because agents read a status field as fact. A stale one is
worse than a missing one, since it is confidently wrong and nothing in
the repository contradicts it. It also manufactures a phantom backlog of
work that is already done.

Proposes the gate at draft-PR time, where the agent still has the
context on what those documents claim, with pr-shepherd and a CI lint as
weaker backstops. Leaves open whether the gate blocks or warns, whether
status should become a closed vocabulary, and whether journals should be
exempt because they legitimately record what was believed at the time.

Idea only. No behavior changes.

Quest/Co-Authored by
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
in collaboration with KjellKod <kjell.hedstrom@gmail.com>
@KjellKod
KjellKod marked this pull request as ready for review September 24, 2026 23:03
@KjellKod
KjellKod deployed to codex-ci-review September 24, 2026 23:03 — with GitHub Actions Active

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 issue found across 2 files

Prompt for AI agents (unresolved issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="ideas/2026-09-22-quest-doc-status-before-draft-pr.md">

<violation number="1" location="ideas/2026-09-22-quest-doc-status-before-draft-pr.md:6">
P3: The Origin line reports "Four separate stale-status incidents," but the evidence section below cites seven records (a seven-row table, "seven implementation records claimed the work was unmerged") plus a README case, and the phantom-work bullet repeats "Seven shipped features." The number 4 is never reconciled with the 7, so the count reads as a contradiction. Say "seven stale-status records across four incidents" or align the intro with the table.</violation>
</file>

Reply with feedback, questions, or to request a fix.

Re-trigger cubic

Date: 2026-09-22
Status: `proposed`
Origin: surfaced while auditing documentation in a downstream repo that uses
Quest. Four separate stale-status incidents in one session, all the same

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P3: The Origin line reports "Four separate stale-status incidents," but the evidence section below cites seven records (a seven-row table, "seven implementation records claimed the work was unmerged") plus a README case, and the phantom-work bullet repeats "Seven shipped features." The number 4 is never reconciled with the 7, so the count reads as a contradiction. Say "seven stale-status records across four incidents" or align the intro with the table.

Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At ideas/2026-09-22-quest-doc-status-before-draft-pr.md, line 6:

<comment>The Origin line reports "Four separate stale-status incidents," but the evidence section below cites seven records (a seven-row table, "seven implementation records claimed the work was unmerged") plus a README case, and the phantom-work bullet repeats "Seven shipped features." The number 4 is never reconciled with the 7, so the count reads as a contradiction. Say "seven stale-status records across four incidents" or align the intro with the table.</comment>

<file context>
@@ -0,0 +1,118 @@
+Date: 2026-09-22
+Status: `proposed`
+Origin: surfaced while auditing documentation in a downstream repo that uses
+Quest. Four separate stale-status incidents in one session, all the same
+mechanism. Analysis only, no code changed.
+
</file context>
Suggested change
Quest. Four separate stale-status incidents in one session, all the same
Quest. Seven stale-status records across four separate incidents in one session, all the same

Copy link
Copy Markdown
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cubic-dev-ai fix this.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@KjellKod Fix with cubic is available during trial and on the Pro plan. Upgrade your plan to use this feature. https://www.cubic.dev/settings?tab=subscription

This branch was successfully deployed

1 active deployment
codex-ci-review — ea1f02b4 Deployed Sep 24, 2026 by KjellKod via codex-review #739
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant