Skip to content

[ENG-3771] projects-cli-1: default project UX#732

Open
mrmoxon wants to merge 2 commits into
projects-cli-0from
projects-cli-1
Open

[ENG-3771] projects-cli-1: default project UX#732
mrmoxon wants to merge 2 commits into
projects-cli-0from
projects-cli-1

Conversation

@mrmoxon

@mrmoxon mrmoxon commented Jun 8, 2026

Copy link
Copy Markdown

Summary

  • stack on [ENG-3771] projects-cli-0: explicit projects CLI #731 and add the behavior-changing project defaults
  • make prime lab setup create, select, or bind an active Lab project unless --no-project is passed
  • have train/eval creation paths use the active project by default, while prime eval push --eval-id avoids implicit reassignment
  • update README guidance for the default-project workflow

Review notes

This PR intentionally contains only the default UX layer on top of #731. The explicit projects CLI, API clients, assignment commands, and explicit --project plumbing live in #731.

Validation

  • uv run pytest packages/prime/tests/test_rl_config.py packages/prime/tests/test_lab_setup.py packages/prime/tests/test_eval_push.py packages/prime/tests/test_hosted_eval.py packages/prime/tests/test_projects_cli.py packages/prime/tests/test_rl_api.py packages/prime/tests/test_deployments.py packages/prime-evals/tests/test_evals.py -q
  • uv run ruff check packages/prime/src/prime_cli/commands/rl.py packages/prime/src/prime_cli/lab_setup.py packages/prime/src/prime_cli/commands/evals.py packages/prime/src/prime_cli/utils/eval_push.py packages/prime/src/prime_cli/verifiers_bridge.py packages/prime/tests/test_lab_setup.py packages/prime/tests/test_eval_push.py packages/prime/tests/test_hosted_eval.py

Note

Medium Risk
Behavior change: new runs/evals may attach to a workspace project without explicit --project; eval push with --eval-id is guarded, but mis-scoped active projects could group artifacts unexpectedly.

Overview
Lab workspaces now default to an active project when you run prime lab setup (if logged in): it creates or reuses a project from the folder name, or you can bind with --project, name with --project-name, or skip with --no-project. prime project clear records a cleared state in workspace context instead of deleting the file, so setup won’t silently re-attach a project until you opt back in.

Train, eval run, and eval push resolve --project / --no-project against the active workspace project by default (resolve_project_id with use_active_project). Hosted training always uses the active project; local eval run only when uploads aren’t skipped; eval push uses it for new pushes but not when --eval-id is set (avoids implicit reassignment on updates). Help text and READMEs document the new flow and --no-project on train/eval push.

Reviewed by Cursor Bugbot for commit 450f0ed. Bugbot is set up for automated code reviews on this repo. Configure here.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 4be637096c

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread packages/prime/src/prime_cli/commands/evals.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant