Skip to content

Simplify CLI around Pier jobs#26

Merged
dbroeglin merged 4 commits into
mainfrom
dbroeglin-simplify-job-structure
Jun 28, 2026
Merged

Simplify CLI around Pier jobs#26
dbroeglin merged 4 commits into
mainfrom
dbroeglin-simplify-job-structure

Conversation

@dbroeglin

@dbroeglin dbroeglin commented Jun 28, 2026

Copy link
Copy Markdown
Owner

Why

The harness exposed two overlapping models: the old native Python Experiment/Variant runner and the Pier job model. That made the CLI hard to explain: users configured Pier agents: but saw variant-oriented summaries, had to use raw --trial selectors to find an agent result, and got a misleading run --dry-run that only validated config loading in Pier mode.

What changed

  • Pier-only execution: removed the native runner, invoker/workspace abstractions, legacy results/ layout, SQLite index, reindex, and native-only tests.
  • Clear vocabulary: standardized CLI/results/docs around Pier job configs, jobs, runs, agents, tasks, and trials.
  • Explicit validation: replaced run --dry-run with copilot-experiments validate, which checks Pier configs, referenced paths, backend preflight, and auth without creating a run.
  • Agent-aware analysis: show, inspect, and analyze now use agent-shaped summaries and selectors like --agent, --task, and --trial.
  • Simpler storage: jobs/<job-name>/<run-id>/ is the only execution output layout and the filesystem source of truth.
  • Docs/templates/canvas: updated README, docs, scaffolded repo guidance, APM guidance, examples, ADRs, and the experiment repository structure canvas for the Pier-only model.

Validation

  • uv run ruff check --fix .
  • uv run ruff format .
  • uv run ruff check .
  • uv run pytest -q
  • uv run copilot-experiments --help
  • Reloaded and exercised the project canvas extension (summarize action)

Co-authored-by: Copilot 223556219+Copilot@users.noreply.github.com

dbroeglin and others added 3 commits June 28, 2026 02:43
Replace the awkward flat-then-suffixed Pier rerun scheme with a clean nested jobs/<job-name>/<run-id>/ layout that separates stable job identity from per-run timestamp ids. Expose copyable job-name/run-id selectors via list, and let show, inspect, and �nalyze resolve an exact run from a selector (legacy run id, Pier job, or job/run). Add actionable not-found hints pointing back at list.

Persist stable job identity in a per-run manifest, derive selectors for the index, and update docs, experiment-repo templates, and ADR-0019. Commit a didactic project-scoped canvas that visualizes the verified structure.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Remove the legacy native runner, dry-run command, SQLite index, and legacy result layout. Standardize storage, summaries, docs, templates, and the structure canvas around Pier jobs, agents, tasks, trials, and runs.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@dbroeglin dbroeglin changed the title Nest Pier runs and make run selectors discoverable Simplify CLI around Pier jobs Jun 28, 2026
Forward --name through the scaffold helper's project_name parameter and cover the CLI init path.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@dbroeglin dbroeglin merged commit cf8af63 into main Jun 28, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant