Skip to content

docs(readme): fix accuracy drift and add documentation index#707

Merged
jamesadevine merged 1 commit into
mainfrom
docs/readme-accuracy-audit
May 23, 2026
Merged

docs(readme): fix accuracy drift and add documentation index#707
jamesadevine merged 1 commit into
mainfrom
docs/readme-accuracy-audit

Conversation

@jamesadevine
Copy link
Copy Markdown
Collaborator

Summary

Audit-driven README updates aligning the top-level README.md with the current state of the codebase. No code changes — docs only.

Findings & fixes

I diffed every concrete claim in the README against the codebase. The README is broadly accurate, but I found six issues worth correcting:

# Issue Fix Source of truth
1 Quick Start example uses model: claude-sonnet-4.5 Change to claude-opus-4.7 to match actual default src/engine.rs::DEFAULT_COPILOT_MODEL
2 Quick Start example uses pool: AZS-1ES-L-MMS-ubuntu-22.04 (1ES pool) without target: 1es Switch to vmImage: ubuntu-22.04 to match the generic standalone default src/compile/common.rs::DEFAULT_VM_IMAGE_POOL
3 Built-in Tools section omits bash and edit (they are in the front-matter table but never exemplified) Add them to the configuration example src/compile/types.rs::ToolsConfig
4 network.blocked bullet only describes wildcard exact-match behaviour Rewrite to cover both ecosystem identifiers and raw domain strings; clarify the exact-string match applies specifically to raw domains src/compile/common.rs:2757-2770, docs/network.md:96
5 CLI Reference shows secrets as a single line; subcommands and project-scope flags are invisible Add a short subcommand list (set/list/delete) and mention --all-repos / --source src/main.rs::SecretsCmd
6 Comprehensive docs/ reference is hidden — README only links to one doc Add a Documentation index section that mirrors the per-concept layout in AGENTS.md docs/*.md (20 files)

What I did not change

A few things looked suspicious initially but turned out to be correct or intentionally out of scope:

  • create-issue is debug-only (gated by ado-aw-debug.create-issue) and intentionally absent from the public Safe Outputs table.
  • env: in the front-matter table is still labelled "reserved, not yet implemented" — verified by grep: the field is parsed into FrontMatter but never read anywhere in src/compile.
  • configure is intentionally hidden in CLI --help but still mentioned in the README as deprecated; left as-is.
  • The CLI table does not include export-gate-schema — that subcommand has #[command(hide = true)].

Verification

  • All cited file paths/line ranges checked in this repo on main (commit 2be2d2c8).
  • Documentation index entries verified: every docs/*.md linked in the new section exists.
  • No code or test changes; README-only patch.

Audit-driven README updates aligning the top-level README with the
current codebase:

- Quick Start agent example: align with the actual default Copilot model
  (claude-opus-4.7, see src/engine.rs::DEFAULT_COPILOT_MODEL) and the
  generic non-1ES default pool (�mImage: ubuntu-22.04, see
  src/compile/common.rs::DEFAULT_VM_IMAGE_POOL). The previous example
  showed a Microsoft-internal 1ES pool without `target: 1es`, which is
  confusing for a generic intro example.
- Built-in Tools section: add �ash and �dit to the configuration
  example. They are listed in the front-matter table but were not
  exemplified, even though they are core tools in ToolsConfig.
- Network Isolation: rewrite the `network.blocked` bullet to match
  actual behaviour from src/compile/common.rs (ecosystem identifiers
  *and* raw domain strings are both accepted; the exact-match note now
  applies specifically to raw domains).
- CLI Reference: enumerate the three `secrets` subcommands
  (`set` / `list` / `delete`) and the project-scope discovery
  flags, matching the SecretsCmd enum in src/main.rs.
- New `Documentation` section that indexes the per-concept reference
  pages under `docs/` (front-matter, engine, tools, runtimes,
  schedule-syntax, parameters, targets, safe-outputs, ado-aw-debug,
  cli, mcp, mcpg, network, template-markers, filter-ir, codemods,
  ado-script, extending, local-development). The previous README only
  linked to a single `docs/` page, making the rest of the
  documentation effectively invisible from the entry point.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@jamesadevine jamesadevine merged commit e20933a into main May 23, 2026
13 checks passed
@jamesadevine jamesadevine deleted the docs/readme-accuracy-audit branch May 23, 2026 03:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant