Skip to content

Schedule live telemetry quality checks#400

Merged
blove merged 1 commit into
mainfrom
codex/posthog-live-quality-ci
May 17, 2026
Merged

Schedule live telemetry quality checks#400
blove merged 1 commit into
mainfrom
codex/posthog-live-quality-ci

Conversation

@blove
Copy link
Copy Markdown
Contributor

@blove blove commented May 17, 2026

Summary

  • add a scheduled/manual PostHog telemetry quality workflow using the live contract checker
  • add critical-event coverage thresholds for install and runtime telemetry so zero recent samples become blocking findings
  • ignore known PostHog attribution metadata in live payload warnings and document the thresholded check

Verification

  • PATH=/tmp/codex-node-v24/bin:$PATH npx tsx --test tools/posthog/live-quality.spec.ts (red first for new coverage/metadata tests, then green)
  • PATH=/tmp/codex-node-v24/bin:$PATH npx nx test posthog-tools --runInBand
  • PATH=/tmp/codex-node-v24/bin:$PATH npx tsc -p tools/posthog/tsconfig.json --noEmit
  • PATH=/tmp/codex-node-v24/bin:$PATH npx nx lint posthog-tools (passes with existing warnings in report/sync/generated types)
  • PATH=/tmp/codex-node-v24/bin:$PATH npx prettier --check .github/workflows/posthog-quality.yml tools/posthog/README.md tools/posthog/live-quality.ts tools/posthog/live-quality.spec.ts && git diff --check
  • set -a; source /Users/blove/repos/angular-agent-framework/.env; set +a; PATH=/tmp/codex-node-v24/bin:$PATH npx nx run posthog-tools:quality:live -- --days 7 --limit-per-event 25 (0 errors, 0 warnings)
  • set -a; source /Users/blove/repos/angular-agent-framework/.env; set +a; PATH=/tmp/codex-node-v24/bin:$PATH npx nx run posthog-tools:quality:live -- --days 7 --limit-per-event 25 --require-critical-coverage (expected failure: zero recent samples for ngaf:runtime_request_created, ngaf:stream_started, ngaf:stream_ended)

Notes

  • Set repository Actions secrets with gh secret set: POSTHOG_PERSONAL_API_KEY and POSTHOG_PROJECT_ID.
  • npx actionlint .github/workflows/posthog-quality.yml could not run locally because npm could not determine an executable for that package in this environment.

@vercel
Copy link
Copy Markdown

vercel Bot commented May 17, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
cacheplane Ready Ready Preview, Comment May 17, 2026 3:00pm

Request Review

@blove blove enabled auto-merge (squash) May 17, 2026 14:58
@blove blove merged commit b0f9f46 into main May 17, 2026
18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant