Skip to content

solutions-engineering: compare fraud benchmark runner sizes#11

Closed
adityamaru wants to merge 1 commit into
mainfrom
se-migration-lab-fraud-sizing-matrix
Closed

solutions-engineering: compare fraud benchmark runner sizes#11
adityamaru wants to merge 1 commit into
mainfrom
se-migration-lab-fraud-sizing-matrix

Conversation

@adityamaru
Copy link
Copy Markdown
Contributor

@adityamaru adityamaru commented May 16, 2026

Summary

  • Run the fraud benchmark as a 4-vCPU and 16-vCPU matrix.
  • Use a fixed worker count so the larger runner shows CPU headroom instead of simply consuming all available CPU.
  • Preserve the same fixed workload so candidates can compare duration and CPU metrics side by side.

Test plan

  • Ran npm run lint in solutions-engineering/migration-lab/app.
  • Ran PROFILE_CPU_TASKS=4 PROFILE_CPU_ITERATIONS=500000 PROFILE_CPU_WORKERS=2 npm run profile:cpu.
  • Validated in the fork playground: 4-vCPU ran at CPU p95 100%, while 16-vCPU ran around CPU p95 41% with lower wall time.

Made with Cursor


View in Codesmith
Need help on this PR? Tag @codesmith with what you need.

  • Let Codesmith autofix CI failures and bot reviews (Staging)

Run the fraud benchmark as a 4-vCPU and 16-vCPU matrix with fixed worker count so CPU headroom is visible after migration.

Co-authored-by: Cursor <cursoragent@cursor.com>
@adityamaru
Copy link
Copy Markdown
Contributor Author

Closing this version because the 16-vCPU comparison reveals the intended fix in the candidate workflow. Replacing with a smaller cleanup that keeps the undersized fraud benchmark as the problem signal.

@adityamaru adityamaru closed this May 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant