HTTP framework benchmark platform.
17 test profiles. 64-core dedicated hardware. Same conditions for every framework.
View Leaderboard | Documentation | Add a Framework
Tag @BennyFranciscus on your PR for help with implementation or benchmark questions.
| Command | Action |
|---|---|
/validate |
Run the 18-point validation suite |
/benchmark |
Run all benchmark profiles |
/benchmark baseline |
Run a specific profile |
| Category | Profiles | Description |
|---|---|---|
| Connection | Baseline (512-16K), Pipelined, Limited | Performance scaling with connection count |
| Workload | JSON, Compression, Upload, Database, Async DB | Serialization, gzip, streaming I/O, SQLite queries, async Postgres |
| Resilience | Noisy, Mixed | Malformed requests, concurrent endpoints |
| Protocol | HTTP/2, HTTP/3, gRPC, WebSocket | Multi-protocol support |
git clone https://github.com/MDA2AV/HttpArena.git
cd HttpArena
./scripts/validate.sh <framework> # correctness check
./scripts/benchmark.sh <framework> # all profiles
./scripts/benchmark.sh <framework> baseline # specific profile
./scripts/benchmark.sh <framework> --save # save resultsHttpArena uses autonomous AI agents to help with PR reviews, community engagement, and benchmark auditing.
The primary maintainer agent. Benny runs three cron jobs:
- PR Review — Monitors open PRs and issues on MDA2AV/HttpArena. Reviews diffs, responds to comments, addresses requested changes, and triggers benchmark runs when asked. Tracks commitments in a memory file to ensure follow-through.
- Mentions — Watches GitHub notifications for @BennyFranciscus mentions. Replies with technical context and actual benchmark data. Can trigger benchmark workflows directly from PR comments.
The benchmark auditor. Cotton is an io_uring specialist who keeps HttpArena fair. Three active cron jobs:
- Cheater Audit — Audits framework implementations for cheating or non-compliance with test profile specs. Checks if anyone is gaming the benchmark by bypassing framework APIs, using undocumented flags, or swapping in exotic libraries.
- PR Review — Reviews open PRs that add or modify frameworks. Checks diffs for rule violations and implementation issues.
- Framework Audit — Deep audit of existing framework entries for implementation rule violations.
- Add a new framework
- Improve an existing implementation — open a PR modifying files under
frameworks/<name>/ - Open an issue
- Comment on any open issue or PR