[PRE-ROUND] - Info #158
Description
Hello everyone!
So far this platform is still in a early exploratory phase where things can change fairly quick. Most framework implementations are far from optimized and the test suite isn't fully consolidated.
Until the first official round is released al the tests' duration is set to 5 seconds (except to the mixed test which is 15 seconds for better balancing). After the first round this duration will change to 15 or 30 seconds, still being evaluated.
How rounds work and when are frameworks benchmarked
Unlike TechEmpower, we are not constantly benchmarking every framework, instead a benchmark can be triggered when a PR that modifies or adds a framework is created, this drastically reduces the wait time between opening a PR and seeing benchmark results. For official rounds a full run is executed - this should happen every 3 to 6 months.
To quickstart things a pre round will happen this weekend.