Skip to content

Refactor benchmark-queries command and add new features#269

Merged
hannahbast merged 8 commits intoqlever-dev:mainfrom
tanmay-9:improve-benchmark-queries
Mar 19, 2026
Merged

Refactor benchmark-queries command and add new features#269
hannahbast merged 8 commits intoqlever-dev:mainfrom
tanmay-9:improve-benchmark-queries

Conversation

@tanmay-9
Copy link
Copy Markdown
Collaborator

@tanmay-9 tanmay-9 commented Feb 27, 2026

In particular:

  • When the queries are input via a .yml file, take the query names and descriptions from there
  • Add benchmark_name and benchmark_description to the result .yml file. These are taken from the input .yml file if it exists, and can be overridden by the command-line arguments --benchmark-name and --benchmark-description; the default is the value of NAME with first letter capitalized
  • Add option --restart-on-hang option to automatically restart the server when it does not respond within TIMEOUT plus 30s
  • So far, the pretty-printing of the queries always used docker, now uses what's in SYSTEM (defaults to docker if SYSTEM = native)

NOTE: This is not backwards-compatible with the previous format of the .yml result file

@hannahbast hannahbast changed the title Improve benchmark-queries command with new features and refactoring Refactor benchmark-queries command and add new features Mar 19, 2026
@hannahbast hannahbast merged commit ae8c4d9 into qlever-dev:main Mar 19, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants