Skip to content

Add Docker integration example for Provably with Model Runner#18

Merged
SimoneBottoni merged 3 commits into
mainfrom
example/local-model
May 6, 2026
Merged

Add Docker integration example for Provably with Model Runner#18
SimoneBottoni merged 3 commits into
mainfrom
example/local-model

Conversation

@SimoneBottoni
Copy link
Copy Markdown
Contributor

This pull request adds a new example demonstrating how to integrate Provably with a locally running LLM via Docker Model Runner. The example includes documentation, environment variable configuration, and a runnable agent script that fetches weather data, runs a local LLM, and evaluates the result with Provably. The most important changes are grouped below:

New Local Model Example:

  • Added examples/local_model/README.md with step-by-step instructions for running a local LLM with Provably, including setup for Docker Model Runner, environment variables, and PostgreSQL requirements.
  • Added examples/local_model/.env.example providing sample environment variables for configuring Provably, Docker Model Runner, and PostgreSQL.
  • Added examples/local_model/agent_run.py, a runnable Python script that demonstrates fetching weather data, intercepting the response, running a local LLM, and evaluating the result with Provably, including an option to simulate a hallucinated response.

…del Runner

Co-authored-by: Copilot <copilot@github.com>
@SimoneBottoni SimoneBottoni merged commit 7919be0 into main May 6, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant