Question: Injecting token usage while constructing the system prompt will invalidate the cache.

[see-more]

bub/src/bub/core/model_runner.py

Line 198 in 951da64

blocks.append(token_usage)

Provide the LLM with a tool similar to from litellm import token_counter to calculate tokens, and then remove token_usage from the system prompt