Skip to content

feat: context compaction strategies for the react loop #996

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
yelkurdi wants to merge 5 commits into
base: main
Choose a base branch
from
+804 −0
Open

feat: context compaction strategies for the react loop #996

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
74a4760
feat: add context compaction strategies for react framework
yelkurdi Apr 27, 2026
455c93d
refactor: express compaction threshold as token count
yelkurdi Apr 28, 2026
ca7bea1
Fix mot.generation.usage
ramon-astudillo Apr 30, 2026
643f5a5
refactor: relocate compaction module into frameworks package
yelkurdi Apr 30, 2026
16e7571
docs: add Args/Returns sections to react_compaction compact overrides
yelkurdi May 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 12 additions & 0 deletions mellea/stdlib/frameworks/react.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@
from mellea.stdlib import functional as mfuncs

# from mellea.stdlib.components.docs.document import Document
from mellea.stdlib.frameworks.react_compaction import CompactionStrategy
from mellea.stdlib.components.chat import ToolMessage
from mellea.stdlib.components.react import (
MELLEA_FINALIZER_TOOL,
Expand All @@ -36,6 +37,7 @@ async def react(
model_options: dict | None = None,
tools: list[AbstractMelleaTool] | None,
loop_budget: int = 10,
compaction: CompactionStrategy | None = None,
) -> tuple[ComputedModelOutputThunk[str], ChatContext]:
"""Asynchronous ReACT pattern (Think -> Act -> Observe -> Repeat Until Done); attempts to accomplish the provided goal given the provided tools.

Expand All @@ -47,6 +49,9 @@ async def react(
model_options: additional model options, which will upsert into the model/backend's defaults.
tools: the list of tools to use
loop_budget: the number of steps allowed; use -1 for unlimited
compaction: an optional ``CompactionStrategy`` to apply when the context
exceeds the strategy's configured threshold
(e.g. ``KeepLastN(keep_n=5, threshold=20)``).

Returns:
A (ModelOutputThunk, Context) if `return_sampling_results` is `False`, else returns a `SamplingResult`.
Expand Down Expand Up @@ -79,6 +84,7 @@ async def react(
turn_num = 0
while (turn_num < loop_budget) or (loop_budget == -1):
turn_num += 1

MelleaLogger.get_logger().info(f"## ReACT TURN NUMBER {turn_num}")

step, next_context = await mfuncs.aact(
Expand Down Expand Up @@ -127,4 +133,10 @@ async def react(
step._underlying_value = str(tool_responses[0].content)
return step, context

# Compact after the final-answer check so terminal turns skip it.
if compaction is not None:
context = await compaction.maybe_compact(
context, backend=backend, goal=goal
)

raise RuntimeError(f"could not complete react loop in {loop_budget} iterations")
Loading
Loading