From: Anderson A. Giacomolli <redacted>
Date: Mon, 9 Nov 2026 13:02:40 +0000 (-0300)
Subject: Send the compaction view in block messages
X-Git-Url: https://git.giacomolli.uk/onechat/commitdiff_plain/0a98ccb67c3df55c0fe6d76b45afcbaa58c2eda1?hp=0a98ccb67c3df55c0fe6d76b45afcbaa58c2eda1

Send the compaction view in block messages

A compaction sends each whole block of four view lines as its own user
message, the first one with the opening tag, and one last user message
with the rest of the lines, the closing tag, and the task. The note of a
retry is one more user message after them. The blocks count from the
first line of the view, so two compactions whose views begin with the
same lines send the same block messages. Joined, the messages are the
same bytes as the one message before.

The backend reads a cache entry only at a message end of a request. With
the view in one message, a compaction read only the shared prompt and
tools, about 1,920 of 10,000 tokens. The first request of a turn sends
its view as messages that only grow and reads 74% to 85% from the cache,
so the compactions get the same kind of split.

Issue: 72c95ad
---