From: Anderson A. Giacomolli <redacted>
Date: Fri, 6 Nov 2026 19:55:18 +0000 (-0300)
Subject: Send the compaction view in blocks of four lines
X-Git-Url: https://git.giacomolli.uk/onechat/commitdiff_plain/56129a5fcbcbe51a7ac7d6b009d4551ed9f71109?ds=sidebyside;hp=56129a5fcbcbe51a7ac7d6b009d4551ed9f71109

Send the compaction view in blocks of four lines

A compaction sends its view as separate input parts of the user
message: the opening tag, one part for each whole block of four lines,
and the rest of the lines with the closing tag. The task and the note
of a retry follow as parts of their own. Joined, the parts are the same
bytes as the single view part before, so the model reads the same text.

The views of two compactions end at different lines when builds run at
once, so before this change no two first tries sent the same view part.
With blocks, they send the same parts up to the last whole block that
both views have. This tests the hypothesis that the ChatGPT backend
reuses a cache entry only up to the end of an input part that both
requests have. The explicit cache breakpoints of the reference
implementation are not used, because the ChatGPT endpoint rejects both
prompt_cache_breakpoint and prompt_cache_options with gpt-6.1-sol.

Issue: 8c5fd2a
---