X-Git-Url: https://git.giacomolli.uk/onechat/blobdiff_plain/496569ab5b179932c60b2924bf4c61176c8be004..2a528fe2981639cf099c713a6be16b8ea0e2cc67:/view_layout.go?ds=sidebyside

diff --git a/view_layout.go b/view_layout.go
index 560abb2..a88c8fd 100644
--- a/view_layout.go
+++ b/view_layout.go
@@ -18,9 +18,9 @@ const viewLayoutFileName = "layout.json"
 // grow between batches. The view goes out as the same messages as in the
 // request before, while their lines give the same text, and the new lines
 // follow as one new message. So the end of the view of each earlier turn stays
-// a message end. On the ChatGPT backend, the first request of a turn with this
-// layout read the view of the turn before from the prompt cache in each of 10
-// turns, and with the view in one message it missed once in 5.
+// a message end. Stable message boundaries let the model reuse the unchanged
+// view prefix from its prompt cache instead of invalidating it when new lines
+// arrive.
 //
 // The first message starts with "<chat>\n". The closing tag goes into the state
 // message after the view, so that no view message changes when lines come. The