From d0dceffaf4fc2150a19178a0b04775654214f57b Mon Sep 17 00:00:00 2001 From: Steven Enamakel Date: Wed, 11 Nov 2026 22:32:41 +0000 Subject: [PATCH 1/4] chore(vendor): bump tinyinference submodule Update the vendored tinyinference submodule to the latest upstream commit. Auto-committed-on: cuttlefish Co-authored-by: Medulla --- vendor/tinyinference | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/vendor/tinyinference b/vendor/tinyinference index 3c4aa886c..1445cf625 160000 --- a/vendor/tinyinference +++ b/vendor/tinyinference @@ -1 +1 @@ -Subproject commit 3c4aa886c9348a71966ac1d6409ca6f17b04c29c +Subproject commit 1445cf625d58c65d59f24cef103e4a5a31aee267 From 705330c01d7c0b71fa2b0decfeed292b321681ff Mon Sep 17 00:00:00 2001 From: Steven Enamakel Date: Wed, 11 Nov 2026 22:42:25 +0000 Subject: [PATCH 2/4] chore(vendor): move tinyinference to 7c806a0 (response observer on streamed invoke) Picks up the review fix on tinyhumansai/tinyinference#151: a streamed invoke shows on_response a Chat Completions body assembled from the stream. Co-authored-by: Medulla --- vendor/tinyinference | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/vendor/tinyinference b/vendor/tinyinference index 1445cf625..7c806a06d 160000 --- a/vendor/tinyinference +++ b/vendor/tinyinference @@ -1 +1 @@ -Subproject commit 1445cf625d58c65d59f24cef103e4a5a31aee267 +Subproject commit 7c806a06d1ec7daf716ba583aaa1d0685636ffb7 From 0219eecb4ca5a986c250030b89dd71c40ef3c131 Mon Sep 17 00:00:00 2001 From: Steven Enamakel Date: Wed, 11 Nov 2026 22:49:19 +0000 Subject: [PATCH 3/4] docs(harness): on_response sees an assembled body for a streamed invoke; bump tinyinference to f5a375c vendor/tinyinference moves to f5a375c (tinyhumansai/tinyinference#151), whose on_response docs now describe the assembled Chat Completions body a streamed invoke passes. model-behaviour.md says the same. Review feedback on #610. Co-authored-by: Medulla --- docs/modules/harness/model-behaviour.md | 7 +++++-- vendor/tinyinference | 2 +- 2 files changed, 6 insertions(+), 3 deletions(-) diff --git a/docs/modules/harness/model-behaviour.md b/docs/modules/harness/model-behaviour.md index cedfb5387..343adedaa 100644 --- a/docs/modules/harness/model-behaviour.md +++ b/docs/modules/harness/model-behaviour.md @@ -59,8 +59,11 @@ http }` lets a host hook the OpenAI and Anthropic adapters' Chat Completions/Messages transport without the harness knowing about the hook: `on_payload: Option>` mutates the wire body immediately before it is sent, `on_response: Option>` observes the raw response JSON after a successful call, and -`http: Option` overrides the adapter's own client. Set it at +Send + Sync>>` observes the raw response JSON after a successful call (an +OpenAI `invoke` fulfilled by streaming, as `local-openai` models do, passes a +Chat Completions body assembled from the stream instead, which parses back to +the same answer), and `http: Option` overrides the adapter's +own client. Set it at construction with `AnthropicModel::with_request_options` / `OpenAiModel::with_request_options`. On the OpenAI adapter it currently covers the Chat Completions path only (not the Responses/Codex path). diff --git a/vendor/tinyinference b/vendor/tinyinference index 7c806a06d..f5a375c72 160000 --- a/vendor/tinyinference +++ b/vendor/tinyinference @@ -1 +1 @@ -Subproject commit 7c806a06d1ec7daf716ba583aaa1d0685636ffb7 +Subproject commit f5a375c72ce2d074e28f7e8a676b3143411d8be6 From b178a40c4d6d770a71de8e21a5786d5975c4c79a Mon Sep 17 00:00:00 2001 From: Steven Enamakel Date: Wed, 11 Nov 2026 22:58:02 +0000 Subject: [PATCH 4/4] chore(vendor): move tinyinference to e8156d1 (review round 3) tinyhumansai/tinyinference#151 round 3: a streamed invoke returns the assembled body on raw, keeps invalid tool arguments invalid, names the model, and bounds the non-streaming retry by the remaining budget. Co-authored-by: Medulla --- vendor/tinyinference | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/vendor/tinyinference b/vendor/tinyinference index f5a375c72..e8156d1d4 160000 --- a/vendor/tinyinference +++ b/vendor/tinyinference @@ -1 +1 @@ -Subproject commit f5a375c72ce2d074e28f7e8a676b3143411d8be6 +Subproject commit e8156d1d48a5fef0c787c6556adcdd8aff5ad266