Skip to content

Cancel the generation when a response stream's consumer stops early - #202

Merged
mattt merged 1 commit into
huggingface:mainfrom
james-333i:fix/stream-consumer-cancellation
Sep 2, 2026
Merged

Cancel the generation when a response stream's consumer stops early#202
mattt merged 1 commit into
huggingface:mainfrom
james-333i:fix/stream-consumer-cancellation

Commits

Commits on Aug 27, 2026