Skip to content

Remove broken Gemini explicit caching - #17

Merged
iamwavecut merged 7 commits into
masterfrom
model-eval
Aug 14, 2026
Merged

Remove broken Gemini explicit caching#17
iamwavecut merged 7 commits into
masterfrom
model-eval

Conversation

@iamwavecut

Copy link
Copy Markdown
Owner

Summary

  • remove explicit Gemini cache creation/list/use paths
  • send one ordinary generateContent request and rely on automatic implicit caching
  • retain pinned model, safety settings, strict output handling, and usage metadata

Evidence

  • production: 33 explicit-cache preparation failures for 33 successful classifications in the sampled uptime window
  • RED: wire regression observed 2 requests instead of 1
  • GREEN: go test ./internal/adapters/llm/gemini ./internal/handlers/moderation ./internal/config -count=1
  • focused go vet passed

Full repository verification runs in CI to avoid the previously reported local CPU saturation.

@iamwavecut
iamwavecut merged commit 479fd52 into master Aug 14, 2026
0 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant