Repository navigation
Commit 659a23b
authored
docs(api): correct adaptive chat completion cache doc (keyed by endpoint+model) (#1492)
The doc called the compatibility cache "model-independent", but cacheKey is
`${normalizedEndpoint}\n${model.trim()}` — learned compatibility is keyed by
endpoint AND model, not shared across models. The tests confirm it ("isolates
learned compatibility by endpoint and model"; LRU evicts after N
endpoint-model keys). Describe the actual behavior.1 parent fffe5a2 commit 659a23b
1 file changed
Lines changed: 3 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
150 | 150 | | |
151 | 151 | | |
152 | 152 | | |
153 | | - | |
154 | | - | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
155 | 156 | | |
156 | 157 | | |
157 | 158 | | |
| |||
0 commit comments