-
Notifications
You must be signed in to change notification settings - Fork 104
docs: Expand LiteLLM backend documentation #642
Copy link
Copy link
Open
Labels
documentationImprovements or additions to documentationImprovements or additions to documentation
Description
Context
The LiteLLM section in backends-and-configuration.md is minimal. With the WatsonX backend now deprecated (v0.4), LiteLLM is the primary multi-provider path and deserves fuller documentation.
Raised in PR #601 review:
- C10 — comment: Expand section with self-hosted LiteLLM guidance, proxy vs direct usage, configuration examples
Suggested content
- When to use LiteLLM (multi-provider access, WatsonX migration path)
- Direct mode vs LiteLLM Proxy — tradeoffs and configuration
- Self-hosted LiteLLM proxy setup guidance
- Provider-specific configuration examples (Anthropic, Bedrock, Azure, WatsonX via LiteLLM)
- Environment variable reference
Files
docs/docs/guide/backends-and-configuration.md(LiteLLM section)- Possibly a new
docs/docs/integrations/litellm.mdif the content is substantial enough
Acceptance criteria
- LiteLLM section covers proxy and direct usage
- At least 2 provider configuration examples
- Migration note for WatsonX users
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
documentationImprovements or additions to documentationImprovements or additions to documentation