Skip to content
UMKIMDocs

fleet-llm

When fleet_llm_enabled: true, hub install can enable a LiteLLM proxy via fleet-llm.yml after fleet-site-controller.

Piece Role
FleetLLM CR Singleton hub enablement / backends
Console /llm/ Proxied through fleet-console-auth
FleetLLMApiKey Bearer keys for API access

Inference backends (GPU charts such as llama-cpp-helm / vllm-helm) are separate catalog apps. Prefer WireGuard-only access in lab; do not expose without auth.

Terminal window
ansible-playbook fleet-llm.yml -l hub --tags fleet_llm_hub