Skip to main content

Debugging

Enable debug logs

Set RUST_LOG before starting the proxy:
For trace-level output (very verbose):

Router resolution

Every request logs how the incoming model name was resolved to an upstream deployment. Exact match — model name matched a named route in model_list:
Wildcard match — no exact match; fell through to the /* wildcard route. Provider prefix stripped if present:
No route — no exact match and no wildcard configured:
Resolution is a single O(1) HashMap lookup — there is no retrying or brute-forcing.

Model cost map

On startup the proxy fetches the LiteLLM model pricing sheet. If the fetch fails it falls back to an embedded backup:
If both fail (parse error, network issue), the proxy continues with an empty cost map and logs:
Pricing data is used for cost tracking only — the proxy still routes requests normally with an empty map.

Config validation errors

Bad config exits immediately with a descriptive message: