Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.litellm-agent-platform.ai/llms.txt

Use this file to discover all available pages before exploring further.

Sandboxes run on Kubernetes via the agent-sandbox CRD. Local dev uses kind.

​
Prerequisites

  • Docker Desktop
  • kind, kubectl, helm
  • A LiteLLM gateway URL and API key

​
Local

git clone https://github.com/BerriAI/litellm-agent-platform.git
cd litellm-agent-platform
cp .env.example .env   # fill in DATABASE_URL, MASTER_KEY, LITELLM_API_BASE, LITELLM_API_KEY
bin/kind-up.sh
docker compose up
bin/kind-up.sh is idempotent — it provisions a kind cluster agent-sbx, installs the sandbox controller, and loads the harness image. docker compose up boots Postgres, runs the migration, and starts web (:3000) + worker. Open localhost:3000, sign in with MASTER_KEY, create an agent. Then jump to the Claude Code quickstart.
DATABASE_URL must be a direct (non-pooled) Postgres connection. Prisma migrations need advisory locks that pgbouncer blocks.

​
Tear down

kind delete cluster --name agent-sbx

​
Production

Recommended: AWS EKS for the sandbox cluster, Render for web + worker.
  • bin/eks-up.sh provisions the EKS cluster with the right node groups and the sandbox controller installed.
  • deploy/render/README.md includes a Render Blueprint — one click to deploy web + worker.

​
Required env vars

VariableDescription
DATABASE_URLDirect Postgres connection string.
MASTER_KEYAPI authentication secret.
LITELLM_API_BASELiteLLM gateway URL.
LITELLM_API_KEYLiteLLM gateway key.
BASE_URLPublic URL of the LAP deployment.
ENCRYPTION_KEYBase64-encoded 32-byte key. Generate: node -e "console.log(require('crypto').randomBytes(32).toString('base64'))"
Never set K8S_SKIP_TLS_VERIFY=true against a production cluster — it disables TLS verification entirely.