Send a prompt - 🚄 LiteLLM Agent Platform

POST

session

{session_id}

prompt_async

Queue a prompt for a session

curl --request POST \
  --url https://litellm-rust.onrender.com/session/{session_id}/prompt_async \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "model": {
    "modelID": "claude-opus-4-5"
  },
  "parts": [
    {
      "type": "text",
      "text": "Summarize the repo README."
    }
  ]
}
'

Authorizations

Authorization

string

header

required

Your LITELLM_MASTER_KEY. Default for local Docker Compose: sk-local

Path Parameters

session_id

string

required

Body

application/json

model

object

required

Show child attributes

parts

object[]

required

Show child attributes

Response

Prompt queued

Create a session

Stream events (SSE)

Queue a prompt for a session

curl --request POST \
  --url https://litellm-rust.onrender.com/session/{session_id}/prompt_async \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "model": {
    "modelID": "claude-opus-4-5"
  },
  "parts": [
    {
      "type": "text",
      "text": "Summarize the repo README."
    }
  ]
}
'