Skip to main content
PUT
update llm

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

id
string
required

The LLM ID

Body

application/json

Partial update of the LLM configuration. Only the fields you include are changed. Default LLMs (not owned by your organization) cannot be modified. Rotating secret replaces the stored credential.

displayName
string
description
string
url
string
llmFormat
enum<string>
Available options:
openai,
azure_openai,
groq_openai,
anthropic,
custom
modelName
string
secret
string
metadata
object
reasoningEffort
string | null

Reasoning effort for models that accept it. The value is forwarded verbatim to the provider/engine (e.g. default, none, minimal, low, medium, high, xhigh — supported values depend on the model). Set null to clear and use the model default.

Maximum string length: 50
Example:

"minimal"

reasoningFormat
enum<string> | null

Groq reasoning format hint. Set null to clear and use the model default.

Available options:
parsed,
hidden,
null

Response

Successfully updated LLM

An LLM configuration a persona can use. Secrets are never returned.

id
string<uuid>

Unique identifier for the LLM configuration.

displayName
string

Human-readable name shown in the Lab.

description
string | null

Free-form description of the LLM configuration.

llmFormat
enum<string>

Wire format used to call the upstream LLM.

Available options:
openai,
azure_openai,
groq_openai,
gemini,
advanced_voice,
none
urls
object[]

Endpoints configured for this LLM.

modelName
string | null

Upstream model identifier (e.g. gpt-4o).

temperature
number | null

Sampling temperature applied when calling the LLM.

maxTokens
integer | null

Maximum tokens generated per response.

deploymentName
string | null

Azure OpenAI deployment name. Only used when llmFormat is azure_openai.

apiVersion
string | null

Azure OpenAI API version. Only used when llmFormat is azure_openai.

metadata
object

Free-form provider-specific metadata.

displayTags
string[]

Tags used to categorise the LLM in the Lab UI.

isDefault
boolean

Whether this LLM is a built-in default available to every organization.

isGlobal
boolean

Whether this LLM is visible to every organization.

isZdr
boolean

Whether this LLM meets the Zero Data Retention requirements.

reasoningEffort
string | null

Reasoning effort hint for models that accept it. Forwarded verbatim to the provider/engine; supported values depend on the model. Null means the model default is used.

reasoningFormat
enum<string> | null

Reasoning format hint for models that accept it. Null means the model default is used.

Available options:
parsed,
hidden,
null
createdByOrganizationId
string | null

ID of the organization that created the LLM, or null for global defaults. IDs may be either UUIDs or nanoid-style strings depending on when the organization was created.

createdAt
string<date-time>

Timestamp when the LLM was created.

updatedAt
string<date-time> | null

Timestamp when the LLM was last updated.

Last modified on July 24, 2026