Skip to main content

Model Settings Reference

Fields available under Resources → Models. Labels are as they appear in the app. Several labels are the underlying API field names. Leave a field blank to use the provider's default. For concepts, see Models.

Identity​

FieldRequiredDescription
Model NameYesDisplay name, shown in the agent LLM Configuration picker.
DescriptionNoNotes for your team.
PathNoFolder in the Model Library. You can also drag the model onto a folder.
Tags (comma-separated)NoLabels.

Provider​

FieldRequiredDescription
PlatformNoStandard (OpenAI-compatible) (default), Azure (OpenAI / AI Services), Amazon Bedrock or Google Vertex AI.
API TypeYesStandard platform: OpenAI (Completions), OpenAI (Responses), GitHub Copilot, Google, DeepSeek, Ollama. Azure platform: Chat Completions, Responses API (stateful), DeepSeek (AI Foundry). Bedrock and Vertex AI are selected by Platform.
modelYes, on createThe provider's model ID. Labelled Deployment Name on Azure and Model / inference-profile id on Bedrock. On the Standard platform, IDs beginning claude- are sent to Anthropic's API.

Connection​

FieldApplies toDescription
base_urlStandardAPI root for an OpenAI-compatible endpoint, or your Ollama server. Leave blank for OpenAI. Surrounding spaces and a trailing /chat/completions or /responses are removed. Labelled Endpoint URL on Azure.
Endpoint URLAzureYour Azure resource endpoint.
organizationAll except BedrockOpenAI organisation ID.
api_versionAzureAzure API version.
Auth ModeAzureAPI Key or Client Secret (Entra ID). Defaults to API Key.
azure_ad_tokenAzureA static Azure AD token (masked after saving).
azure_ad_token_provider (JSON)AzureToken-provider settings as JSON.
AWS Region (e.g. us-east-1)BedrockRequired.
Auth ModeBedrockAPI Key (bearer token), IAM Access Keys or Assume Role (cross-account). Defaults to API Key.
GCP Project ID (e.g. fyai-prod-123456)Vertex AIRequired.
GCP Location (e.g. us-central1)Vertex AIRequired.
Google Search GroundingAPI Type Google, Vertex AIOff or On. Lets Gemini ground answers with Google Search.
Reasoning EffortAPI Type ResponsesDefault (unset), Low, Medium or High. Only sent on the Responses API.
timeoutAllRequest timeout in seconds.
max_retriesAllRetries on transient failures.
default_headers (JSON)AllExtra HTTP headers. Credential headers (Authorization, api-key, x-api-key) are rejected.
add_name_prefixesAlltrue or false: prefix messages with the speaking agent's name in multi-agent conversations.

API Key Integration​

ControlDescription
Link Integration / Change IntegrationOpens Link Integration to Model. The model's credentials are read from the chosen integration's secrets at runtime. The linked integration's name is shown as a chip; remove it with the chip's delete icon.

Expected secret names on the integration:

Platform / auth modeSecrets
Standard, Azure API Keyapi_key
Azure Client Secret (Entra ID)azure_tenant_id, azure_client_id, azure_client_secret
Bedrock API Key (bearer token)aws_bearer_token
Bedrock IAM Access Keysaws_access_key_id, aws_secret_access_key, optional aws_session_token
Bedrock Assume Role (cross-account)aws_role_arn, aws_external_id
Vertex AIgcp_service_account_json

base_url, organization, azure_endpoint, azure_deployment and api_version may also be stored as secrets.

Context and output​

FieldDescription
Context Length (total tokens)The model's total context window. Drives conversation-history trimming.
Max Output (completion tokens)Tokens reserved for the completion when trimming, and sent to the provider as the maximum completion length.
max_tokensMaximum tokens in the response (used when Max Output isn't set).

Generation​

FieldDescription
temperatureSampling randomness.
top_pNucleus sampling threshold.
frequency_penaltyPenalises frequently repeated tokens.
presence_penaltyEncourages new topics.
stop (string or JSON array)Sequence or sequences that end generation.
seedSeed for reproducible output, where supported.
nCompletions per request.
response_formatOutput format constraint, for example json_object.
logit_bias (JSON)Token ID to bias mapping.
userEnd-user identifier passed to the provider.

Not every provider supports every parameter.

Advanced​

FieldDescription
model_capabilities (JSON)Overrides for what the model supports.
model_info (JSON)Additional model metadata. Google Search Grounding writes its setting here.

Model group routing​

On a group's Members tab. See Model Groups and Routing.

FieldDefaultDescription
Group NameSet when creating the group (New model group).
Member Weight1Relative weight for the weighted strategy. Must be greater than 0.
Member Priority100Lower is preferred under the priority strategy.
Member EnabledOnDisabled members are skipped.
StrategyWeightedWeighted (random, by weight), Priority (lowest number first), Round-robin.
Max failover hops / turn31 to 20.
Default cooldown (s)600 to 3600.
Fail over onAll threeRate limit (429), Server error (5xx), Timeout.
Sticky (stay on last-good member)On
Honor Retry-AfterOn
Aggressive mid-stream failoverOff

Actions​

ActionDescription
+Create a model.
New model groupCreate a group.
Create / UpdateSave.
CancelDiscard edits.
DeleteDelete after confirmation.
Copy ModelCreate a copy with the same configuration under a New Model Name.
Run preflightOn the Definition tab: check the configuration loads, the credential resolves and your plan permits the model.
Publish TemplatePlatform administrators only.

Platform models are read-only, shown as Managed by platform — read only.

API-only fields and endpoints​

ItemDescription
api_key on create or updateAccepted by the API. The platform stores it in the secrets vault, links an integration named llm-<model name> and clears the key from the model record.
GET /llmconfigs/{id}/resolvedThe non-secret connection fields (model, base URL, API type, Azure endpoint, deployment and version) plus api_key_set, which says whether a credential is configured. Never returns the key.
GET /platform-modelsThe enabled platform model catalog with plan floors, capabilities and per-million-token prices. No secrets.

See Platform API.