Skip to main content
POST
Create policy
Create a routing policy in your organization. A policy is a named chain of models with one strategy: fallback tries models in order, load_balance splits traffic by weight, and latency picks the fastest model. Once created, use the policy name as the model in inference requests, for example policy/production-chat. Fallback policies → · Load balancing policies →

Authorizations

Authorization
string
header
required

API key for authentication

Body

application/json
name
string
required

Policy name. Use it as the model in inference requests, for example policy/production-chat.

Example:

"production-chat"

config
object
required

Policy strategy and model chain. Set exactly one of fallback, load_balance, or latency, with at least one model.

scope
enum<string>
required

Policy scope. The Management API only accepts POLICY_SCOPE_ORGANIZATION.

Available options:
POLICY_SCOPE_ORGANIZATION
Example:

"POLICY_SCOPE_ORGANIZATION"

Response

Policy created successfully

policy
object
Last modified on September 8, 2026