Contact Us 1-800-596-4880
  1. Homepage
  2. Enhanced MuleSoft Experience
  3. Creating and Managing Model Proxies

  4. Applying Model Proxy Policies

Applying Model Proxy Policies

Model Proxy enforces three policies by default to secure and route LLM traffic without additional configuration. Apply additional supported policies through API Manager to add content safety, PII detection, and token rate limiting controls. Outbound policies and the Rate Limiting SLA policy are not supported.

By default, Model Proxy applies these policies:

  • Client ID Enforcement

  • Model Proxy Core Policy

  • Model Based Routing Policy or Semantic Routing Policy (policy name dependent on embedded service provider)

You don’t need to modify these policies.

Model Proxy supports most included policies, but doesn’t support outbound policies.

Model Proxy doesn’t support Rate Limiting: SLA-Based Policy.

These policies are specific and useful for Model Proxies:

Apply Policies to Model Proxies

  1. From API Manager, click Model Proxies.

  2. Click the name of the Model Proxy you want to apply a policy to.

  3. Click AI Policies.

  4. Click Add inbound policy.

  5. Select the policy to apply.

  6. Configure the required parameters.

    For policy configuration parameters, see Inbound Policies Directory.

  7. If necessary, configure Advanced options.

  8. Click Apply.

Model Proxy Authentication Policy

By default, the Model Proxy has the Client ID Enforcement policy applied. This is required because the Client ID Enforcement populates the Authentication.clientName variable in the Authentication object that is used as a unique identifier for LLM Metrics.

To remove the Client ID Enforcement policy, ensure that you either:

See Also