Contact Us 1-800-596-4880

Test a Model Proxy

The try out feature lets you validate your model proxy configuration by testing mock LLM prompts without making external API requests. You can verify response messages, response headers, the routing path, and which model services each request. The feature is available only for model proxies configured with OpenAI input format.

With this feature, you can verify:

  • What response message your model proxy returns.

  • What response headers are returned.

  • What model services the response is routed to.

  • Why a request is sent to a specific route.

The Try Out feature only supports Model Proxies configured with OpenAI input format. For Model Proxies configured with Gemini or Anthropic native formats, use the request examples in Sending Requests to Model Proxies to test your proxy.

To test your model proxy:

  1. From API Manager in Anypoint Platform, click Model Proxies.

  2. Click the name of the model proxy you want to test.

  3. Click Try out.

  4. Configure any authentication or other headers your request requires.

  5. Enter your test prompt.

  6. Click Run test.

  7. View the LLM response, Response headers, and Test result for details about your test request.