Contact Us 1-800-596-4880
  1. Homepage
  2. Flex Gateway (1.12)
  3. LLM Proxy Overview

  4. Trying Out Your LLM Proxy

Trying Out Your LLM Proxy

LLM Proxy provides the try out functionality to test mock LLM prompts without creating API requests. Use the try out feature to test:

  • What response message your LLM Proxy returns.

  • What response headers are returned.

  • What model services the response.

  • Why a request is sent to a specific route.

Try Out Your LLM Proxy

  1. From API Manager, click LLM Proxies.

  2. Click the name of the LLM Proxy you want to try out.

  3. Click Try out.

  4. Configure any authentication or other headers your request requires.

  5. Enter your test prompt.

  6. Click Run test.

  7. View the LLM response, Response headers, and Test result for details about your test request.