LLM Token Based Rate Limit
The LLM Token Based Rate Limit policy rate limits LLM Proxy usage based on token consumption.
For configuration details, see LLM Token Based Rate Limit Policy.
The LLM Token Based Rate Limit policy rate limits LLM Proxy usage based on token consumption.
For configuration details, see LLM Token Based Rate Limit Policy.