Viewing Token Usage and LLM Metrics
View Token Usage Reports
With Token Usage reports, you can view the amount of API tokens each LLM Proxy uses for individual models.
| To limit token usage, apply the LLM Token Based Rate Limit policy to your LLM Proxy. |
To view token usage reports:
-
Click you Anypoint Platform profile icon. This is icon of your initials.
-
Click Usage Reports.
-
Select LLM Proxy for Product.
-
Filter between Usage by Business Group and Usage by Application to see how tokens are being consumed.
To learn more about Usage Reports, see Usage Reports.
| Gemini models use thinking tokens. This number is included in Total tokens but isn’t individually listed. |
View API Manager Insights
The API Manager LLM Summary page provides these metrics for your LLM Proxy:
-
Total requests per hour
-
Total policy violations per hour
-
Total errors per hour
-
Average response time per hour
To view the LLM Summary page for an LLM Proxy:
-
From API Manager, click LLM Proxies.
-
Click the name of the LLM Proxy you want to view.
To view more detailed metrics and build custom dashboards, click View more metrics in Anypoint Monitoring dashboard.