Setting Model Costs for Spend Tracking
Set a cost for each model so usage translates into spend tracking. The Models page lists the AI models available in your organization. Wallet budgets can cap spend or token count. Spend caps use the model costs that you set here.
Before You Begin
To set model costs, you need:
-
An Anypoint Platform account.
-
One of the API Manager permissions:
-
API Manager: API Creator
-
API Manager: View APIs Configuration
-
API Manager: Edit APIs Configuration
For more information, see Enhanced Experience Permissions.
-
View Models
The Models page lists available models, the proxies that use them, and any costs you have set.
-
From Portfolio > Model Proxies > Model Wallets, select Models.
-
Review the list of available models.
-
To see details for a model, select its name.
The model detail page shows the model proxies that use the model and the model’s configured costs.
Edit Model Costs
Model costs drive spend and budget calculations. Set a cost per token for each model that you use.
-
From Portfolio > Model Proxies > Model Wallets, select Models.
-
Select a model, for example,
Claude 3.5 Haiku. -
Select Edit model costs.
-
Enter the Cost per 1M input tokens, for example,
0.001. -
Enter the Cost per 1M output tokens, for example,
0.005. -
Select Save changes.
If a model has no configured cost, then spend tracking and spend-based wallet budgets treat that model’s usage as zero. Token-based wallet budgets still count tokens. See Capping Spend for Callers of Model Proxies.