Skip to main content

Manage budgets

Use the Budgets screen to set organization defaults and limits for users and groups.

Budget enforcement denies model requests from callers without an applicable budget. Configure an organization default before you connect the gateway to the budgets service. See Budgets and pricing for the API and Budget enforcement for how the gateway enforces budgets.

Set the organization default​

On the Defaults tab, set the limit and period applied to users without an explicit budget.

Group budgets​

The Group Budgets tab lists each group's Period, Budget, Used, and Utilization. Select Create Group Budget, then choose a group, daily, monthly, or yearly period, and limit. Budget periods align with the calendar.

Use Priority, called precedence in the API, to order applicable group budgets. The gateway charges a user's explicit budget, or the organization default, first. It then charges the first group budget with remaining capacity, in ascending priority order.

User budgets​

The User Budgets tab lists each user's Budget source, Period, and Limit. Default identifies the organization default, and Custom identifies an explicit user budget. Select Edit Budgets to update multiple users.

Changes take effect on the next request and preserve current-period usage. Raise an exhausted user's limit to restore access before the period resets.

Next steps​