Monthly requests are a key metric in elvex that measure the total activity generated by AI models within your account. This concept is crucial for understanding your usage and managing your account effectively.
Definition
In Elvex, a request is defined as an interaction with an AI model provider. The system counts requests based on the following exchanges:
When a user sends a message to the model (counts as 1 request)
When the system sends tool call results back to the model for further processing (counts as 1 request)
Monthly requests are a sum of all requests in a single month.
Key Points
Request Types: Requests are categorized by their origin:
UI: Requests from the web interface
API: Requests made programmatically via API
Slack: Requests originating from Slack integration
System: Internal system-generated requests
Tool Calls: These are instances where the AI model invokes a specific function or tool to perform an action or retrieve information
Example: If you send a message to OpenAI that results in 1 tool call, that would count as 2 requests:
You ask the model for something (request)
It makes a tool call (response)
We give the tool call result to the model (request)
The model gives us its reply (response)
Why It Matters
Understanding your monthly requests helps you:
Track your usage of elvex's AI capabilities
Manage your account resources effectively
Plan for scaling your AI operations