Credits
What are Credits?
Credits are a metric used to quantify the consumption of computing resources when tasks are performed by our AI agents. Each agent request executed, including sending chat messages, triggering agents, or interacting with agents via widgets, consumes Credits.
Credits provide a standardized way to measure resource usage across different AI models and tools, allowing for fair and transparent billing.
How Credits are Calculated
The calculation of Credits is based on several factors:
-
Token Processing: The number of tokens (input + output + reasoning) processed by a specific Language Model (LLM) per request.
- Larger models like GPT-4o and Claude-3.5 use more credits than simpler models like Llama 3 or Mistral Large.
- This includes your request, the agent’s output, and any tokens processed by AI teammates invoked.
-
Agent Complexity: The size of the system message and other complexity factors of the agent.
-
Tool Usage: Some specific tools consume a fixed number of Credits per request.
- For example, DALL-E 3 consumes 13 credits per request.
You can view the credit consumption per 1K tokens for each LLM in the LLM selector in the ChatUI or on our Available LLMs page.
You can view the amount of credits consumed by tools by hovering over the enabled tool in the ChatUI; it will appear in the popover card. (Coming soon: Tools that consume credits will have a ’?’ icon to view the tooltip showing the credit cost associated with it.)
Monitoring Your Compute Point Usage
Users can keep track of their consumption in two ways:
-
Progress Slider:
-
On desktop: Hover over the progress slider in the bottom left corner, just below your profile button.
-
On mobile: Open the sidebar to view your credit usage.
This shows how many credits you have left and when they will reset.
-
-
Analytics Dashboard:
Access User Profile
Click on your user profile in the bottom left corner.
Navigate
View Reports
Here, you’ll find detailed reports on your compute point consumption and other analytics.
Obtaining Credits
Credits can be obtained through:
- Monthly Allocation: Based on your subscription tier.
- Purchases: Available in bundles of 1000 credits (these do not expire).
- Free Usage: Free users receive 25 credits daily.
Rollover Policy
Purchased credits (bundles of 1000) DO roll over and do not expire.
Business or Enterprise Credits
For Business or Enterprise customers, your company gets a pool of monthly credits. All users added to the organisation will consume credits from that pool. You can view them in the “Organisation” page.
If a user has both organisational and personal credit allocations, organisational credits will be consumed first. Personal credits will be used only if organisational credits run out.
Optimizing Credit Usage
To conserve credits, create new conversation threads frequently instead of maintaining one long thread. Long conversations can disproportionately consume credits due to the large input token window required for each subsequent request.
Conclusion
Understanding and managing your Compute Point usage is crucial for optimizing your interaction with AI agents. By monitoring your consumption and being aware of how different tasks and models affect credit usage, you can make informed decisions about resource allocation and cost management.