​
What are Compute Points?

Compute Points (CPs) are a metric used to quantify the consumption of computing resources when tasks are performed by our AI agents. Each agent request executed, including sending chat messages, triggering agents, or interacting with agents via widgets, consumes Compute Points.

Compute Points provide a standardized way to measure resource usage across different AI models and tools, allowing for fair and transparent billing.

​
How Compute Points are Calculated

The calculation of Compute Points is based on several factors:

  1. Token Processing: The number of tokens (input + output + reasoning) processed by a specific Language Model (LLM) per request.

    • Larger models like GPT-4o and Claude-3.5 use more CPs than simpler models like Llama 3 or Mistral Large.
    • This includes your request, the agent’s output, and any tokens processed by AI teammates invoked.

  2. Agent Complexity: The size of the system message and other complexity factors of the agent.

  3. Tool Usage: Some specific tools consume a fixed number of Compute Points per request.

    • For example, DALL-E 3 consumes 13 CP per request.

You can view the CP consumption per 1K tokens for each LLM in the LLM selector in the ChatUI or on our Available LLMs page.

You can view the amount of compute points consumed by tools by hovering over the enabled tool in the ChatUI; it will appear in the popover card. (Coming soon: Tools that consume CP will have a ’?’ icon to view the tooltip showing the CP cost associated with it.)

​
Monitoring Your Compute Point Usage

Users can keep track of their consumption in two ways:

  1. Progress Slider:

    • On desktop: Hover over the progress slider in the bottom left corner, just below your profile button.
    • On mobile: Open the sidebar to view your CP usage.

    This shows how many compute points you have left and when they will reset.

  2. Analytics Dashboard:

1

Access User Profile

Click on your user profile in the bottom left corner.

2

Navigate

Click on the “Analytics Page”.
3

View Reports

Here, you’ll find detailed reports on your compute point consumption and other analytics.

​
Obtaining Compute Points

Compute Points can be obtained through:

  1. Monthly Allocation: Based on your subscription tier.
  2. Purchases: Available in bundles of 1000 CPs (these do not expire).
  3. Free Usage: Free users receive 25 CPs daily.

The more CPs you buy, the lower the per-point cost. Visit our pricing page to explore subscription tiers and bundles.

​
Rollover Policy

Purchased CPs (bundles of 1000) DO roll over and do not expire.
Monthly CPs and daily free CPs DO NOT roll over.

​
Business or Enterprise Compute Points

For Business or Enterprise customers, your company gets a pool of monthly compute points. All users added to the organisation will consume CPs from that pool. You can view them in the “Organisation” page.

If a user has both organisational and personal CP allocations, organisational CPs will be consumed first. Personal CPs will be used only if organisational CPs run out.

​
Optimizing CP Usage

To conserve CPs, create new conversation threads frequently instead of maintaining one long thread. Long conversations can disproportionately consume CPs due to the large input token window required for each subsequent request.

​
Conclusion

Understanding and managing your Compute Point usage is crucial for optimizing your interaction with AI agents. By monitoring your consumption and being aware of how different tasks and models affect CP usage, you can make informed decisions about resource allocation and cost management.

IntroductionAvailable LLMs