Skip to main content

AI Tracking

What it is

Track AI usage and quotas

Who it's for

Workspace Owner

Access & Scope

PropertyValue
Moduleai-tracking
Personasworkspace-owner
ScopeWorkspace-level
UI LocationDashboard > Settings > AI Tracking

| Status | active |

UI Location

Dashboard > Settings > AI Tracking

How it works

The AI Tracking feature provides comprehensive monitoring and management of AI tool usage in your workspace. Here's how it works:

  1. AI Summary:

    • View current AI balance
    • See total AI tool usages
    • Track total cost
    • Monitor remaining balance
    • View minimum allowed balance threshold
  2. Balance Management:

    • Sufficient Balance: Green indicator - AI tools are enabled
    • Low Balance: Yellow warning - Balance is negative but above minimum threshold
    • Insufficient Balance: Red alert - Balance below minimum, AI tools are disabled
  3. Usage Tracking:

    • View all AI tool usages
    • See usage details: tool name, input, output, cost, timestamp
    • View usage results in detail
    • Paginate through usage history
  4. Payment Tracking:

    • View all AI payments/credits
    • See payment details: amount, date, transaction information
    • Track payment history
    • Monitor account top-ups
  5. Cost Calculation:

    • Each AI usage has an associated cost
    • Costs are calculated based on tool type and usage
    • Total cost is tracked per usage
    • Running balance is maintained
  6. Balance Warnings:

    • System warns when balance is low
    • AI tools are disabled when balance is insufficient
    • Minimum balance threshold prevents overuse

Settings

The AI Tracking feature includes the following configuration options:

  1. Display Settings:

    • Summary view with balance and statistics
    • Usages tab with pagination (20 per page)
    • Payments tab with pagination (20 per page)
  2. Balance Thresholds:

    • Minimum allowed balance (default: -$0.12)
    • Low balance warning threshold
    • Balance status indicators
  3. Usage Display:

    • Sort by date (newest/oldest)
    • View usage details
    • See input and output
    • View cost per usage
    • Open detailed usage results modal
  4. Payment Display:

    • Sort by date (newest/oldest)
    • View payment amounts
    • See transaction details
    • Track payment history

Permissions

Access to AI Tracking requires:

  • Workspace Owner: Has full access to view AI tracking, usages, and payments
  • Staff: Access may be restricted. Typically, only workspace owners can view AI tracking.

Note: AI tracking contains sensitive information about AI tool usage and costs. Access is typically restricted to workspace owners.

Use Cases

  1. Usage Monitoring:

    • Track AI tool usage over time
    • Monitor costs and spending
    • Identify usage patterns
  2. Budget Management:

    • Monitor AI balance
    • Plan for top-ups
    • Control spending
  3. Usage Audit:

    • Review AI tool usages
    • Verify tool outputs
    • Track usage history
  4. Cost Analysis:

    • Analyze AI costs
    • Identify high-cost periods
    • Optimize AI tool usage
  5. Balance Management:

    • Monitor balance levels
    • Add credits when needed
    • Prevent service interruption
  6. Result Review:

    • View detailed usage results
    • Review AI tool outputs
    • Verify tool performance

Notes / Limits

  1. Balance Management:

    • Balance can go negative up to minimum threshold
    • AI tools are disabled when balance is insufficient
    • Minimum allowed balance: -$0.12 (default, may vary)
  2. Usage Costs:

    • Costs vary by tool type and usage complexity
    • Each usage has an associated cost
    • Costs are deducted from balance immediately
  3. Balance Warnings:

    • Insufficient: Balance < minimum threshold, AI tools disabled
    • Low: Balance < 0 but >= minimum threshold, AI tools enabled with warning
    • Sufficient: Balance >= 0, AI tools enabled
  4. Usage Tracking:

    • All AI tool usages are logged
    • Input and output are stored
    • Usage results can be viewed in detail
    • Usages cannot be deleted from logs
  5. Payment Tracking:

    • All payments/credits are logged
    • Payment history is maintained
    • Payments cannot be deleted
  6. Pagination:

    • Usages: 20 per page
    • Payments: 20 per page
    • Navigate through pages to view history
  7. Usage Results:

    • Detailed results can be viewed in modal
    • Results show input, output, and metadata
    • Results are preserved for review
  8. Data Retention: Usage and payment logs are retained indefinitely (check current policy).

  9. Cost Calculation: AI costs are calculated based on tool type and usage characteristics. Exact pricing may vary.

Changelog

Mon Jan 15 2024 02:00:00 GMT+0200 (Eastern European Standard Time)

  • Initial documentation