AI Tracking
What it is
Track AI usage and quotas
Who it's for
Workspace Owner
Access & Scope
| Property | Value |
|---|---|
| Module | ai-tracking |
| Personas | workspace-owner |
| Scope | Workspace-level |
| UI Location | Dashboard > Settings > AI Tracking |
| Status | active |
UI Location
Dashboard > Settings > AI Tracking
How it works
The AI Tracking feature provides comprehensive monitoring and management of AI tool usage in your workspace. Here's how it works:
-
AI Summary:
- View current AI balance
- See total AI tool usages
- Track total cost
- Monitor remaining balance
- View minimum allowed balance threshold
-
Balance Management:
- Sufficient Balance: Green indicator - AI tools are enabled
- Low Balance: Yellow warning - Balance is negative but above minimum threshold
- Insufficient Balance: Red alert - Balance below minimum, AI tools are disabled
-
Usage Tracking:
- View all AI tool usages
- See usage details: tool name, input, output, cost, timestamp
- View usage results in detail
- Paginate through usage history
-
Payment Tracking:
- View all AI payments/credits
- See payment details: amount, date, transaction information
- Track payment history
- Monitor account top-ups
-
Cost Calculation:
- Each AI usage has an associated cost
- Costs are calculated based on tool type and usage
- Total cost is tracked per usage
- Running balance is maintained
-
Balance Warnings:
- System warns when balance is low
- AI tools are disabled when balance is insufficient
- Minimum balance threshold prevents overuse
Settings
The AI Tracking feature includes the following configuration options:
-
Display Settings:
- Summary view with balance and statistics
- Usages tab with pagination (20 per page)
- Payments tab with pagination (20 per page)
-
Balance Thresholds:
- Minimum allowed balance (default: -$0.12)
- Low balance warning threshold
- Balance status indicators
-
Usage Display:
- Sort by date (newest/oldest)
- View usage details
- See input and output
- View cost per usage
- Open detailed usage results modal
-
Payment Display:
- Sort by date (newest/oldest)
- View payment amounts
- See transaction details
- Track payment history
Permissions
Access to AI Tracking requires:
- Workspace Owner: Has full access to view AI tracking, usages, and payments
- Staff: Access may be restricted. Typically, only workspace owners can view AI tracking.
Note: AI tracking contains sensitive information about AI tool usage and costs. Access is typically restricted to workspace owners.
Use Cases
-
Usage Monitoring:
- Track AI tool usage over time
- Monitor costs and spending
- Identify usage patterns
-
Budget Management:
- Monitor AI balance
- Plan for top-ups
- Control spending
-
Usage Audit:
- Review AI tool usages
- Verify tool outputs
- Track usage history
-
Cost Analysis:
- Analyze AI costs
- Identify high-cost periods
- Optimize AI tool usage
-
Balance Management:
- Monitor balance levels
- Add credits when needed
- Prevent service interruption
-
Result Review:
- View detailed usage results
- Review AI tool outputs
- Verify tool performance
Notes / Limits
-
Balance Management:
- Balance can go negative up to minimum threshold
- AI tools are disabled when balance is insufficient
- Minimum allowed balance: -$0.12 (default, may vary)
-
Usage Costs:
- Costs vary by tool type and usage complexity
- Each usage has an associated cost
- Costs are deducted from balance immediately
-
Balance Warnings:
- Insufficient: Balance < minimum threshold, AI tools disabled
- Low: Balance < 0 but >= minimum threshold, AI tools enabled with warning
- Sufficient: Balance >= 0, AI tools enabled
-
Usage Tracking:
- All AI tool usages are logged
- Input and output are stored
- Usage results can be viewed in detail
- Usages cannot be deleted from logs
-
Payment Tracking:
- All payments/credits are logged
- Payment history is maintained
- Payments cannot be deleted
-
Pagination:
- Usages: 20 per page
- Payments: 20 per page
- Navigate through pages to view history
-
Usage Results:
- Detailed results can be viewed in modal
- Results show input, output, and metadata
- Results are preserved for review
-
Data Retention: Usage and payment logs are retained indefinitely (check current policy).
-
Cost Calculation: AI costs are calculated based on tool type and usage characteristics. Exact pricing may vary.
Changelog
Mon Jan 15 2024 02:00:00 GMT+0200 (Eastern European Standard Time)
- Initial documentation