Module token_tracking

Token tracking middleware for monitoring LLM usage and costs

This middleware intercepts LLM requests and responses to track token usage, costs, and other usage metrics across different providers.

Structs

TokenCosts

Token cost configuration for different providers

TokenTrackingConfig

Configuration for token tracking middleware

TokenTrackingMiddleware

Token tracking middleware that wraps an LLM to monitor usage

TokenUsageSummary

Summary of token usage across all requests