Struct AnthropicPromptCachingMiddleware

pub struct AnthropicPromptCachingMiddleware {
    pub ttl: String,
    pub unsupported_model_behavior: String,
}

Anthropic-specific prompt caching middleware. Marks system prompts for caching to reduce latency on subsequent requests with the same base prompt.

Fields

ttl: String

unsupported_model_behavior: String

Implementations

impl AnthropicPromptCachingMiddleware

pub fn new( ttl: impl Into<String>, unsupported_model_behavior: impl Into<String>, ) -> Self

pub fn with_defaults() -> Self

Trait Implementations

impl AgentMiddleware for AnthropicPromptCachingMiddleware

fn id(&self) -> &'static str

Unique identifier for logging and diagnostics.

fn modify_model_request<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, ctx: &'life1 mut MiddlewareContext<'life2>, ) -> Pin<Box<dyn Future<Output = Result<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Apply middleware-specific mutations to the pending model request.

fn tools(&self) -> Vec<ToolBox>

Tools to expose when this middleware is active.

fn before_tool_execution<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, _tool_name: &'life1 str, _tool_args: &'life2 Value, _call_id: &'life3 str, ) -> Pin<Box<dyn Future<Output = Result<Option<AgentInterrupt>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

Hook called before tool execution - can return an interrupt to pause execution.