Expand description
Stream Health Monitoring
Provides health monitoring, heartbeat detection, and timeout handling for streaming LLM responses.
Structs§
- Stream
Health Config - Configuration for stream health monitoring
- Stream
Health Handle - Lightweight handle for stream health monitoring
- Stream
Health Monitor - Stream health monitor
Enums§
- Stream
Health Event - Stream health event for frontend notification
- Stream
Health Status - Stream health status
Constants§
- DEFAULT_
HEARTBEAT_ INTERVAL_ SECS - Default heartbeat interval in seconds
- DEFAULT_
STREAM_ TIMEOUT_ SECS - Default stream timeout in seconds (no activity)