Expand description
OpenAI(-compatible) API compatibility helpers (e.g., parameter support quirks). OpenAI API compatibility helpers.
Some OpenAI(-compatible) models reject non-default parameters. We defensively detect those errors and allow higher layers to retry with a reduced request body.
Functionsยง
- should_
retry_ without_ temperature - Returns true if an OpenAI(-compatible) error response indicates the
temperatureparameter is unsupported and callers should retry without it.