How does automatic provider failover work?
Opt-in cross-provider retry when the primary AI provider times out, rate-limits, or errors — one retry hop, never a surprise, never on by default.
When your primary AI provider times out, rate-limits you, or returns a 5xx, Cognocient can retry the same call once against a different provider you've already connected — instead of just failing.
Off by default — opt-in only
Some teams have data-residency or vendor constraints that make cross-provider failover unacceptable. This never turns on by itself: enable it explicitly per account, and it only ever activates if you have at least 2 providers connected.
What triggers it
| Condition | Fails over? |
|---|---|
| Timeout | Yes |
| HTTP 429 (rate limited) | Yes |
| 5xx from the provider | Yes |
| HTTP 401 (bad key) | No — this is a configuration problem, not an outage; failing over would hide the fix |
How it's different from Degrade mode
| Degrade mode | Provider Failover | |
|---|---|---|
| Trigger | Budget threshold crossed | Timeout / 429 / 5xx |
| Target | Cheaper model, same provider | Equivalent-tier model, different provider |
| Goal | Reduce cost | Maintain availability |
They can both be active on the same account without conflicting — a call can be cost-degraded on one request and availability-failed-over on another; they trigger on entirely different conditions.
Setup
- Connect at least 2 providers (Settings → AI Providers).
- Enable the toggle under Settings → AI Providers → Content Guardrails & Provider Failover — "Automatically retry on a different provider if one is down."
Response headers on a failed-over call
Your application can read these to know a call was served by a different provider than requested — useful if response quality/format nuances matter for your use case.
What happens if the fallback also fails
You get the original error back, exactly as if failover weren't enabled — never a cascading retry, never a second distinct error.
Frequently asked questions
Related articles