How does automatic provider failover work?
Opt-in cross-provider retry when the primary AI provider times out, rate-limits, or errors — one retry hop, never a surprise, never on by default.
When your primary AI provider times out, rate-limits you, or returns a 5xx, Cognocient AI can retry the same call once against a different provider you've already connected — instead of just failing.
Off by default — opt-in only
Some teams have data-residency or vendor constraints that make cross-provider failover unacceptable. This never turns on by itself: enable it explicitly per account, and it only ever activates if you have at least 2 providers connected.
What triggers it
| Condition | Fails over? |
|---|---|
| Timeout | Yes |
| HTTP 429 (rate limited) | Yes |
| 5xx from the provider | Yes |
| HTTP 401 (bad key) | No — this is a configuration problem, not an outage; failing over would hide the fix |
How it's different from Degrade mode
| Degrade mode | Provider Failover | |
|---|---|---|
| Trigger | Budget threshold crossed | Timeout / 429 / 5xx |
| Target | Cheaper model, same provider | Equivalent-tier model, different provider |
| Goal | Reduce cost | Maintain availability |
They can both be active on the same account without conflicting — a call can be cost-degraded on one request and availability-failed-over on another; they trigger on entirely different conditions.
Setup
- Connect at least 2 providers (Settings → AI Providers).
- Enable the toggle under Settings → Safety & Limits → Content Guardrails & Provider Failover — "Automatically retry on a different provider if one is down."
Response headers on a failed-over call
Your application can read these to know a call was served by a different provider than requested — useful if response quality/format nuances matter for your use case.
What happens if the fallback also fails
You get the original error back, exactly as if failover weren't enabled — never a cascading retry, never a second distinct error.
Frequently asked questions
Related articles
Budget Enforcement
Hard limits enforced at the proxy before charges reach your card.
Spend Groups
Named groups of people, managed in the app or pushed by your identity provider, that one budget caps together.
Alerts: Email & Slack
Budget-threshold and anomaly alerts by email (every plan) and Slack (Base+): defaults, recipients, quiet hours, hourly cap.