Nova

Gateway Health

Live

Routing reliability, provider performance, and spend across your AI gateway

Requests

515.6K

3.5%

Across all projects

Success rate

99.37%

0 pp

After gateway recovery

P95 TTFT

556ms

2.1%

Time to first token

P95 latency

1.65s

0.2%

End-to-end response

Fallback rate

2.29%

0.1 pp

2.9% retried upstream

Cache savings

$1,412

3.1%

34.2% cache hit rate

Traffic and routing outcomes
Daily request outcomes across primary routes, cache, fallbacks, and failures.
Explore requests
Primary route
Cache served
Provider fallback
Model fallback
Policy blocked
Failed
Routing outcomes
How the gateway completed each request.

Primary route

Served by the first selected provider

62.8%

324K

Cache served

Returned without an upstream request

34.2%

176.5K

Provider fallback

Same model, alternate provider

1.7%

8.9K

Model fallback

Backup model completed the request

0.6%

2.8K

Policy blocked

Stopped by gateway policy

0.2%

1.2K

Failed

No route completed successfully

0.4%

2.1K

Provider health
Observed reliability and streaming performance for active upstreams.
Updated just now
ProviderStatusRequestsRoute shareUptimeP95 TTFTThroughputErrors
OpenAIoperational179.4K34.8%99.99%412ms121 tok/s0.18%
Anthropicdegraded150.6K29.2%99.72%706ms88 tok/s1.3%
Google Vertexoperational110.3K21.4%99.98%338ms146 tok/s0.24%
AWS Bedrockoperational50.5K9.8%99.95%462ms108 tok/s0.31%
Mistraloperational24.7K4.8%99.96%521ms102 tok/s0.29%
Monthly budget
Gateway spend across every provider and project.

$3,651

of $7,500 budget

$4,272 projected
Production chat
$1,534
Support copilot
$986
Coding agents
$694
Other
$438
Incidents
Provider events affecting routing decisions.
1 active

Elevated rate limiting

Anthropic

18m ago

Fallback routing is absorbing impact; 96.8% of affected requests recovered.

TTFT returned to baseline

OpenAI

1h ago

Latency in us-east has remained within SLO for the last 45 minutes.

Routing maintenance completed

Google Vertex

6h ago

Traffic has returned to the preferred regional endpoint.

99.94% gateway availability

Within the 99.9% monthly SLO

96.8% fallback recovery

Affected requests completed successfully

$3,651 routed spend

Before $1,412 cache savings