Skip to main content
Sandbox Mode Active: Read-only guest session for reviewer evaluation. No signup required.
Live Developer Console & Telemetry Sandbox

Real-Time Telemetry Stream & API Key Management

Inspect live inference requests, cache hit ratios, token economy metrics, and ephemeral API credentials in PromptRelay: Universal Multi-Provider AI Gateway & AWS Bedrock SigV4 Bridge (BYOK) sandbox mode.

Requests Today
142,890
+18.4% vs 7-day average
Cache Hit Rate
58.4%
Aurora pgvector HNSW matches
Bedrock Failovers
3 Resolved
0ms client-side downtime
Net Savings Today
$1,842.60
Cumulative monthly: $48,290

Live Telemetry Stream

Simulated real-time inference telemetry intercepted across regional relays.

LIVE FEED
Request IDTimeModel TargetRouting StatusLatencyTokensCost Saved
req_89f1a214:28:19anthropic.claude-3-5-sonnetCACHE_HIT18ms840$0.038
req_89f1a114:28:12anthropic.claude-3-5-sonnetCACHE_HIT16ms1,240$0.046
req_89f1a014:27:58meta.llama3-70bFAILOVER_SUCCESS342ms512$0.000
req_89f19f14:27:44amazon.titan-embed-text-v2INFERENCE_MISS148ms256$0.000
req_89f19e14:27:29anthropic.claude-3-5-sonnetCACHE_HIT19ms980$0.041
req_89f19d14:27:10anthropic.claude-3-haikuCACHE_HIT15ms620$0.012

API Key Vault Preview

Keys are envelope-encrypted via AWS KMS Customer Master Keys (CMKs).

AWS KMS CMK: Active
Production Ingress Relay KeyActive
kl_live_bedrock_09a1f2bc88e...4f9b
Cap: 10M / 10M tokens
Staging & Evaluation KeySandbox
kl_beta_staging_77a9c1e402...9a12
Cap: 10M / 10M tokens