Universal Multi-Provider AI Gateway & AWS Bedrock SigV4 Bridge (BYOK) by Kiyas Labs Technologies
PromptRelay is engineered by Kiyas Labs Technologies (https://www.kiyaslabs.tech) as a Universal Multi-Provider AI Gateway & AWS Bedrock SigV4 Bridge (BYOK) to eliminate latency, slash cloud AI expenses, and guarantee zero prompt retention across Amazon Bedrock, Google Gemini, Anthropic Claude, and OpenAI workloads.
Zero-Knowledge Data Isolation
Raw prompts and completions never touch persistent disk. Streaming tokens are buffered in volatile RAM and immediately zeroized upon stream termination.
Deterministic Sub-20ms Latency
Our asynchronous stream-teeing engine delivers the first token to the client with sub-millisecond overhead while concurrently assembling and indexing vectors in background workers.
Universal Multi-Provider BYOK (Zero Lock-In)
No proprietary SDK required. Keep your existing OpenAI, Anthropic, or LangChain SDK imports with Bring-Your-Own-Key routing across Amazon Bedrock, Google Gemini, Anthropic, and OpenAI.
Competitive Architectural Matrix
Comparing PromptRelay against generic proxies and cloud-locked API gateways.
| Capability / Standard | PromptRelay™ (KiyasLabs) | Generic Open-Source Proxies | Cloud-Locked API Gateways |
|---|---|---|---|
| AWS SigV4 Bedrock Translation | Native in volatile RAM (Zero code changes) | Manual proxy layer or custom Lambda | AWS IAM SDK lock-in (no OpenAI SDK) |
| SSE Streaming Latency Overhead | < 1ms (Stream-Teeing Engine) | 35ms - 90ms (Synchronous buffer) | 120ms+ (API Gateway buffer limit) |
| Vector Semantic Cache | Amazon Titan v2 + Aurora pgvector HNSW | Exact-match Redis string KV | None (Requires manual DynamoDB) |
| Zero-Prompt Persistence | Strict Volatile RAM only (0 disk writes) | Logs to local disk / SQLite / Redis | S3 / CloudWatch retention policies |
| Zero-Downtime Bedrock Failover | Sub-millisecond auto-rerouting on 429/503 | Client-facing 502 / manual retry | Manual multi-region DNS failover |
| Deployment Flexibility | Public Gateway or Customer AWS VPC | Self-managed container or SaaS | Strictly locked to single AWS account |
Developer infrastructure company headquartered in Tech District, specialized in high-performance universal AI gateway architecture.
Zero Persistence, Deterministic Latency, Open Standards
Vector Semantic Caching
Analyzes semantic intent rather than brittle exact-string hashing. Computes high-dimensional vector representations using Amazon Titan Embeddings v2 and queries Amazon Aurora Serverless with pgvector HNSW indexing in under 2ms.
- HNSW Cosine similarity index
- Sub-20ms P99 cache lookup
- Tenant-isolated vector partitions
- Automated TTL & eviction policies
AWS SigV4 Bedrock Bridge
Acts as an autonomous translation bridge between standard OpenAI/Anthropic SDK headers (Bearer sk-...) and Amazon Bedrock’s mandatory AWS Signature Version 4 protocol. Signs requests in volatile memory using HMAC-SHA256.
- Drop-in base_url replacement
- In-memory SigV4 signing (< 0.5ms overhead)
- Zero AWS SDK dependencies on client
- Automatic regional IAM role assumption
Real-Time Token FinOps
Enforces granular per-tenant token quotas, sliding-window rate limits, and circuit breakers against infinite loop prompts. Delivers sub-second telemetry aggregation and cost attribution across teams.
- Hard & soft token budget ceilings
- Automatic runaway prompt throttling
- Model fallover routing on 429/503
- Live cost attribution by team/project
PII Scrubbing & Zero-Retention
Zero-Prompt Persistence architecture: raw prompts and completions exist exclusively in volatile RAM buffers during active streaming and are cryptographically zeroized upon stream closure. Zero disk writes, zero model training.
- Regex & NER PII masking in-flight
- Zero prompt storage on persistent disk
- AWS KMS envelope key encryption
- Strict HIPAA BAA & SOC2 Type II alignment
Connect with the Founding Engineering Team
Direct Technical Lead Inquiry
Dedicated Routing Channels
Enterprise Sandbox
enterprise@kiyaslabs.techProvisioning for enterprise subscriptions, dedicated VPC relays, and HIPAA BAAs.
Developer Support
support@kiyaslabs.techInquiries regarding the AWS SigV4 translation bridge, OpenAI SDK drop-in, or stream-teeing.
Security Disclosures
security@kiyaslabs.techEncrypted PGP channel for vulnerability reporting, pen-test reports, and compliance reviews.
Operating Entity for PromptRelay™ • Response SLA: Within 1 Business Day