Engineering organizations managing multiple LLM providers (OpenAI, Anthropic, Google Vertex AI, AWS Bedrock, Azure OpenAI, Groq) across dozens of internal teams frequently search to hire a freelance AI Gateway (LiteLLM, Portkey, Cloudflare AI Gateway) & multi-model routing programmer. I am Aldian Fazrihady, a Senior Freelance AI Application Engineer available via Upwork.
Core AI Gateway & Multi-Provider Resiliency Capabilities
- Zero-Downtime Provider Fallbacks & Load Balancing: Configuring LiteLLM Proxy / Portkey gateways that automatically fail over from Anthropic direct API to AWS Bedrock or Google Vertex AI within milliseconds during provider rate-limit spikes or outages.
- Redis Semantic Caching & Per-Team Budget Governance: Enforcing virtual API keys, per-department/per-tenant monthly USD spend caps, RPM/TPM rate limits, and Redis semantic response caching.
- Unified OpenAI-Compatible Schema: Allowing application developers to call 100+ models through a single standardized SDK interface.
Frequently Asked Questions
How do you prevent an OpenAI or Anthropic outage from taking down our AI product?
By routing requests through an intelligent AI Gateway with automated health checks, timeout retries, and cross-cloud fallback (e.g., OpenAI -> Azure OpenAI -> Claude on Bedrock -> Gemini on Vertex AI).
How can we hire you to architect our AI Gateway?
Contact me on Upwork or email mobile@aldianfazrihady.com.