← All work
AI Infrastructure2026

UNIUN Inference Platform — AI Gateway

A Go-based LLM inference gateway routing OpenAI-compatible requests across Anthropic, OpenAI, and self-hosted models — with token-metered subscription and credit billing.

View live ↗
UNIUN Inference Platform — AI Gateway
Role
Backend & AI Engineer
Timeline
2026
Year
2026
Category
AI Infrastructure
3+
Model providers routed
1
key · every model

Overview

A production LLM inference gateway that routes OpenAI-compatible requests across Anthropic, OpenAI, and self-hosted models. It layers subscription and credit billing with precise token metering, Razorpay payments, and audited usage — including an upstream fix for streaming charges.

Highlights

  • ◆OpenAI-compatible gateway routing across multiple upstream providers and self-hosted models.
  • ◆Subscription and credit billing with token metering, Razorpay, and fully audited usage.
  • ◆Contributed an upstream streaming-charge correctness fix.
GoPostgreSQLRazorpayOpenAI API