Native Go Routing Engine

Janus API Gateway

A native Go LLM router built to replace Python proxy stacks. One compiled binary, goroutine multiplexing, and no runtime dependencies to install or break.

Inspect Architecture ← Back to Hub
Concurrency

No Python GIL

Compiled Go goroutines bypass Python's Global Interpreter Lock (GIL), routing hundreds of concurrent prompts with wire-speed throughput.

Zero Bloat

Single Static Binary

No virtual environments, no pip conflicts, no CUDA version hell. Copy one file to the machine and run it.

Universal Endpoint

OpenAI Compatible

Drop-in replacement for standard /v1/chat/completions routes. Compatible with Ollama, Vulkan runners, OpenRouter, and Claude.

Hardware Acceleration

Vulkan, Any GPU

Hardware-agnostic Vulkan backend — runs models on AMD, Intel, or NVIDIA GPUs, or straight on CPU and system RAM.

Architecture Comparison

What you actually ship, and what you have to keep working.

janus — deployment shape
Ships as      one compiled binary — copy it to the box and run it
Installs       nothing — no venv, no pip tree, no CUDA toolkit to match
Speaks        /v1/chat/completions — anything OpenAI-compatible just points at it
Routes to      local Vulkan & Ollama runners, OpenRouter, Claude — same endpoint
Runs on       AMD / Intel / NVIDIA GPU, or CPU + system RAM — Vulkan, not vendor-locked