Cloud proxy, managed
A managed gateway with admission control, automatic retries, and fallback routing across your providers.
Cloud & local proxy for your AI coding
LLM Worker is the control plane for your model gateway. Manage provider credentials, catalogs, budgets, and remote machines — then let a cloud or local proxy route every request from VS Code with retries and fallbacks.
Closed beta preview — GitHub authentication required.
Capabilities
A managed gateway with admission control, automatic retries, and fallback routing across your providers.
An embedded JavaScript runtime runs a local proxy inside VS Code — no native executables to trust.
Connect remote machines to the control plane and operate them from one workspace surface.
Provider credentials stay under your control — OpenAI-compatible providers plug in without vendor lock-in.
Usage, routing, and spend signals per provider, with budget guardrails on top.
Provider-agnostic routing. Prompt content never enters telemetry.
How it works
Drop the LLM Worker extension into VS Code — the local proxy runtime is embedded, nothing else to install.
Authenticate with GitHub to link your editor to your workspace. Your keys stay with you.
Start a conversation. Every request is routed through your cloud or local gateway with retries and fallbacks applied.
LLM Worker is in closed beta. Your workspace is isolated and provisioned on sign-in — expect breaking changes between builds while we iterate.
Join the beta