1. Overview & Architecture
Autonomous AI agents follow a continuous execution loop: Perceive → Decide → Execute → Synthesize. In traditional setups, every micro-decision (selecting a tool, scoring severity, running a guardrail check) is sent to heavy autoregressive models like GPT-4o or Claude 3.5 Sonnet. This burns 1,400ms and $0.02 on turns that only need a structured choice.
JevProxy sits as a transparent, high-speed reverse proxy between your agent harness and upstream LLM providers. It intercepts intermediate control-plane turns, executing them via TypeSafe Jev System One in <25ms at $0.0001 per call, while passing long-form generative tasks to OpenAI and Claude upstream.
Agent Harness (LangChain / CrewAI / Cursor / Custom)
│
│ Standard OpenAI / Anthropic SDK Request
▼
┌───────────────────────────────────────────────┐
│ JEVPROXY GATEWAY (<25ms) │
│ https://api.jevproxy.com/v1 │
└───────┬───────────────────────────────┬───────┘
│ │
[Micro-Decisions / Tools] [Long-form Generative Prose]
│ │
▼ ▼
TypeSafe Jev System One Upstream LLMs (GPT-4o / Claude)
• 18.4ms execution latency • High-context creative text
• $0.0001 per decision turn • Transparent pass-through
• 100% calibrated probabilities • Zero code changes required2. Quickstart (1-Line Drop-in)
Integrate JevProxy into any existing application by pointing your SDK's baseURL to the JevProxy gateway:
npx jevproxy initimport OpenAI from "openai";
// Drop-in JevProxy: change only baseURL and pass your JevProxy key
const openai = new OpenAI({
baseURL: "https://api.jevproxy.com/v1",
apiKey: process.env.JEVPROXY_API_KEY, // e.g. "jev_live_..."
});
// Any decision turns execute in <25ms at $0.0001!
const response = await openai.chat.completions.create({
model: "gpt-4o",
messages: [
{ role: "system", content: "Select optimal action: [approve, reject, escalate]" },
{ role: "user", content: "Refund requested on order #891" }
]
});3. Coding Agents & Tool Calling Acceleration
Modern coding agents (Claude Code, Cursor, Codex, Windsurf, OpenCode, Cline) spend huge amounts of time and reasoning tokens on every turn deciding which tool to call. JevProxy sits directly between your agent and upstream LLM providers, intercepting the tools: [...] array and using TypeSafe Jev in sub-25ms to accelerate execution:
When tools have closed parameters (enums, booleans, constants), JevProxy executes the tool call in <30ms without calling OpenAI or Claude upstream.
When open text generation is needed, JevProxy forces tool_choice upstream. Heavy reasoning models skip deliberation and immediately produce arguments.
Agents with dozens of MCP servers (like Claude Code with 280+ tools) are intelligently sharded into tournament batches so context windows never overflow.
npx jevproxy loginAuthenticate with your JevProxy keynpx jevproxy claudeRun Claude Code accelerated by Jevnpx jevproxy codexRun OpenAI Codex with forced tool choicenpx jevproxy cursorShow 1-click Cursor IDE config4. AI Agent Skill (/skill.md)
Autonomous developer agents (such as Claude Code, Cursor, GitHub Copilot, or LangChain) can natively load JevProxy as an autonomous skill. The specification is hosted publicly at /skill.md and /.well-known/skill.md.
- Create a skill folder:
.agents/skills/jevproxy/SKILL.mdin your workspace. - Download or copy the raw specification from https://jevproxy.com/skill.md.
- Your agent will automatically intercept intermediate reasoning steps and tool selection loops through JevProxy.
5. System One Decision Primitives
TypeSafe Jev replaces stochastic text generation with calibrated non-autoregressive decision models. Three core primitives are supported:
Evaluates multiple discrete options against strict rubric criteria. Returns the winning choice with confidence score.
Calibrated Boolean verdict (true/false) accompanied by raw execution probability between 0.00 and 1.00.
Continuous evaluation against an ordered quality or severity scale (e.g. 1 to 10 or Low/Med/High).
6. Gateway API Reference
https://api.jevproxy.com/api/v1/chat/completionsStandard OpenAI-compatible completions endpoint. Supports direct zero-LLM execution for closed tools and forced tool_choice.
https://api.jevproxy.com/api/v1/messagesNative Anthropic Messages API endpoint. Drop-in support for Claude Code and Anthropic SDKs with smart steering hints and direct tool dispatch.
https://api.jevproxy.com/api/v1/systemoneNative TypeSafe System One evaluator endpoint for raw structured questions, schemas, and calibrated scoring.
7. Control Headers & Routing Flags
Customize how requests are routed through JevProxy by passing optional HTTP headers:
| HEADER | VALUES | DESCRIPTION |
|---|---|---|
| x-jev-route | force | bypass | force guarantees sub-25ms Jev execution regardless of prompt size. bypass transparently passes through to upstream LLM. |
| x-openai-api-key | sk-... | Your customer OpenAI API key for pass-through requests that require upstream generation. |
| x-anthropic-api-key | sk-ant-... | Your customer Anthropic API key for pass-through requests to the Messages API. |
| x-jev-demo | true | Enables rate-limited evaluation in the interactive playground without an API key. |
8. Prompt Injection & Safety Guardrails
Intercept adversarial inputs, jailbreaks, and system prompt override attempts in sub-25ms before any tokens reach an expensive LLM:
// Check incoming prompt safety via JevProxy Guardrails API
const response = await fetch("https://api.jevproxy.com/api/v1/guardrails/check", {
method: "POST",
headers: {
"Content-Type": "application/json",
"Authorization": "Bearer jev_live_your_key_here"
},
body: JSON.stringify({
prompt: userQuery
})
});
const data = await response.json();
if (data.isThreat) {
throw new Error("Prompt injection attempt intercepted: " + data.threatLevel);
}9. Response Headers & Telemetry
Every request proxied through JevProxy includes real-time telemetry headers so you can audit performance on every turn:
10. Full Code Examples
PYTHON (OPENAI SDK)
from openai import OpenAI
import os
client = OpenAI(
base_url="https://api.jevproxy.com/api/v1",
api_key=os.environ.get("JEVPROXY_API_KEY")
)
response = client.chat.completions.create(
model="gpt-4o",
messages=[
{"role": "system", "content": "Route to billing, technical, or sales."},
{"role": "user", "content": "I need to update my company payment method."}
]
)
print(response.choices[0].message.content)
# 18.4ms latency | $0.0001 costANTHROPIC PYTHON SDK (CLAUDE)
import anthropic
client = anthropic.Anthropic(
base_url="https://api.jevproxy.com/api/v1",
api_key=os.environ.get("JEVPROXY_API_KEY")
)
message = client.messages.create(
model="claude-3-5-sonnet-20241022",
max_tokens=1024,
messages=[{"role": "user", "content": "What is the git status?"}],
tools=[{"name": "git_status", "description": "Check working tree status", "input_schema": {"type": "object"}}]
)
# Direct execution in <30ms with 0 reasoning tokens burned!cURL
curl https://api.jevproxy.com/api/v1/chat/completions \
-H "Authorization: Bearer $JEVPROXY_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "gpt-4o",
"messages": [
{"role": "system", "content": "Classify priority: p0, p1, or p2."},
{"role": "user", "content": "Checkout DB replica lag is 40 minutes."}
]
}'11. Rate Limits & Error Codes
| HTTP CODE | ERROR CODE | RESOLUTION |
|---|---|---|
| 401 | UNAUTHORIZED | Missing or invalid Bearer token. Generate an API key from the Console. |
| 403 | FREE_QUOTA_BLOCKED | Free Starter tier is unavailable for this account. Upgrade to Pro. |
| 429 | QUOTA_EXCEEDED | Monthly plan call limit reached (5k Free / 50k Pro / 500k Scale). Upgrade in Console. |
| 429 | DEMO_LIMIT_EXCEEDED | Playground demo limit (10 calls/15 min). Sign up for a starter API key to continue. |