JEVPROXY DOCUMENTATION
ARCHITECTURE & VALUE PROPOSITION

1. Overview & Architecture

Autonomous AI agents follow a continuous execution loop: Perceive → Decide → Execute → Synthesize. In traditional setups, every micro-decision (selecting a tool, scoring severity, running a guardrail check) is sent to heavy autoregressive models like GPT-4o or Claude 3.5 Sonnet. This burns 1,400ms and $0.02 on turns that only need a structured choice.

JevProxy sits as a transparent, high-speed reverse proxy between your agent harness and upstream LLM providers. It intercepts intermediate control-plane turns, executing them via TypeSafe Jev System One in <25ms at $0.0001 per call, while passing long-form generative tasks to OpenAI and Claude upstream.

Agent Harness (LangChain / CrewAI / Cursor / Custom)
        │
        │ Standard OpenAI / Anthropic SDK Request
        ▼
┌───────────────────────────────────────────────┐
│           JEVPROXY GATEWAY (<25ms)            │
│         https://api.jevproxy.com/v1           │
└───────┬───────────────────────────────┬───────┘
        │                               │
[Micro-Decisions / Tools]       [Long-form Generative Prose]
        │                               │
        ▼                               ▼
TypeSafe Jev System One         Upstream LLMs (GPT-4o / Claude)
• 18.4ms execution latency      • High-context creative text
• $0.0001 per decision turn     • Transparent pass-through
• 100% calibrated probabilities • Zero code changes required

2. Quickstart (1-Line Drop-in)

Integrate JevProxy into any existing application by pointing your SDK's baseURL to the JevProxy gateway:

TERMINAL CLI INIT
npx jevproxy init
NODE.JS / TYPESCRIPT (OPENAI SDK)
import OpenAI from "openai";

// Drop-in JevProxy: change only baseURL and pass your JevProxy key
const openai = new OpenAI({
  baseURL: "https://api.jevproxy.com/v1",
  apiKey: process.env.JEVPROXY_API_KEY, // e.g. "jev_live_..."
});

// Any decision turns execute in <25ms at $0.0001!
const response = await openai.chat.completions.create({
  model: "gpt-4o",
  messages: [
    { role: "system", content: "Select optimal action: [approve, reject, escalate]" },
    { role: "user", content: "Refund requested on order #891" }
  ]
});
CODING AGENTS & TOOL CALLING ACCELERATOR

3. Coding Agents & Tool Calling Acceleration

Modern coding agents (Claude Code, Cursor, Codex, Windsurf, OpenCode, Cline) spend huge amounts of time and reasoning tokens on every turn deciding which tool to call. JevProxy sits directly between your agent and upstream LLM providers, intercepting the tools: [...] array and using TypeSafe Jev in sub-25ms to accelerate execution:

Direct Execution0 LLM TOKENS

When tools have closed parameters (enums, booleans, constants), JevProxy executes the tool call in <30ms without calling OpenAI or Claude upstream.

Forced Tool Choice-80% TOKENS

When open text generation is needed, JevProxy forces tool_choice upstream. Heavy reasoning models skip deliberation and immediately produce arguments.

Dynamic Sharding250+ TOOLS

Agents with dozens of MCP servers (like Claude Code with 280+ tools) are intelligently sharded into tournament batches so context windows never overflow.

OFFICIAL JEVPROXY DEVELOPER CLI
npx jevproxy loginAuthenticate with your JevProxy key
npx jevproxy claudeRun Claude Code accelerated by Jev
npx jevproxy codexRun OpenAI Codex with forced tool choice
npx jevproxy cursorShow 1-click Cursor IDE config

4. AI Agent Skill (/skill.md)

Autonomous developer agents (such as Claude Code, Cursor, GitHub Copilot, or LangChain) can natively load JevProxy as an autonomous skill. The specification is hosted publicly at /skill.md and /.well-known/skill.md.

HOW TO ADD TO CURSOR OR CLAUDE CODE
  1. Create a skill folder: .agents/skills/jevproxy/SKILL.md in your workspace.
  2. Download or copy the raw specification from https://jevproxy.com/skill.md.
  3. Your agent will automatically intercept intermediate reasoning steps and tool selection loops through JevProxy.

5. System One Decision Primitives

TypeSafe Jev replaces stochastic text generation with calibrated non-autoregressive decision models. Three core primitives are supported:

ChoiceROUTING

Evaluates multiple discrete options against strict rubric criteria. Returns the winning choice with confidence score.

Example: Tool dispatch, department triage, intent categorization.
NoulPROBABILITY

Calibrated Boolean verdict (true/false) accompanied by raw execution probability between 0.00 and 1.00.

Example: Safety check, refund policy eligibility, fraud trigger.
ScoreRUBRIC

Continuous evaluation against an ordered quality or severity scale (e.g. 1 to 10 or Low/Med/High).

Example: Lead qualification, bug urgency ranking, threat rating.

6. Gateway API Reference

POSThttps://api.jevproxy.com/api/v1/chat/completions

Standard OpenAI-compatible completions endpoint. Supports direct zero-LLM execution for closed tools and forced tool_choice.

POSThttps://api.jevproxy.com/api/v1/messages

Native Anthropic Messages API endpoint. Drop-in support for Claude Code and Anthropic SDKs with smart steering hints and direct tool dispatch.

POSThttps://api.jevproxy.com/api/v1/systemone

Native TypeSafe System One evaluator endpoint for raw structured questions, schemas, and calibrated scoring.

7. Control Headers & Routing Flags

Customize how requests are routed through JevProxy by passing optional HTTP headers:

HEADERVALUESDESCRIPTION
x-jev-routeforce | bypassforce guarantees sub-25ms Jev execution regardless of prompt size. bypass transparently passes through to upstream LLM.
x-openai-api-keysk-...Your customer OpenAI API key for pass-through requests that require upstream generation.
x-anthropic-api-keysk-ant-...Your customer Anthropic API key for pass-through requests to the Messages API.
x-jev-demotrueEnables rate-limited evaluation in the interactive playground without an API key.

8. Prompt Injection & Safety Guardrails

Intercept adversarial inputs, jailbreaks, and system prompt override attempts in sub-25ms before any tokens reach an expensive LLM:

// Check incoming prompt safety via JevProxy Guardrails API
const response = await fetch("https://api.jevproxy.com/api/v1/guardrails/check", {
  method: "POST",
  headers: {
    "Content-Type": "application/json",
    "Authorization": "Bearer jev_live_your_key_here"
  },
  body: JSON.stringify({
    prompt: userQuery
  })
});

const data = await response.json();
if (data.isThreat) {
  throw new Error("Prompt injection attempt intercepted: " + data.threatLevel);
}

9. Response Headers & Telemetry

Every request proxied through JevProxy includes real-time telemetry headers so you can audit performance on every turn:

x-jev-latency-ms: 18.4
x-jev-savings-usd: 0.0149
x-jev-engine: typesafe-system-one-v1.13
x-jev-intercepted: true
x-jev-mode: direct | forced | hint | none

10. Full Code Examples

PYTHON (OPENAI SDK)

from openai import OpenAI
import os

client = OpenAI(
    base_url="https://api.jevproxy.com/api/v1",
    api_key=os.environ.get("JEVPROXY_API_KEY")
)

response = client.chat.completions.create(
    model="gpt-4o",
    messages=[
        {"role": "system", "content": "Route to billing, technical, or sales."},
        {"role": "user", "content": "I need to update my company payment method."}
    ]
)

print(response.choices[0].message.content)
# 18.4ms latency | $0.0001 cost

ANTHROPIC PYTHON SDK (CLAUDE)

import anthropic

client = anthropic.Anthropic(
    base_url="https://api.jevproxy.com/api/v1",
    api_key=os.environ.get("JEVPROXY_API_KEY")
)

message = client.messages.create(
    model="claude-3-5-sonnet-20241022",
    max_tokens=1024,
    messages=[{"role": "user", "content": "What is the git status?"}],
    tools=[{"name": "git_status", "description": "Check working tree status", "input_schema": {"type": "object"}}]
)
# Direct execution in <30ms with 0 reasoning tokens burned!

cURL

curl https://api.jevproxy.com/api/v1/chat/completions \
  -H "Authorization: Bearer $JEVPROXY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-4o",
    "messages": [
      {"role": "system", "content": "Classify priority: p0, p1, or p2."},
      {"role": "user", "content": "Checkout DB replica lag is 40 minutes."}
    ]
  }'

11. Rate Limits & Error Codes

HTTP CODEERROR CODERESOLUTION
401UNAUTHORIZEDMissing or invalid Bearer token. Generate an API key from the Console.
403FREE_QUOTA_BLOCKEDFree Starter tier is unavailable for this account. Upgrade to Pro.
429QUOTA_EXCEEDEDMonthly plan call limit reached (5k Free / 50k Pro / 500k Scale). Upgrade in Console.
429DEMO_LIMIT_EXCEEDEDPlayground demo limit (10 calls/15 min). Sign up for a starter API key to continue.