Agent frameworks

Mint itr_rt_* in Settings → Runtime API keys. Keep upstream secrets in the Provider vault; clients should not need vendor sk- keys.

LLM plane: point any OpenAI-compatible client at https://intertrace.fly.dev/v1. Tool plane: wrap tools with @intertrace-runtime/runtime so authorize + permits run before the body.

# LangGraph / LangChain: base_url="https://intertrace.fly.dev/v1"
# OpenAI Agents: set_default_openai_client + chat_completions
# CrewAI: LLM(..., base_url="https://intertrace.fly.dev/v1")
# LlamaIndex: api_base="https://intertrace.fly.dev/v1"
# Mastra / Vercel AI / Pydantic AI: OpenAI provider baseURL

TypeScript adapters: protectLangChainTool, protectOpenAIAgentsTool, protectVercelAiTool, protectMastraTool, protectCrewAiTool, protectLlamaIndexTool, protectAutoGenTool, protectSemanticKernelTool, protectPydanticAiTool. Google ADK / Claude Agent SDK / .NET use the /v1, /anthropic, /mcp, or /a2a planes, not npm wrappers yet.

LiteLLM · OpenAI SDK · SDKs.

Point OpenAIChatGenerator at the edge with api_base_url and pass the runtime key as its API key. Every model call the pipeline or agent makes then goes through Intertrace.

import os
from haystack.components.generators.chat import OpenAIChatGenerator
from haystack.utils import Secret

llm = OpenAIChatGenerator(
    model="gpt-4o-mini",
    api_key=Secret.from_env_var("INTERTRACE_RUNTIME_API_KEY"),  # itr_rt_…
    api_base_url="https://intertrace.fly.dev/v1",
)

There is no Haystack tool wrapper. The tool calls the model proposes are still checked by the gateway's tool-call gate on the way back.

1. 1

   Create an OpenAI credential

   In n8n, open Credentials, add an OpenAI credential and use your itr_rt_… runtime key as the API key.
2. 2

   Set the Base URL

   Set Base URL to https://intertrace.fly.dev/v1 and save.
3. 3

   Use it for the model

   Select the credential in the OpenAI Chat Model attached to your AI Agent node, and pick a model that GET /v1/models lists.

Make and Zapier are not covered: their OpenAI steps can't point at a custom base URL.