Observability for coding agents

View as Markdown

Teams adopting AI coding agents need three things: to see what the agent did, to spend less doing it, or to use the agent to add observability to their own app.

You want to…UseWhat you get
See what the agent did. Read the conversation, check which tools ran, debug a bad run, share a session with a teammate.Opik tracing, set up per agentEvery prompt, response and tool call, grouped into threads you can score, annotate and share.
Spend less doing it. Find where the tokens actually go, per user and per repo, then cut the waste.Cost IntelligenceToken counts broken out across system prompt, tools, MCP servers, skills and memory, plus policy controls. Metadata only — never your code or conversations.
Add observability to your own app. Instrument your code, score outputs and run experiments from your coding agent.Opik MCP serveruvx opik mcp configure registers the server and the Opik skills with your agent.

Set up tracing for your agent

Each agent has its own way of getting sessions out. The Quick start column is the single step that does most of the work; the linked page has the full setup, endpoint modes and validation.

AgentPath into OpikQuick startContent capturedCost Intelligence
Claude CodeOpik plugin (recommended), or native OTel export (beta)/plugin install opik inside Claude CodePlugin: yes. OTel: redacted unless enabledSupported
GitHub Copilot (VS Code, CLI)Native OTel exportgithub.copilot.chat.otel.enabled: true plus the Opik endpointOff unless captureContent is enabledAsk your account team
CursorOpik Cursor extensionInstall the Opik extension and paste your API keyYesSupported
OpenAI CodexNative OTel exporttrace_exporter = "otlp-http" in ~/.codex/config.tomlOff unless log_user_prompt = trueSupported
Other agents (opencode, Gemini CLI, …)Native OTel export if the agent emits gen_ai.* spansPoint the agent’s OTLP exporter at the Opik OTel endpointDepends on the agentNot yet

Every native OpenTelemetry path (GitHub Copilot, OpenAI Codex, Claude Code OTel, other agents) shares one property: content is redacted by default and has to be switched on explicitly. Check your organization’s policy before enabling prompt and response export. Structure, timing and token counts are logged either way.