Observability for Hermes with Opik

Hermes can send trace data to Opik through the plugin package opik-hermes.

This integration captures:

  • A root trace per agent turn, organized by Hermes session_id
  • LLM spans (type=llm): messages, assistant output, model/provider, token usage, and USD cost
  • Tool spans (type=tool): tool arguments and results

Prerequisites

  • The Hermes agent framework installed.
  • Opik project/workspace details (for cloud or enterprise deployments).

Setup

1

1. Install the plugin

$pip install opik-hermes

Installing the package automatically registers the plugin with Hermes.

2

2. Enable the plugin

Add opik to the enabled plugins in ~/.hermes/config.yaml:

1plugins:
2 enabled: [opik]
3

3. Configure Opik credentials

Set the Opik environment variables in ~/.hermes/.env.

For a local open-source Opik deployment:

$OPIK_URL_OVERRIDE=http://localhost:5173/api
$OPIK_PROJECT_NAME=hermes

For Comet-hosted Opik:

$OPIK_API_KEY=your-api-key
$OPIK_WORKSPACE=your-workspace

Validate setup

Run a Hermes chat session and verify traces appear in the configured Opik project dashboard.

Next step

For OTEL-native pipelines, see OpenTelemetry integration.