Observability for Smolagents with Opik

Smolagents is a framework from HuggingFace that allows you to create AI agents with various capabilities.

The framework provides a simple way to build agents that can perform tasks like coding, searching the web, and more with built-in support for multiple tools and LLM providers.

Account Setup

Comet provides a hosted version of the Opik platform, simply create an account and grab your API Key.

You can also run the Opik platform locally, see the installation guide for more information.

Getting Started

Installation

To use the Smolagents integration with Opik, you will need to have Smolagents and the required OpenTelemetry packages installed:

pip install --upgrade opik 'smolagents[telemetry,toolkit]' opentelemetry-sdk opentelemetry-exporter-otlp

Configuring Smolagents

In order to use Smolagents, you will need to configure your LLM provider API keys. For this example, we’ll use OpenAI. You can find or create your API keys in these pages:

You can set them as environment variables:

export OPENAI_API_KEY="YOUR_API_KEY"

Or set them programmatically:

import os
import getpass
if "OPENAI_API_KEY" not in os.environ:
    os.environ["OPENAI_API_KEY"] = getpass.getpass("Enter your OpenAI API key: ")

Configuring OpenTelemetry

You will need to set the following environment variables to configure OpenTelemetry to send data to Opik:

export OTEL_EXPORTER_OTLP_ENDPOINT=https://www.comet.com/opik/api/v1/private/otel
export OTEL_EXPORTER_OTLP_HEADERS='Authorization=<your-api-key>,Comet-Workspace=default'

export OTEL_EXPORTER_OTLP_HEADERS='Authorization=<your-api-key>,Comet-Workspace=default,projectName=<your-project-name>'

Using Opik with Smolagents

To track your Smolagents applications, you will need to configure OpenTelemetry to instrument the framework:

# Import telemetry components
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry.sdk.trace.export import SimpleSpanProcessor
# Import SmolAgents instrumentation
from openinference.instrumentation.smolagents import SmolagentsInstrumentor
# Import OTLP exporter
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
# Set up the tracer provider with span processor
trace_provider = TracerProvider()
trace_provider.add_span_processor(
    SimpleSpanProcessor(OTLPSpanExporter())
)
# Instrument SmolAgents
SmolagentsInstrumentor().instrument(tracer_provider=trace_provider)
# Now use SmolAgents as usual
from smolagents import CodeAgent, WebSearchTool, OpenAIServerModel
model = OpenAIServerModel(model_id="gpt-4o")
agent = CodeAgent(
    tools=[WebSearchTool()],
    model=model,
    stream_outputs=True
)
agent.run("How many seconds would it take for a leopard at full speed to run through Pont des Arts?")

Further improvements

If you would like to see us improve this integration, simply open a new feature request on Github.