Changelog

Opik Dashboard:

• Added the option to download traces and LLM calls as CSV files from the UI:

  

• Introduce a new quickstart guide to help you get started:

  

• Updated datasets to support more flexible data schema, you can now insert items with any key value pairs and not just input and expected_output. See more in the SDK section below.
• Multiple small UX improvements (more informative empty state for projects, updated icons, feedback tab in the experiment page, etc).
• Fix issue with \t characters breaking the YAML code block in the traces page.

SDK:

• Datasets now support more flexible data schema, we now support inserting items with any key value pairs:

  1
  import opik
  2
  3
  client = opik.Opik()
  4
  dataset = client.get_or_create_dataset(name="Demo Dataset")
  5
  dataset.insert([
  6
      {
  7
          "user_question": "Hello, what can you do ?",
  8
          "expected_output": {
  9
              "assistant_answer": "I am a chatbot assistant that can answer questions and help you with your queries!"
  10
          }
  11
      },
  12
      {
  13
          "user_question": "What is the capital of France?",
  14
          "expected_output": {
  15
              "assistant_answer": "Paris"
  16
          }
  17
      },
  18
  ])

• Released WatsonX, Gemini and Groq integration based on the LiteLLM integration.

• The context field is now optional in the Hallucination metric.

• LLM as a Judge metrics now support customizing the LLM provider by specifying the model parameter. See more in the Customizing LLM as a Judge metrics section.

• Fixed an issue when updating feedback scores using the update_current_span and update_current_trace methods. See this Github issue for more details.