Feedback Definitions

Feedback definitions allow you to create custom labels to systematically collect and analyze structured feedback on your LLM outputs.

Using Feedback Definitions

Once created, feedback definitions appear in two places:

1. Trace and thread sidebars — Add scores when reviewing individual items.
2. Annotation queues — Pick which definitions annotators see when you create a queue.

Creating a Feedback Definition

1. Click Create new feedback definition
2. Enter a Name for your feedback definition
3. Select the Type: Categorical or Numerical
4. Define the Values (for Categorical) or Range (for Numerical)

Common Feedback Types