> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://www.comet.com/docs/opik/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://www.comet.com/docs/opik/_mcp/server.

# Feedback Definitions

> Configure custom feedback types for evaluating LLM outputs

Feedback definitions allow you to create custom labels to systematically collect and analyze structured feedback on your LLM outputs.

## Using Feedback Definitions

Once created, feedback definitions appear in two places:

1. **Trace and thread sidebars** — Add scores when reviewing individual items.
2. **Annotation queues** — Pick which definitions annotators see when you create a queue.

![Annotation Queue Feedback Selection](https://fdr-prod-docs-files-public.s3.us-east-1.amazonaws.com/opik.docs.buildwithfern.com/3ef5c788ee095080642b262c16eb046a65ac4851bd1d398d8fa78896d68ae8bb/img/administration/annotation_queue.png?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA6KXJSKKNFOCF7G4B%2F20260920%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260920T144100Z&X-Amz-Expires=604800&X-Amz-Signature=04e9348e1257366dcb22184e2217634fea54970b033bb6f87123ce002e05ae4c&X-Amz-SignedHeaders=host&x-amz-checksum-mode=ENABLED&x-id=GetObject)

You can also log feedback scores programmatically using the SDK. See the [SDK documentation](/reference/overview) for details.

## Creating a Feedback Definition

![New Feedback Definition Modal](https://fdr-prod-docs-files-public.s3.us-east-1.amazonaws.com/opik.docs.buildwithfern.com/2c79a89044197e3cb533a8a665c0b156ae2ea3698e34d18a09969020ce6abf3b/img/configuration/new_feedback_definition.png?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA6KXJSKKNFOCF7G4B%2F20260920%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260920T144100Z&X-Amz-Expires=604800&X-Amz-Signature=9a71d67c4f70bda7b9a25449d1447925b8212b7f97ba501439cfe3acca547e15&X-Amz-SignedHeaders=host&x-amz-checksum-mode=ENABLED&x-id=GetObject)

1. Click **Create new feedback definition**
2. Enter a **Name** for your feedback definition
3. Select the **Type**: Categorical or Numerical
4. Define the **Values** (for Categorical) or **Range** (for Numerical)

## Common Feedback Types

| Feedback Type    | Type        | Values                      |
| ---------------- | ----------- | --------------------------- |
| Thumbs Up / Down | Categorical | thumbs up, thumbs down      |
| Usefulness       | Categorical | Useful, Neutral, Not useful |
| Hallucination    | Categorical | Yes, No                     |
| Correct          | Categorical | Good, Bad                   |