Evaluation

The TypeScript SDK provides a streamlined approach to evaluating your LLM applications with the evaluate function that handles various evaluation scenarios.

Structure

The TypeScript SDK evaluation documentation covers:

• Quick Start: Get up and running with basic evaluations
• Datasets: Working with evaluation datasets
• Evaluate Function: Using the evaluate function
• Evaluation Metrics: Available metrics and creating custom metrics
• Experiments: Creating and managing evaluation experiments
• Test Suites: Regression testing with assertions and execution policies