Automate Prompt Engineering
& Agent Optimization
Step up your agent development workflows using Opik to automatically iterate and tune system prompts you can freeze and deploy in production.
Unlock cost, performance, and reliability improvements in a fraction of the time you’d spend on manual prompt engineering.
Trusted by the most innovative AI teams
Automate Multi-Trial Optimization at Scale
Automated prompt engineering gives your complex agentic systems the most predictable LLM performance across multiple models, with efficient iteration built into your LLM eval lifecycle.
Generate, Score, & Implement Elite Prompts
The Opik Agent Optimizer SDK comes with everything you need to generate new prompts automatically, score them based on your eval criteria, and trust that the best version makes it to production.
Run Seven Prompt Optimization Algorithms in One Package
Few-Shot Bayesian
Optimizer
- Ideal for text-based chat models with template-based, stable examples
- Automatically finds the best set of few-shot example combinations
- Efficient, probabilistic framework chooses which combination to try next
Hierarchical Reflective Prompt Optimizer (HRPO)
- Identifies failed outcomes from existing prompts and applies hierarchical root-cause analysis
- Generates targeted improvements to systematically address each failure mode
- Ideal when you have a complex prompt that needs to be surgically fixed rather than entirely rewritten
MetaPrompt Optimizer
- Refines and expands your initial prompt draft using a reasoning model
- Improves wording, structure, and clarity to achieve better results that more closely resemble your golden dataset
- Iteratively generates and scores multiple prompt candidates and returns the best one
Evolutionary Optimizer
- Optimizes for multiple objectives and adds diversity and exploration to your workflow
- Uses genetic algorithms with selection, mutation, and crossover operations
- Stronger ability to “think outside the box” and discover new prompt solutions
GEPA Optimizer
- Wraps the external GEPA package to optimize a single system prompt for single-turn tasks
- Optimizes using a task model and a reflection model to return optimized results
- Expands GEPA’s built-in baseline evaluation with the full suite of Opik LLM evaluation metrics for more precise optimization
Parameter Optimizer
- Finds the best parameter or configuration for your specific task when you already have a solid prompt
- Uses Bayesian optimization to tune LLM call parameters like temperature, top_p, frequency_penalty, and more
- Tunes model behavior without interfering with your actual prompt text
Tool Optimization (MCP & Function Calling)
- Extends prompt optimization capabilities to prompts that use external tools and function calls like MCP (Model Context Protocol), tool schemas with structured definitions and parameters, and multi-step agentic workflows
- True tool optimization means Opik can optimize the tools themselves, their schemas, or MCP integrations, where other algorithms simply optimize agents that use tools
- Ideal for modern agentic systems that require integration with external APIs and services, structured data processing through function calls, complex multi-step reasoning with tools, or dynamic tool selection based on context
Opik is Free & Fully Open Source
LLM observability should be accessible to everyone building the next generation of AI applications and agents. Opik is truly open source with no gotchas, and the hosted version comes with a full-featured free tier.
The Agent Optimizer SDK is fully available under an Opik open-source license,
and it’s included in all Comet subscription plans.
An AI Platform Built for Enterprise, Driven by Community
“LLMs are black boxes. We don’t know what is going on inside them. We needed a solution that allowed us to see how our models behaved, and Opik gives us the ability to understand what went wrong, and share that with the team to debug and iterate faster.”
DMITRII KRASNOV
ENGINEERING MANAGER AT FOR GOOD AI,
MAKERS OF ZENCODER
Get started today for free.
You don’t need a credit card to sign up, and your Comet account comes with a generous free tier you can actually use—for as long as you like.