-
Major Releases: Auto-Optimize Multi-Step Agents, Annotate & Score Entire Chatbot Convos
When multiple steps in an agentic system are contextually related, logging and evaluating individual LLM calls doesn’t tell the whole…
-
AI Assisted Coding with Cursor AI and Opik
How AI can help you move beyond vibe coding and become an effective AI engineer faster than you think Dear…
-
Release Highlights: Discover Opik Agent Optimizer, Guardrails, & New Integrations
As LLMs power more complex, multi-step agentic systems, the need for precise optimization and control is growing. In case you…
-
Announcing Opik’s Guardrails Beta: Moderate LLM Applications in Real-Time
We’ve spent the past year building tools that make LLM applications more transparent, measurable, and accountable. Since launching Opik, our…
-
Major Releases: MCP Server & Google Agent Dev Kit Support
We’ve just rolled out two major updates in Opik, Comet’s open-source LLM evaluation platform, that make it easier than ever…
-
How Contributing to Open Source Projects Helped Me Build My Dream Career in AI
6 years ago, I decided to open-source my Python code for a personal project I was working on, which led…
-
LLM Evaluation Complexities for Non-Latin Languages
Large language models (LLMs) have revolutionized natural language processing, yet most development and evaluation efforts have historically centered around Latin-script…
-
SelfCheckGPT for LLM Evaluation
Detecting hallucinations in language models is challenging. There are three general approaches: The problem with many LLM-as-a-Judge techniques is that…
-
LLM Hallucination Detection in App Development
Even ChatGPT knows it’s not always right. When prompted, “Are large language models (LLMs) always accurate?” ChatGPT says no and…
-
Major Releases: TypeScript for LLM Evals, Total Fidelity ML Metrics, & More
Spring is in the air, and we’re excited to bring you four fresh releases in the Comet platform to make…
Run open source LLM evaluations with Opik!
Star
Comet Blog
-
From Observability to Optimization: Announcing the Opik Agent Optimizer Public Beta
At Comet, we’re driven by a commitment to advance innovation in AI, particularly in the realm of LLM observability. Our…
Get started today for free.
Trusted by Thousands of Data Scientists