-
Announcing Opik’s Guardrails Beta: Moderate LLM Applications in Real-Time
We’ve spent the past year building tools that make LLM applications more transparent, measurable, and accountable. Since launching Opik, our…
-
From Observability to Optimization: Announcing the Opik Agent Optimizer Public Beta
At Comet, we’re driven by a commitment to advance innovation in AI, particularly in the realm of LLM observability. Our…
-
Major Releases: MCP Server & Google Agent Dev Kit Support
We’ve just rolled out two major updates in Opik, Comet’s open-source LLM evaluation platform, that make it easier than ever…
-
SelfCheckGPT for LLM Evaluation
Detecting hallucinations in language models is challenging. There are three general approaches: The problem with many LLM-as-a-Judge techniques is that…
-
LLM Hallucination Detection in App Development
Even ChatGPT knows it’s not always right. When prompted, “Are large language models (LLMs) always accurate?” ChatGPT says no and…
-
LLM Evaluation Frameworks: Head-to-Head Comparison
As teams work on complex AI agents and expand what LLM-powered applications can achieve, a variety of LLM evaluation frameworks…
-
LLM Juries for Evaluation
Evaluating the correctness of generated responses is an inherently challenging task. LLM-as-a-Judge evaluators have gained popularity for their ability to…
-
A Simple Recipe for LLM Observability
So, you’re building an AI application on top of an LLM, and you’re planning on setting it live in production.…
-
LLM Monitoring & Maintenance in Production Applications
Generative AI has become a transformative force, revolutionizing how businesses engage with users through chatbots, content creation, and personalized recommendations.…
-
Building Opik: A Scalable Open-Source LLM Observability Platform
Opik is an open-source platform for evaluating, testing, and monitoring LLM applications, created by Comet. When teams integrate language models…
Run open source LLM evaluations with Opik!
Star
Category: LLMOps
Get started today for free.
You don’t need a credit card to sign up, and your Comet account comes with a generous free tier you can actually use—for as long as you like.