-
LLM Evaluation Frameworks: Head-to-Head Comparison
As teams work on complex AI agents and expand what LLM-powered applications can achieve, a variety of LLM evaluation frameworks…
-
LLM Juries for Evaluation
Evaluating the correctness of generated responses is an inherently challenging task. LLM-as-a-Judge evaluators have gained popularity for their ability to…
-
A Simple Recipe for LLM Observability
So, you’re building an AI application on top of an LLM, and you’re planning on setting it live in production.…
-
LLM Monitoring & Maintenance in Production Applications
Generative AI has become a transformative force, revolutionizing how businesses engage with users through chatbots, content creation, and personalized recommendations.…
-
Building Opik: A Scalable Open-Source LLM Observability Platform
Opik is an open-source platform for evaluating, testing, and monitoring LLM applications, created by Comet. When teams integrate language models…
-
G-Eval for LLM Evaluation
LLM-as-a-judge evaluators have gained widespread adoption due to their flexibility, scalability, and close alignment with human judgment. They excel at…
-
Comet Product Releases January 2025
As 2025 picks up steam, we’re thrilled to bring you some exciting product updates from Comet! This month, we’ve added…
-
Build Multi-Index Advanced RAG Apps
Welcome to Lesson 12 of 12 in our free course series, LLM Twin: Building Your Production-Ready AI Replica. You’ll learn…
-
Build a scalable RAG ingestion pipeline using 74.3% less code
Welcome to Lesson 11 of 12 in our free course series, LLM Twin: Building Your Production-Ready AI Replica. You’ll learn…
-
LLM Evaluation Metrics Every Developer Should Know
When you build an app or system on top of an LLM, you need a way to understand the quality…
Run open source LLM evaluations with Opik!
Star
Comet Blog
-
From Observability to Optimization: Announcing the Opik Agent Optimizer Public Beta
At Comet, we’re driven by a commitment to advance innovation in AI, particularly in the realm of LLM observability. Our…
Get started today for free.
Trusted by Thousands of Data Scientists