Run open source LLM evaluations with Opik!

Star
Comet logo
  • Comet logo
  • Opik LLM Evals
  • Products
    • Opik – LLM Evaluation
    • ML Experiment Management
    • ML Artifacts
    • ML Model Registry
    • ML Model Production Monitoring
  • Docs
    • Opik – LLM Evaluation
    • ML Experiment Management
  • Pricing
  • Customers
  • Learn
    • Blog
    • Deep Learning Weekly
  • Company
    • About Us
    • News and Events
      • Events
      • Press Releases
    • Careers
    • Contact Us
    • Leadership
  • Login
Get Demo
Try Comet Free
Get Demo
Try Comet Free
  1. Home
  2. Product

Category: Product

  • Academic Research
  • Comet Community Hub
  • Industry
  • Integrations
  • LLMOps
  • Machine Learning
  • Office Hours
  • Partners & Integrations
  • Product
  • Thought Leadership
  • Tutorials
  • Uncategorized
  • Caroline Borders

    July 14, 2025
    Product

    Major Releases: Auto-Optimize Multi-Step Agents, Annotate & Score Entire Chatbot Convos

    When multiple steps in an agentic system are contextually related, logging and evaluating individual LLM calls doesn’t tell the whole…

    Read

    Major Releases: Auto-Optimize Multi-Step Agents, Annotate & Score Entire Chatbot Convos
  • Caroline Borders

    June 6, 2025
    LLMOps, Product

    Release Highlights: Discover Opik Agent Optimizer, Guardrails, & New Integrations

    As LLMs power more complex, multi-step agentic systems, the need for precise optimization and control is growing. In case you…

    Read

    Release Highlights: Discover Opik Agent Optimizer, Guardrails, & New Integrations
  • Team Comet

    May 23, 2025
    LLMOps, Product

    Announcing Opik’s Guardrails Beta: Moderate LLM Applications in Real-Time

    We’ve spent the past year building tools that make LLM applications more transparent, measurable, and accountable. Since launching Opik, our…

    Read

    Announcing Opik’s Guardrails Beta: Moderate LLM Applications in Real-Time
  • Vincent Koc

    May 21, 2025
    LLMOps, Product

    From Observability to Optimization: Announcing the Opik Agent Optimizer Public Beta

    At Comet, we’re driven by a commitment to advance innovation in AI, particularly in the realm of LLM observability. Our…

    Read

    From Observability to Optimization: Announcing the Opik Agent Optimizer Public Beta
  • Caroline Borders

    April 24, 2025
    Integrations, LLMOps, Product

    Major Releases: MCP Server & Google Agent Dev Kit Support

    We’ve just rolled out two major updates in Opik, Comet’s open-source LLM evaluation platform, that make it easier than ever…

    Read

    Major Releases: MCP Server & Google Agent Dev Kit Support
  • Caroline Borders

    March 10, 2025
    Product

    Major Releases: TypeScript for LLM Evals, Total Fidelity ML Metrics, & More

    Spring is in the air, and we’re excited to bring you four fresh releases in the Comet platform to make…

    Read

    Major Releases: TypeScript for LLM Evals, Total Fidelity ML Metrics, & More
  • Andrés Cruz

    January 29, 2025
    LLMOps, Product

    Building Opik: A Scalable Open-Source LLM Observability Platform

    Opik is an open-source platform for evaluating, testing, and monitoring LLM applications, created by Comet. When teams integrate language models…

    Read

    Building Opik: A Scalable Open-Source LLM Observability Platform
  • Abby Morgan

    January 28, 2025
    Comet Community Hub, LLMOps, Machine Learning, Product, Tutorials

    G-Eval for LLM Evaluation

    LLM-as-a-judge evaluators have gained widespread adoption due to their flexibility, scalability, and close alignment with human judgment. They excel at…

    Read

    G-Eval for LLM Evaluation
  • Caroline Borders

    January 27, 2025
    LLMOps, Product

    Comet Product Releases January 2025

    As 2025 picks up steam, we’re thrilled to bring you some exciting product updates from Comet! This month, we’ve added…

    Read

    Comet Product Releases January 2025
  • Caroline Borders

    December 18, 2024
    Product

    Comet Product Releases December 2024

    Each layer of visibility into your training and debugging workflows builds confidence that your models will work reliably in production.…

    Read

    Comet Product Releases December 2024
1 2 3 … 10
→

Get started today for free.

Trusted by Thousands of Data Scientists

Create Free Account
Contact Sales
Comet logo
  • LinkedIn
  • X
  • YouTube
  • Facebook

Subscribe to Comet

Thank you for subscribing to Comet’s newsletter!

Products

  • Opik
  • Experiment Management
  • Artifacts
  • Model Registry
  • Model Production Monitoring

Learn

  • Documentation
  • Resources
  • Comet Blog
  • Deep Learning Weekly
  • Heartbeat
  • LLM Course

Company

  • About Us
  • News and Events
  • Careers
  • Contact Us

Pricing

  • Pricing
  • Create a Free Account
  • Contact Sales
Capterra badge
AICPA badge

©2025 Comet ML, Inc. – All Rights Reserved

Terms of Service

Privacy Policy

CCPA Privacy Notice

Cookie Settings

We use cookies to collect statistical usage information about our website and its visitors and ensure we give you the best experience on our website. Please refer to our Privacy Policy to learn more.OkPrivacy policy