{"id":12597,"date":"2025-01-27T16:50:53","date_gmt":"2025-01-28T00:50:53","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/?p=12597"},"modified":"2026-01-14T18:58:47","modified_gmt":"2026-01-14T18:58:47","slug":"new-features-january-2025","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/","title":{"rendered":"Comet Product Releases January 2025"},"content":{"rendered":"\n<p>As 2025 picks up steam, we\u2019re thrilled to bring you some exciting product updates from Comet! This month, we\u2019ve added new features to make your machine learning and LLM development workflows more efficient and effective. From new scoring and experimentation features in Opik, our open-source <a href=\"https:\/\/www.comet.com\/site\/blog\/llm-observability\/\">LLM observability<\/a> platform, to enhancements in Comet\u2019s suite of ML Experiment Management tools, you&#8217;ll find a set of releases designed to help get great results out of your models faster.<\/p>\n\n\n\n<p>Within Opik, we\u2019ve released Online Evaluation, which gives you the ability to score traces automatically in production for hallucinations, answer relevance, or any other task-specific metric. You can also save time testing and iterating with Opik\u2019s new Prompt Playground, a space to run and compare different LLM prompts directly within the UI. ML Experiment Management now features Autogenerated Panels, for faster and easier visualization of your logged metrics.<\/p>\n\n\n\n<p>Read on for details on how these releases simplify your ML &amp; LLM workflows, and <a href=\"\/login\">log into the platform<\/a> to give them a try.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-opik-online-llm-evaluation\">Opik: Online LLM Evaluation<\/h2>\n\n\n\n<figure class=\"wp-block-image aligncenter\"><img loading=\"lazy\" decoding=\"async\" width=\"1920\" height=\"1080\" src=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/online_evaluation-1b8bb48103ca233121102cce02ea363a.gif\" alt=\"\" class=\"wp-image-12599\"\/><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>When working with LLMs in production, the sheer number of traces means it is impossible to review each trace manually. Our new <a href=\"https:\/\/www.comet.com\/docs\/opik\/production\/rules\/\">Online Evaluation<\/a> feature within Opik allows you to define <a href=\"https:\/\/www.comet.com\/site\/blog\/llm-as-a-judge\/\">LLM-as-a-judge<\/a> metrics that automatically score the LLM calls logged to the platform. By defining LLM-as-a-judge metrics that run on all your production traces, you can automate the monitoring of your LLM calls for hallucinations, answer relevance, or any other task-specific metric.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-opik-llm-prompt-playground\">Opik: LLM Prompt Playground<\/h2>\n\n\n\n<figure class=\"wp-block-image aligncenter\"><img loading=\"lazy\" decoding=\"async\" width=\"1920\" height=\"1080\" src=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/Jacquess-video-6.gif\" alt=\"\" class=\"wp-image-12600\"\/><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>Opik\u2019s new <a href=\"https:\/\/www.comet.com\/docs\/opik\/prompt_engineering\/playground\">Prompt Playground<\/a> lets you interact with OpenAI models directly within the UI, so you can spend less time writing code to test new prompts and more time comparing results and iterating. All of your prompts run in the playground and appear in the playground tracing project.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-ml-experiment-management-autogenerated-panels\">ML Experiment Management: Autogenerated Panels<\/h2>\n\n\n\n<p>You can now view autogenerated panels within Experiment Management. For every metric you log, there will now be a panel created within your personal view. There\u2019s no need to manually add your panels, making it a breeze to visualize the model training metrics you log.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-new-opik-integrations\">New Opik Integrations<\/h2>\n\n\n\n<p>Opik is designed to enhance your existing LLM development workflows, so you can get improve insights and results without rebuilding your tech stack. Our <a href=\"https:\/\/www.comet.com\/docs\/opik\/tracing\/integrations\/overview\">list of supported integrations<\/a> is always growing, with Haystack and Dify as recent additions.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-haystack\">Haystack<\/h3>\n\n\n\n<p>Opik now integrates directly with <a href=\"https:\/\/www.comet.com\/docs\/opik\/tracing\/integrations\/haystack\/\">Haystack<\/a>, meaning all chains or agents defined using Haystack can be logged to Opik. Haystack is a Python framework for creating agents, and the addition of Opik greatly increases visibility into what you are building.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-dify\">Dify<\/h3>\n\n\n\n<p><a href=\"https:\/\/www.comet.com\/docs\/opik\/tracing\/integrations\/dify\">Dify<\/a> is a popular no-code platform for building LLM-powered apps and chatbots. Dify users can now leverage Opik to track and analyze interactions with their apps, with better insights into app performance. Opik goes above and beyond Dify\u2019s native tracking and monitoring capabilities with features like trace annotation and log evaluation, so you can iterate more effectively.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-how-to-upgrade\">How to Upgrade<\/h2>\n\n\n\n<p>If you are using www.comet.com, no action is required! You have access to these features and can use them immediately.<\/p>\n\n\n\n<p>If you are using a self-hosted version of Comet, before you upgrade please verify which version of Comet you are running.<\/p>\n\n\n\n<p><strong>Comet Versions January 2025<\/strong><\/p>\n\n\n\n<p>Frontend version: 5.90.15<br>\nBackend version: 3.53.251<br>\nOptimizer version: 2.1.4<br>\nSDK version: 3.47.6<\/p>\n\n\n\n<p>To check your frontend version: Click your username in the top-right corner of the Comet application and check the Version at the bottom of the pop-up.<\/p>\n\n\n\n<p>To check your backend version: Visit. &lt;your_comet_url&gt;.com\/api\/isAlive\/ver<\/p>\n\n\n\n<p>To check your SDK version: In your training environment run the command pip freeze | grep comet_ml<\/p>\n\n\n\n<p>If you would like to upgrade, please contact your Technical Account Manager or Deployment Engineer on the Comet team. You can always reach out directly to Claire Longo (clairel@comet.com) with general questions.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As 2025 picks up steam, we\u2019re thrilled to bring you some exciting product updates from Comet! This month, we\u2019ve added new features to make your machine learning and LLM development workflows more efficient and effective. From new scoring and experimentation features in Opik, our open-source LLM observability platform, to enhancements in Comet\u2019s suite of ML [&hellip;]<\/p>\n","protected":false},"author":140,"featured_media":12601,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","footnotes":""},"categories":[65,9],"tags":[],"coauthors":[127],"class_list":["post-12597","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-llmops","category-product"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Comet Product Releases January 2025<\/title>\n<meta name=\"description\" content=\"Read about our new LLM prompt playground, online LLM evaluations, autogenerated panels, &amp; more!\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Comet Product Releases January 2025\" \/>\n<meta property=\"og:description\" content=\"Read about our new LLM prompt playground, online LLM evaluations, autogenerated panels, &amp; more!\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2025-01-28T00:50:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-01-14T18:58:47+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/online_evaluation-1b8bb48103ca233121102cce02ea363a-1.gif\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"576\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/gif\" \/>\n<meta name=\"author\" content=\"Caroline Borders\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Caroline Borders\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Comet Product Releases January 2025","description":"Read about our new LLM prompt playground, online LLM evaluations, autogenerated panels, & more!","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/","og_locale":"en_US","og_type":"article","og_title":"Comet Product Releases January 2025","og_description":"Read about our new LLM prompt playground, online LLM evaluations, autogenerated panels, & more!","og_url":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2025-01-28T00:50:53+00:00","article_modified_time":"2026-01-14T18:58:47+00:00","og_image":[{"url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/online_evaluation-1b8bb48103ca233121102cce02ea363a-1.gif","width":1024,"height":576,"type":"image\/gif"}],"author":"Caroline Borders","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Caroline Borders","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/#article","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/"},"author":{"name":"Caroline Borders","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/8500e2f020e85676c245e00af46bae3c"},"headline":"Comet Product Releases January 2025","datePublished":"2025-01-28T00:50:53+00:00","dateModified":"2026-01-14T18:58:47+00:00","mainEntityOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/"},"wordCount":646,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/online_evaluation-1b8bb48103ca233121102cce02ea363a-1.gif","articleSection":["LLMOps","Product"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/","url":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/","name":"Comet Product Releases January 2025","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/#primaryimage"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/online_evaluation-1b8bb48103ca233121102cce02ea363a-1.gif","datePublished":"2025-01-28T00:50:53+00:00","dateModified":"2026-01-14T18:58:47+00:00","description":"Read about our new LLM prompt playground, online LLM evaluations, autogenerated panels, & more!","breadcrumb":{"@id":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/#primaryimage","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/online_evaluation-1b8bb48103ca233121102cce02ea363a-1.gif","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/online_evaluation-1b8bb48103ca233121102cce02ea363a-1.gif","width":1920,"height":1080},{"@type":"BreadcrumbList","@id":"https:\/\/www.comet.com\/site\/blog\/new-features-january-2025\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"Comet Product Releases January 2025"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/8500e2f020e85676c245e00af46bae3c","name":"Caroline Borders","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/77bfb2d62bc772cc39672e46e3e8059f","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2024\/12\/cropped-1672334331755-2-96x96.jpeg","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2024\/12\/cropped-1672334331755-2-96x96.jpeg","caption":"Caroline Borders"},"url":"https:\/\/www.comet.com\/site\/blog\/author\/carolineb\/"}]}},"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/12597","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/140"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=12597"}],"version-history":[{"count":2,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/12597\/revisions"}],"predecessor-version":[{"id":18947,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/12597\/revisions\/18947"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media\/12601"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=12597"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=12597"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=12597"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=12597"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}