{"id":2385,"date":"2021-07-27T15:31:08","date_gmt":"2021-07-27T23:31:08","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/blog\/announcing-comet-artifacts\/"},"modified":"2021-07-27T15:31:08","modified_gmt":"2021-07-27T23:31:08","slug":"announcing-comet-artifacts","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/","title":{"rendered":"Announcing Comet Artifacts"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Introducing Comet Artifacts<\/h2>\n\n\n\n<p><a href=\"https:\/\/www.comet.com\/site\/artifacts\/?utm_campaign=artifacts-launch&amp;utm_source=blog&amp;utm_medium=intro\">Comet Artifacts<\/a> is a new set of tools that provides ML teams a convenient way to log, version, and browse data from all parts of their experimentation pipelines.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Why Artifacts?<\/h2>\n\n\n\n<p>Machine learning typically involves experimenting with different models, hyperparameters and different versions of datasets.<\/p>\n\n\n\n<p>In addition to the metrics and parameters that are being measured and tested, machine learning also involves keeping track of the inputs and outputs produced by an experiment. An experiment run can produce all sorts of interesting output data. These data artifacts can be files containing model predictions, model weights, and much more.\u00a0<\/p>\n\n\n\n<p>Often, the outputs from one experiment can be used as the inputs for other experiments\u2014this can become complex to track without the right structure or a single source of truth.<\/p>\n\n\n\n<p>We built Comet Artifacts to solve these specific challenges.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What Are Artifacts?<\/h2>\n\n\n\n<p>An Artifact is a versioned object, where each version is an immutable snapshot of files &amp; assets, arranged in a folder-like logical structure. This snapshot can be tracked using metadata, a version number, tags, and aliases. A version tracks which experiments consumed it, and which experiment produced it.\u00a0<\/p>\n\n\n\n<p>This means that with Artifacts, you can structure your experiments as multi-stage pipelines or DAGs (Directed Acyclic Graphs), and ensure centralized, managed and versioned access to any of the intermediate data produced in the process.\u00a0<\/p>\n\n\n\n<p>Specifically, Artifacts enable you and your team to:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Reuse data produced by intermediate or exploratory steps in experimentation pipelines, and allow it to be tracked, versioned, consumed, and analyzed in a managed way.\u00a0<\/li>\n<li>Track and reproduce complex multi-experiment scenarios, where the output of one model would be used in the input of another experiment.<\/li>\n<li>Iterate on datasets over time, track which model used which version of the dataset, and schedule model re-training.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Getting Started with Artifacts<\/h2>\n\n\n\n<p>It takes only 3 lines of code to register an Artifact of any size in Comet:<\/p>\n\n\n\n<p>&nbsp;<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">artifact = Artifact(\"artifact-name\", \"dataset\")\nartifact.add(\"path\/to\/my\/file.csv\")\nexperiment.log_artifact(artifact)<\/pre>\n\n\n\n<p>And then just 2 lines of code to download and use a logged Artifact in an Experiment:<\/p>\n\n\n\n<p>&nbsp;<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">logged_artifact = experiment.get_artifact(\"artifact-name\")\nlocal_artifact = logged_artifact.download()<\/pre>\n\n\n\n<h2 class=\"wp-block-heading\">Additional Resources<\/h2>\n\n\n\n<p>For a deeper dive into working with Artifacts checkout these additional resources:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.comet.com\/site\/debugging-your-machine-learning-models-with-comet-artifacts\/?utm_camapign=artifacts-launch&amp;utm_source=blog&amp;utm_medium=additional-resources\">An end-to-end tutorial<\/a><\/li>\n<li><a href=\"https:\/\/colab.research.google.com\/drive\/1QlKPgqPtaayrQd4usouh03QN5d7Iy3mf?usp=sharing\">A Colab Notebook <\/a><\/li>\n<li><a href=\"https:\/\/www.comet.com\/docs\/python-sdk\/artifacts-overview\/?utm_campaign=artifacts-announcement&amp;utm_source=addtl-resources&amp;utm_medium=blog\">Technical documentation and reference<\/a><\/li>\n<\/ul>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\"><em>Want to stay in the loop?\u00a0<a href=\"https:\/\/info.comet.ml\/newsletter-signup\/?utm_campaign=artifacts-launch&amp;utm_source=blog&amp;utm_medium=CTA\">Subscribe to the Comet Newsletter<\/a>\u00a0for weekly insights and perspective on the latest ML news, projects, and more.<\/em><\/h2>\n","protected":false},"excerpt":{"rendered":"<p>Comet Artifacts is a new set of tools that  provides ML teams a convenient way to log, version, and browse data from all parts of their experimentation pipelines.<\/p>\n","protected":false},"author":1,"featured_media":2386,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","footnotes":""},"categories":[8,9],"tags":[],"coauthors":[124],"class_list":["post-2385","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-comet-community-hub","category-product"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Announcing Comet Artifacts - Comet<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Announcing Comet Artifacts\" \/>\n<meta property=\"og:description\" content=\"Comet Artifacts is a new set of tools that provides ML teams a convenient way to log, version, and browse data from all parts of their experimentation pipelines.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2021-07-27T23:31:08+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Artifacts-banner-2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Team Comet\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Team Comet\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Announcing Comet Artifacts - Comet","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/","og_locale":"en_US","og_type":"article","og_title":"Announcing Comet Artifacts","og_description":"Comet Artifacts is a new set of tools that provides ML teams a convenient way to log, version, and browse data from all parts of their experimentation pipelines.","og_url":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2021-07-27T23:31:08+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Artifacts-banner-2.png","type":"image\/png"}],"author":"Team Comet","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Team Comet","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/#article","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/"},"author":{"name":"engineering@atre.net","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/550ac35e8e821db8064c5bd1f0a04e6b"},"headline":"Announcing Comet Artifacts","datePublished":"2021-07-27T23:31:08+00:00","mainEntityOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/"},"wordCount":386,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Artifacts-banner-2.png","articleSection":["Comet Community Hub","Product"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/","url":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/","name":"Announcing Comet Artifacts - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/#primaryimage"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Artifacts-banner-2.png","datePublished":"2021-07-27T23:31:08+00:00","breadcrumb":{"@id":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/#primaryimage","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Artifacts-banner-2.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Artifacts-banner-2.png","width":1200,"height":628,"caption":"Artifacts Banner"},{"@type":"BreadcrumbList","@id":"https:\/\/www.comet.com\/site\/blog\/announcing-comet-artifacts\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"Announcing Comet Artifacts"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/550ac35e8e821db8064c5bd1f0a04e6b","name":"engineering@atre.net","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/027c18177377edf459980f0cfb83706c","url":"https:\/\/secure.gravatar.com\/avatar\/d002a459a297e0d1779329318029aee19868c312b3e1f3c9ec9b3e3add2740de?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d002a459a297e0d1779329318029aee19868c312b3e1f3c9ec9b3e3add2740de?s=96&d=mm&r=g","caption":"engineering@atre.net"},"sameAs":["https:\/\/live-cometml.pantheonsite.io"],"url":"https:\/\/www.comet.com\/site\/blog\/author\/engineeringatre-net\/"}]}},"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2385","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=2385"}],"version-history":[{"count":0,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2385\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media\/2386"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=2385"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=2385"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=2385"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=2385"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}