{"id":2683,"date":"2022-02-25T14:45:12","date_gmt":"2022-02-25T22:45:12","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/"},"modified":"2022-02-25T14:45:12","modified_gmt":"2022-02-25T22:45:12","slug":"comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/","title":{"rendered":"7 Simple Steps to Standardizing the ML Experiment (Feb. 23)"},"content":{"rendered":"\n<p>Welcome to another recap of the Comet ML Office Hours, powered by <a href=\"https:\/\/theartistsofdatascience.fireside.fm\/\">The Artists of Data Science<\/a>! This week we&#8217;re covering Session 8 of our new series. This session took place Feb. 23rd, 2022 and we were joined by Dr. Doug Blank, Jacques Verre, Dhruv Nair and Michael Cullan, all of Comet. This was the final session in our Standardizing the Experiment series and we&#8217;ll be back in March with Deep Learning for Structured Data.<\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<p>As a reminder, we\u2019d love to see any and all of you at these fifty minute sessions. Keep an eye on our social media handles for how to sign up for the next series. As always, there&#8217;s a lot more in the full session (which you can <a href=\"https:\/\/youtu.be\/AAScd3pZBs4\">find on our YouTube channel<\/a>), so be sure to check it out, alongside clips from roundtables, webinars, and previous Office Hours.<\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">The Last Mile &#8211; Deployment<\/h2>\n\n\n\n<p>As this was the last week in our eight-part series, it was fitting that we focused on the final step of the machine learning lifecycle&#8211;deployment. Of course, we know that the machine learning lifecycle is more a circle than a straight line, but to build on a model you need to see how it works in production.<\/p>\n\n\n\n<p>To kick things off, host Harpreet Sahota asked the panelists what the differences were between ML deployment and more traditional software deployment. Hear what Head of Product Jacques Verre had to say in the clip below.<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Office Hours: Software Deployment vs. ML Model Deployment\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/ZXhMO__H7u0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Small Teams = Big Change<\/h2>\n\n\n\n<p>There are always challenges when working with machine learning for a business objective, especially when you&#8217;re on a small team or tasked with creating projects solo.<\/p>\n\n\n\n<p>Most of the panelists have worked on small teams before, but they all agreed that small teams could make big impacts in the company as a whole. Jacques gave some tips on how small data science and machine learning teams could have the biggest impact in large scale companies.<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Office Hours: How Small Teams Can Have Organizational Impact\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/0FqgLtv7NjQ?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Failing Silently<\/h2>\n\n\n\n<p>Because the iterative nature of ML doesn&#8217;t end after a model is deployed, the group talked about the importance of monitoring models in production. Along with a discussion of Comet&#8217;s <a href=\"https:\/\/www.comet.com\/site\/comet-mpm\/\">Model Production Monitoring<\/a> tool, Dhruv Nair mentioned the irritating habit of ML models failing silently.<\/p>\n\n\n\n<p>This silent failing can mean that you&#8217;re not alerted until things go drastically wrong. But there are solutions. Learn more in the clip below.<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Office Hours: ML Systems Fail Silently\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/vxcUUmkiC20?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Resources<\/h2>\n\n\n\n<p>As always, there&#8217;s more to be discussed and discovered. Check out Comet&#8217;s contributor-led publication <a href=\"https:\/\/heartbeat.comet.ml\/\">Heartbeat<\/a> as well as our YouTube, Twitter, and LinkedIn for more great information.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/heartbeat.comet.ml\/comet-office-hours-bookshelf-a463abdf4a5e\">Comet Office Hours Bookshelf<\/a><\/li>\n<li>Office Hours <a href=\"https:\/\/www.youtube.com\/playlist?list=PLX9GmL8cVn_wkVp7g942xiHrKrT_zVpLU\">YouTube Playlist<\/a><\/li>\n<li>Follow Comet ML on <a href=\"http:\/\/twitter.com\/Cometml\">Twitter<\/a><\/li>\n<li>Connect with Comet on <a href=\"https:\/\/www.linkedin.com\/company\/comet-ml\">LinkedIn<\/a><\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Curious to Learn More? Join Us!<\/h2>\n\n\n\n<p>We run these virtual Office Hours every Wednesday, now at 3pm EST (New York, NY). Completely free to attend and participate, we&#8217;d love to see any and all of you there! We&#8217;ve got a great series planned and welcome questions for Harpreet or any of our guests via email to emilie@comet.ml.<\/p>\n\n\n\n<p>Keep an eye out for the registration link to our next series coming soon!<\/p>\n\n\n\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Notes from the eight session of a brand new Office Hours series: Seven Simple Steps to Standardizing the Experiment with guests Dr. Doug Blank, Jacques Verre, Dhruv Nair and Michael Cullan.<\/p>\n","protected":false},"author":112,"featured_media":2671,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","footnotes":""},"categories":[13],"tags":[],"coauthors":[131],"class_list":["post-2683","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-office-hours"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>7 Simple Steps to Standardizing the ML Experiment (Feb. 23) - Comet<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"7 Simple Steps to Standardizing the ML Experiment (Feb. 23)\" \/>\n<meta property=\"og:description\" content=\"Notes from the eight session of a brand new Office Hours series: Seven Simple Steps to Standardizing the Experiment with guests Dr. Doug Blank, Jacques Verre, Dhruv Nair and Michael Cullan.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2022-02-25T22:45:12+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Claire Pena\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Claire Pena\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"7 Simple Steps to Standardizing the ML Experiment (Feb. 23) - Comet","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/","og_locale":"en_US","og_type":"article","og_title":"7 Simple Steps to Standardizing the ML Experiment (Feb. 23)","og_description":"Notes from the eight session of a brand new Office Hours series: Seven Simple Steps to Standardizing the Experiment with guests Dr. Doug Blank, Jacques Verre, Dhruv Nair and Michael Cullan.","og_url":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2022-02-25T22:45:12+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","type":"image\/jpeg"}],"author":"Claire Pena","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Claire Pena","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/#article","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/"},"author":{"name":"Claire Pena","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/b73b3ffc304cf8bec8866340329c5e89"},"headline":"7 Simple Steps to Standardizing the ML Experiment (Feb. 23)","datePublished":"2022-02-25T22:45:12+00:00","mainEntityOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/"},"wordCount":544,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","articleSection":["Office Hours"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/","url":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/","name":"7 Simple Steps to Standardizing the ML Experiment (Feb. 23) - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/#primaryimage"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","datePublished":"2022-02-25T22:45:12+00:00","breadcrumb":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/#primaryimage","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","width":1200,"height":628,"caption":"Machine Learing Process Hosted by Harpreet Sahota"},{"@type":"BreadcrumbList","@id":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-23-22\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"7 Simple Steps to Standardizing the ML Experiment (Feb. 23)"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/b73b3ffc304cf8bec8866340329c5e89","name":"Claire Pena","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/6c42de20d82274b5bcc55f12d2480401","url":"https:\/\/secure.gravatar.com\/avatar\/0158b496f72fba29753917da405441fa923b21dec99134ee8818143fc4113fe4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0158b496f72fba29753917da405441fa923b21dec99134ee8818143fc4113fe4?s=96&d=mm&r=g","caption":"Claire Pena"},"url":"https:\/\/www.comet.com\/site\/blog\/author\/clairep\/"}]}},"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2683","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/112"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=2683"}],"version-history":[{"count":0,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2683\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media\/2671"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=2683"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=2683"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=2683"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=2683"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}