{"id":2675,"date":"2022-02-10T21:30:44","date_gmt":"2022-02-11T05:30:44","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/"},"modified":"2022-02-10T21:30:44","modified_gmt":"2022-02-11T05:30:44","slug":"comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/","title":{"rendered":"7 Simple Steps to Standardizing the ML Experiment (Feb. 9)"},"content":{"rendered":"\n<p>Welcome to another recap of the Comet ML Office Hours, powered by <a href=\"https:\/\/theartistsofdatascience.fireside.fm\/\">The Artists of Data Science<\/a>! This week we&#8217;re covering Session 6 of our new series. This session took place Feb. 9th, 2022 and we were joined by Dr. Doug Blank from Comet and Tiffany Fabianac of AstraZeneca.<\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<p>As a reminder, we\u2019d love to see any and all of you at these fifty minute sessions\u2014so feel free to <a href=\"https:\/\/comet-ml.zoom.us\/meeting\/register\/tZItf-urrzMoE9N-HWSIK68qfI1eDB_jlUeN\">register for upcoming Office Hours sessions here<\/a>! As always, there&#8217;s a lot more in the full session (which you can <a href=\"https:\/\/youtu.be\/AAScd3pZBs4\">find on our YouTube channel<\/a>), so be sure to check it out, alongside clips from roundtables, webinars, and previous Office Hours.<\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Reproducibility, Reproducibility, Reproducibility<\/h2>\n\n\n\n<p>This week we focused on how experiment management helps you iterate, build, and deploy models faster. The key takeaway from this week&#8217;s panel was reproducibility. Knowing the exact hyperparameters, tracking each change, and generally building reproducibility into your standard practice is vital.<\/p>\n\n\n\n<p>When asked about building reproducibility, both panelists suggested melding it into the culture of the company or workflow. Doug suggested focusing on protecting against irreproducibility as true reproducibility is a myth. Hear more in the clips below:<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Office Hours: Reproducibility as a Culture\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/GmktfQ0-8W0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p>\n\n<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Office Hours: Dr. Doug Blank on Reproducibility After Deployment\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/CY-63eGZeOg?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\">\n<div class=\"wp-block-embed__wrapper\">\u00a0<\/div>\n<\/figure>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Understanding the Model<\/h2>\n\n\n\n<p>Tiffany also suggested that rather than focusing on just being able to copy an experiment, practitioners should focus on maintaining their understanding of the model and the problems that it solves. As data will change and models will adjust, keeping the end-goal in mind can be a means of creating an iterative machine learning lifecycle.<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Office Hours: Tiffany Fabianac on Understanding Your Model\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/dJ_X4vN6SPE?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Rogue Robots<\/h2>\n\n\n\n<p>As an example of how impossible it is to prepare for all outcomes, Doug told a story from his time teaching developmental robotics. The robot, which didn&#8217;t have memory, was supposed to travel down a hall and turn based on the color of the light.<\/p>\n\n\n\n<p>What happened was a memory-less robot teaching itself on the job! Hear the full story in the clip below:<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Office Hours: Experimental Protocols in Developmental Robotics\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/zcaUpZNI7xk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Resources<\/h2>\n\n\n\n<p>During the session, Doug mentioned the book <a href=\"https:\/\/www.amazon.com\/Thinking-Outside-Brain-Annie-Murphy\/dp\/0544947665\/ref=asc_df_0544947665\/?tag=hyprod-20&amp;linkCode=df0&amp;hvadid=509199198673&amp;hvpos=&amp;hvnetw=g&amp;hvrand=4254287053367691345&amp;hvpone=&amp;hvptwo=&amp;hvqmt=&amp;hvdev=c&amp;hvdvcmdl=&amp;hvlocint=&amp;hvlocphy=9002061&amp;hvtargid=pla-978445372927&amp;psc=1\"><em>The Extended Mind<\/em><\/a> by Annie Murphy Paul.<\/p>\n\n\n\n<p>As always, there&#8217;s more to be discussed and discovered. Check out Comet&#8217;s contributor-led publication <a href=\"https:\/\/heartbeat.comet.ml\/\">Heartbeat<\/a> as well as our YouTube, Twitter, and LinkedIn for more great information.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/heartbeat.comet.ml\/comet-office-hours-bookshelf-a463abdf4a5e\">Comet Office Hours Bookshelf<\/a><\/li>\n<li>Office Hours <a href=\"https:\/\/www.youtube.com\/playlist?list=PLX9GmL8cVn_wkVp7g942xiHrKrT_zVpLU\">YouTube Playlist<\/a><\/li>\n<li>Follow Comet ML on <a href=\"http:\/\/twitter.com\/Cometml\">Twitter<\/a><\/li>\n<li>Connect with Comet on <a href=\"https:\/\/www.linkedin.com\/company\/comet-ml\">LinkedIn<\/a><\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Curious to Learn more? Join Us!<\/h2>\n\n\n\n<p>We run these virtual Office Hours every Wednesday at 11am EST (New York, NY). Completely free to attend and participate, and we&#8217;d love to see any and all of you there! We&#8217;ve got a great series planned and welcome questions for Harpreet or any of our guests via email to emilie@comet.ml.<\/p>\n\n\n\n<p>But most importantly:<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><a href=\"http:\/\/bit.ly\/comet-ml-oh\">Register for Comet Office Hours<\/a><\/h3>\n\n\n\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Notes from the sixth session of a brand new Office Hours series: Seven Simple Steps to Standardizing the Experiment discussing data with guests Tiffany Fabianac and Dr. Doug Blank.<\/p>\n","protected":false},"author":112,"featured_media":2671,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[13],"tags":[],"coauthors":[131],"class_list":["post-2675","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-office-hours"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>7 Simple Steps to Standardizing the ML Experiment (Feb. 9) - Comet<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"7 Simple Steps to Standardizing the ML Experiment (Feb. 9)\" \/>\n<meta property=\"og:description\" content=\"Notes from the sixth session of a brand new Office Hours series: Seven Simple Steps to Standardizing the Experiment discussing data with guests Tiffany Fabianac and Dr. Doug Blank.\" \/>\n<meta property=\"og:url\" content=\"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2022-02-11T05:30:44+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Claire Pena\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Claire Pena\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"7 Simple Steps to Standardizing the ML Experiment (Feb. 9) - Comet","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/","og_locale":"en_US","og_type":"article","og_title":"7 Simple Steps to Standardizing the ML Experiment (Feb. 9)","og_description":"Notes from the sixth session of a brand new Office Hours series: Seven Simple Steps to Standardizing the Experiment discussing data with guests Tiffany Fabianac and Dr. Doug Blank.","og_url":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2022-02-11T05:30:44+00:00","og_image":[{"width":1200,"height":628,"url":"http:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","type":"image\/jpeg"}],"author":"Claire Pena","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Claire Pena","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/#article","isPartOf":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/"},"author":{"name":"Claire Pena","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/b73b3ffc304cf8bec8866340329c5e89"},"headline":"7 Simple Steps to Standardizing the ML Experiment (Feb. 9)","datePublished":"2022-02-11T05:30:44+00:00","mainEntityOfPage":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/"},"wordCount":483,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","articleSection":["Office Hours"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/","url":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/","name":"7 Simple Steps to Standardizing the ML Experiment (Feb. 9) - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/#primaryimage"},"image":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","datePublished":"2022-02-11T05:30:44+00:00","breadcrumb":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/#primaryimage","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","width":1200,"height":628,"caption":"Machine Learing Process Hosted by Harpreet Sahota"},{"@type":"BreadcrumbList","@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment2-9-22\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"7 Simple Steps to Standardizing the ML Experiment (Feb. 9)"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/b73b3ffc304cf8bec8866340329c5e89","name":"Claire Pena","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/6c42de20d82274b5bcc55f12d2480401","url":"https:\/\/secure.gravatar.com\/avatar\/0158b496f72fba29753917da405441fa923b21dec99134ee8818143fc4113fe4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0158b496f72fba29753917da405441fa923b21dec99134ee8818143fc4113fe4?s=96&d=mm&r=g","caption":"Claire Pena"},"url":"https:\/\/www.comet.com\/site\/blog\/author\/clairep\/"}]}},"jetpack_featured_media_url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2675","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/112"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=2675"}],"version-history":[{"count":0,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2675\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media\/2671"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=2675"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=2675"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=2675"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=2675"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}