{"id":2672,"date":"2022-01-20T19:02:55","date_gmt":"2022-01-21T03:02:55","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/"},"modified":"2022-01-20T19:02:55","modified_gmt":"2022-01-21T03:02:55","slug":"comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/","title":{"rendered":"7 Simple Steps to Standardizing the ML Experiment (Jan. 19)"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Welcome to another recap of the Comet ML Office Hours, powered by <a href=\"https:\/\/theartistsofdatascience.fireside.fm\/\">The Artists of Data Science<\/a>! This week we&#8217;re covering Session 3 of our new series. This session took place Jan. 19th, 2022 and we were joined by researcher and professor Dr. Angelica Lo Duca.<\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<p class=\"wp-block-paragraph\">As a reminder, we\u2019d love to see any and all of you at these fifty minute sessions\u2014so feel free to <a href=\"https:\/\/comet-ml.zoom.us\/meeting\/register\/tZItf-urrzMoE9N-HWSIK68qfI1eDB_jlUeN\">register for upcoming Office Hours sessions here<\/a>! As always, there&#8217;s a lot more in the full session (which you can <a href=\"https:\/\/youtu.be\/AAScd3pZBs4\">find on our YouTube channel<\/a>), so be sure to check it out, alongside clips from roundtables, webinars, and previous Office Hours.<\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Defining The Baseline<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The way to tell if you&#8217;ve created a good experiment is by using baselines. Baselines tell you if your model is performing accurately and how much improvement you&#8217;re brining to the problem with your ML model.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A good baseline is three things: Simple, fast, and repeatable. Learn more in the clip below:<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Office Hours: What Makes a Good Baseline?\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/BkjfY--1FK0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">The Most Important Thing? Tracking!<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Our special guest Dr. Angelica Lo Duca has written a number of articles on workflow and highlights the importance of a standardized workflow and consistently tracked data. Just as we discussed last week, logging each and every step is the difference in creating a reproducible (and therefore standardized) experiment.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Reproducibility was one thing that drew Dr. Lo Duca to Comet. Check out the clip below to hear her reasoning.<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Office Hours: Why Dr. Angelica Lo Duca Uses Comet\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/pGvXV_ql_JU?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Experimentation and Community<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Throughout the discussion Harpreet and Angelica mentioned experimentation: Asking questions, iterating on models, trying out new tools and techniques. Constantly experimenting and playing is what makes models (and people) successful. Try different models, try different algorithms, investigate!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;We are a community,&#8221; Dr. Lo Duca explained, and communities share their knowledge. Though different people have different focuses, such as data journalism for her, it is important to learn from each other and constantly be evolving your practice and yourself.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This learning process can be difficult but both Harpreet and Angelica highlighted the importance of taking your time and taking breaks when studying. Hear more of their tips in the clip below.<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Office Hours: Tips on Learning Machine Learning and Data Science\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/JcXw7bz0Znk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Resources<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Make sure to read Angelica&#8217;s articles on <a href=\"https:\/\/heartbeat.comet.ml\/empowering-comet-with-gitlab-3455f1f54f5d\">Heartbeat<\/a> and other <a href=\"https:\/\/alod83.medium.com\/\">Medium publications<\/a>. The work of <a href=\"https:\/\/www.coursera.org\/instructor\/andrewng\">Andrew Ng<\/a>, <a href=\"https:\/\/machinelearningmastery.com\/\">Jason Brownlee<\/a>, <a href=\"https:\/\/www.amazon.com\/gp\/product\/B0842ZD3Y7\/ref=dbs_a_def_rwt_bibl_vppi_i0\">Emmanuel Ameisen<\/a>, and <a href=\"https:\/\/www.amazon.com\/Introduction-Data-Visualization-Storytelling-Scientist\/dp\/1085827836\/ref=sr_1_1?crid=2U8179FZTH8G8&amp;keywords=Jose+Berengueres+introduction+to+data+visualization&amp;qid=1642696061&amp;sprefix=jose+berengueres+introduction+to+data+visualiz%2Caps%2C148&amp;sr=8-1\">Jose Berengueres<\/a> was also mentioned.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As always, there&#8217;s more to be discussed and discovered. Check out Comet&#8217;s contributor-led publication <a href=\"https:\/\/heartbeat.comet.ml\/\">Heartbeat<\/a> as well as our YouTube, Twitter, and LinkedIn for more great information.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/heartbeat.comet.ml\/comet-office-hours-bookshelf-a463abdf4a5e\">Comet Office Hours Bookshelf<\/a><\/li>\n<li>Office Hours <a href=\"https:\/\/www.youtube.com\/playlist?list=PLX9GmL8cVn_wkVp7g942xiHrKrT_zVpLU\">YouTube Playlist<\/a><\/li>\n<li>Follow Comet ML on <a href=\"http:\/\/twitter.com\/Cometml\">Twitter<\/a><\/li>\n<li>Connect with Comet on <a href=\"https:\/\/www.linkedin.com\/company\/comet-ml\">LinkedIn<\/a><\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Curious to Learn more? Join Us!<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">We run these virtual Office Hours every Wednesday at 11am EST (New York, NY). Completely free to attend and participate, and we&#8217;d love to see any and all of you there! We&#8217;ve got a great series planned and welcome questions for Harpreet or any of our guests via email to emilie@comet.ml.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But most importantly:<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><a href=\"http:\/\/bit.ly\/comet-ml-oh\">Register for Comet Office Hours<\/a><\/h3>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<p class=\"wp-block-paragraph\">&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Notes from the third session of a brand new Office Hours series: Seven Simple Steps to Standardizing the Experiment discussing baselines with special guest Dr. Angelica Lo Duca.<\/p>\n","protected":false},"author":112,"featured_media":2671,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[13],"tags":[],"coauthors":[131],"class_list":["post-2672","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-office-hours"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>7 Simple Steps to Standardizing the ML Experiment (Jan. 19) - Comet<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"7 Simple Steps to Standardizing the ML Experiment (Jan. 19)\" \/>\n<meta property=\"og:description\" content=\"Notes from the third session of a brand new Office Hours series: Seven Simple Steps to Standardizing the Experiment discussing baselines with special guest Dr. Angelica Lo Duca.\" \/>\n<meta property=\"og:url\" content=\"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2022-01-21T03:02:55+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Claire Pena\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Claire Pena\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"7 Simple Steps to Standardizing the ML Experiment (Jan. 19) - Comet","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/","og_locale":"en_US","og_type":"article","og_title":"7 Simple Steps to Standardizing the ML Experiment (Jan. 19)","og_description":"Notes from the third session of a brand new Office Hours series: Seven Simple Steps to Standardizing the Experiment discussing baselines with special guest Dr. Angelica Lo Duca.","og_url":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2022-01-21T03:02:55+00:00","og_image":[{"width":1200,"height":628,"url":"http:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","type":"image\/jpeg"}],"author":"Claire Pena","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Claire Pena","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/#article","isPartOf":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/"},"author":{"name":"Claire Pena","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/b73b3ffc304cf8bec8866340329c5e89"},"headline":"7 Simple Steps to Standardizing the ML Experiment (Jan. 19)","datePublished":"2022-01-21T03:02:55+00:00","mainEntityOfPage":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/"},"wordCount":524,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","articleSection":["Office Hours"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/","url":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/","name":"7 Simple Steps to Standardizing the ML Experiment (Jan. 19) - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/#primaryimage"},"image":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","datePublished":"2022-01-21T03:02:55+00:00","breadcrumb":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/#primaryimage","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","width":1200,"height":628,"caption":"Machine Learing Process Hosted by Harpreet Sahota"},{"@type":"BreadcrumbList","@id":"http:\/\/www.comet.com\/site\/blog\/comet-office-hoursseven-simple-steps-to-standardizing-the-ml-experiment-1-19-22\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"7 Simple Steps to Standardizing the ML Experiment (Jan. 19)"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/b73b3ffc304cf8bec8866340329c5e89","name":"Claire Pena","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/6c42de20d82274b5bcc55f12d2480401","url":"https:\/\/secure.gravatar.com\/avatar\/0158b496f72fba29753917da405441fa923b21dec99134ee8818143fc4113fe4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0158b496f72fba29753917da405441fa923b21dec99134ee8818143fc4113fe4?s=96&d=mm&r=g","caption":"Claire Pena"},"url":"https:\/\/www.comet.com\/site\/blog\/author\/clairep\/"}]}},"jetpack_featured_media_url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/NoNames_Comet-Office-Hours-LI_TW.jpg","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2672","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/112"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=2672"}],"version-history":[{"count":0,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2672\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media\/2671"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=2672"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=2672"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=2672"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=2672"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}