{"id":2464,"date":"2021-08-03T13:40:53","date_gmt":"2021-08-03T21:40:53","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/"},"modified":"2021-08-03T13:40:53","modified_gmt":"2021-08-03T21:40:53","slug":"comet-industry-qa-collaborative-data-science-and-machine-learning-2","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/","title":{"rendered":"Comet Industry Q&#038;A (Recap): Collaborative Data Science and Machine Learning"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\"><em>A conversation with <a href=\"https:\/\/twitter.com\/abidlabs\">Abubakar Abid<\/a> of <a href=\"https:\/\/gradio.app\/\">Gradio<\/a> and <a href=\"https:\/\/twitter.com\/jakubjurovych\">Jakub Jurovych<\/a> of <a href=\"https:\/\/deepnote.com\/\">Deepnote<\/a><\/em><\/h2>\n\n\n\n<p>As data science and machine learning teams become less siloed, more cross-functional, and increasingly interdisciplinary, the need for sustainable tools and processes for collaboration across the ML model building lifecycle has only increased.<\/p>\n\n\n\n<p>Given this trend\u2014and the fact that one of Comet&#8217;s core values (both internally and with our product stack) is to enable more effective and efficient collaboration\u2014we thought collaboration would be a perfect topic to restart our Industry Q&amp;A series.<\/p>\n\n\n\n<p>Luckily, we were able to host two industry leaders at the forefront of creating tooling for ML collaboration at different points in the development lifecycle\u2014Abubakar Abid of Gradio, and Jakub Jurovych of Deepnote.<\/p>\n\n\n\n<p>While there was plenty of awesome conversation and many compelling insights (we&#8217;ve collected the best, along with the full session, <a href=\"https:\/\/youtube.com\/playlist?list=PLX9GmL8cVn_wQCkhb4ARSFoJ5ZgtuISPF\">in this YouTube playlist)<\/a>, I wanted to take a few moments to recap and share a few of my favorite moments<\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">The stages of collaboration in ML\u2014or in any organization<\/h2>\n\n\n\n<p>To help frame the conversation around collaboration in ML\u2014which admittedly could go in so many different directions, Jakub shared his thoughts about the nature of collaboration more broadly.<\/p>\n\n\n\n<p>Specifically, he discussed his understanding of collaboration as something that, organizationally speaking, happens both in stages and in relative proportions. I really appreciated his use of general writing as a frame through which to explore collaboration&#8217;s basics stages, from creating and tweaking an initial draft in isolation to seeking line edits or deeper peer review.<\/p>\n\n\n\n<p>The same basic concept holds true for collaboration in ML. Much of the modeling work will still need to be done on the individual level\u2014but to capture value from that 20-30% of the work that requires close and efficient collaboration, teams will need to adopt cross-functional tools and approaches to make sure a collaborative approach is able to scale with you as your team grows.<\/p>\n\n\n\n<p>&nbsp;<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Industry Q&amp;A Clip: The stages of collaboration in data science and machine learning (Jakub)\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/8s8aYSuDuLg?list=PLX9GmL8cVn_wQCkhb4ARSFoJ5ZgtuISPF\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Collaborative tools for interdisciplinary teams<\/h2>\n\n\n\n<p>One of the overarching themes of the Q&amp;A was the topic of domain\/subject matter expertise\u2014that is, the importance of building, testing, and deploying models with the support of experts in the field in which your model will exist in the real world (i.e. healthcare, finance, retail, etc).<\/p>\n\n\n\n<p>Abubakar was able to share some really interesting thoughts on this dynamic, especially as it relates to testing whether or not ML models actually work as intended. His primary contention is that we need to change the model validation paradigm\u2014from just measuring accuracy and loss on validation sets, to actually measuring effectiveness by putting models in the hands of domain experts as quickly as possible.<\/p>\n\n\n\n<p>&nbsp;<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Industry Q&amp;A Clip: Collaboration with interdisciplinary teams (Abubakar)\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/1zeerDlAx9I?list=PLX9GmL8cVn_wQCkhb4ARSFoJ5ZgtuISPF\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">The future of collaboration in data science and machine learning<\/h2>\n\n\n\n<p>In addition to discussing the dynamics that led them to building tools for ML collaboration, as well as the current problems they&#8217;re attempting to solve, both Jakub and Abubakar also offered some interesting perspective on what they&#8217;d like to see from collaborative tools and processes moving forward.<\/p>\n\n\n\n<p>Specifically, Jakub discussed how the future of data-focused organizations will likely include data scientists and analysts across different teams and business areas (product, sales, marketing, etc). And Abubakar largely agreed, adding that he hopes to see a future where teams, using intuitive tools for collaboration, can accomplish a whole lot more with just a single data scientist than they previously could with a full team.<\/p>\n\n\n\n<p>&nbsp;<\/p>\n<p><iframe loading=\"lazy\" title=\"Comet Industry Q&amp;A Clip: The future of collaboration in data science and machine learning\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/QuJBKFEQvPM?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">Enjoy the Snippets Above?<\/h2>\n\n\n\n<p>Check out <a href=\"https:\/\/www.youtube.com\/playlist?list=PLX9GmL8cVn_wQCkhb4ARSFoJ5ZgtuISPF\"><strong>our complete playlist on YouTube<\/strong><\/a> for more awesome content from this event, including the full session!<\/p>\n\n\n\n<p>And stay tuned! We&#8217;ll be announcing our August Industry Q&amp;A soon, and we&#8217;d love to see you all there.<\/p>\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n<h2 class=\"wp-block-heading\">One last thing&#8230;<\/h2>\n\n\n\n<p>We recently launched <strong><em><a href=\"https:\/\/www.comet.com\/site\/blog\/?category=comet-newsletter&amp;utm_campaign=office-hours&amp;utm_source=blog&amp;utm_medium=recap\">The Comet Newsletter<\/a><\/em><\/strong>, which offers a weekly inside look at all things data science and ML, featuring expert takes and perspective from our team. We have big things planned for both Office Hours and the newsletter, so be sure to subscribe if you haven&#8217;t already!<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><a href=\"https:\/\/info.comet.ml\/newsletter-signup\/\">Subscribe to the Comet Newsletter<\/a><\/h3>\n\n\n\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A conversation with Abubakar Abid of Gradio and Jakub Jurovych of Deepnote.<\/p>\n","protected":false},"author":1,"featured_media":2465,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","footnotes":""},"categories":[6],"tags":[],"coauthors":[130],"class_list":["post-2464","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-machine-learning"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Comet Industry Q&amp;A (Recap): Collaborative Data Science and Machine Learning - Comet<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Comet Industry Q&amp;A (Recap): Collaborative Data Science and Machine Learning\" \/>\n<meta property=\"og:description\" content=\"A conversation with Abubakar Abid of Gradio and Jakub Jurovych of Deepnote.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2021-08-03T21:40:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/MeetUp-rough-mockup-youtube-card.001.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1920\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Austin Kodra\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Austin Kodra\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Comet Industry Q&A (Recap): Collaborative Data Science and Machine Learning - Comet","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/","og_locale":"en_US","og_type":"article","og_title":"Comet Industry Q&A (Recap): Collaborative Data Science and Machine Learning","og_description":"A conversation with Abubakar Abid of Gradio and Jakub Jurovych of Deepnote.","og_url":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2021-08-03T21:40:53+00:00","og_image":[{"width":1920,"height":1080,"url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/MeetUp-rough-mockup-youtube-card.001.jpeg","type":"image\/jpeg"}],"author":"Austin Kodra","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Austin Kodra","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/#article","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/"},"author":{"name":"engineering@atre.net","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/550ac35e8e821db8064c5bd1f0a04e6b"},"headline":"Comet Industry Q&#038;A (Recap): Collaborative Data Science and Machine Learning","datePublished":"2021-08-03T21:40:53+00:00","mainEntityOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/"},"wordCount":733,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/MeetUp-rough-mockup-youtube-card.001.jpeg","articleSection":["Machine Learning"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/","url":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/","name":"Comet Industry Q&A (Recap): Collaborative Data Science and Machine Learning - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/#primaryimage"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/MeetUp-rough-mockup-youtube-card.001.jpeg","datePublished":"2021-08-03T21:40:53+00:00","breadcrumb":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/#primaryimage","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/MeetUp-rough-mockup-youtube-card.001.jpeg","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/MeetUp-rough-mockup-youtube-card.001.jpeg","width":1920,"height":1080,"caption":"Collaborative Data Science and Machine Learning"},{"@type":"BreadcrumbList","@id":"https:\/\/www.comet.com\/site\/blog\/comet-industry-qa-collaborative-data-science-and-machine-learning-2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"Comet Industry Q&#038;A (Recap): Collaborative Data Science and Machine Learning"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/550ac35e8e821db8064c5bd1f0a04e6b","name":"engineering@atre.net","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/027c18177377edf459980f0cfb83706c","url":"https:\/\/secure.gravatar.com\/avatar\/d002a459a297e0d1779329318029aee19868c312b3e1f3c9ec9b3e3add2740de?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d002a459a297e0d1779329318029aee19868c312b3e1f3c9ec9b3e3add2740de?s=96&d=mm&r=g","caption":"engineering@atre.net"},"sameAs":["https:\/\/live-cometml.pantheonsite.io"],"url":"https:\/\/www.comet.com\/site\/blog\/author\/engineeringatre-net\/"}]}},"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2464","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=2464"}],"version-history":[{"count":0,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2464\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media\/2465"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=2464"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=2464"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=2464"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=2464"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}