{"id":364,"date":"2021-08-03T15:37:44","date_gmt":"2021-08-03T23:37:44","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/?p=364"},"modified":"2025-04-24T17:30:02","modified_gmt":"2025-04-24T17:30:02","slug":"managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/","title":{"rendered":"Managing ML Operations: When to Build vs Buy"},"content":{"rendered":"\n<figure class=\"wp-block-embed-vimeo wp-block-embed is-type-video is-provider-vimeo wp-embed-aspect-1-1 wp-has-aspect-ratio\">\n<div class=\"wp-block-embed__wrapper\"><iframe loading=\"lazy\" id=\"vm-6da3bd71-3aff-421a-b43d-86376007b996\" title=\"When does it make sense to build and when to buy\" src=\"https:\/\/player.vimeo.com\/video\/582673746?dnt=1&amp;app_id=122963\" width=\"500\" height=\"500\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\" data-ready=\"true\" data-mce-fragment=\"1\"><\/iframe><\/div>\n<\/figure>\n\n\n\n<p>When to build your own MLOps platform and when to buy it?<\/p>\n\n\n\n<p>Here\u2019s the framework:<\/p>\n\n\n\n<p>This depends on the level of maturity and size of the organization.<\/p>\n\n\n\n<p>For large enterprises that have no internal resources whatsoever to build, the only option is to buy.<\/p>\n\n\n\n<p>But for most enterprises, the typical answer here is to do both.<\/p>\n\n\n\n<p>Throughout the MLOps lifecycle, some areas are unique to your business.<\/p>\n\n\n\n<p>This is typically around:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>data pipelines<\/li>\n\n\n\n<li>ETLs<\/li>\n\n\n\n<li>deployment of a mobile or web application<\/li>\n\n\n\n<li>batch prediction.<\/li>\n<\/ul>\n\n\n\n<p>For these use cases, it better to build the components internally.<\/p>\n\n\n\n<p>However, it often doesn\u2019t make sense to build in areas that are more generalizable.<\/p>\n\n\n\n<p>This includes:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>experiment management,<\/li>\n\n\n\n<li>model management, and<\/li>\n\n\n\n<li>model monitoring.<\/li>\n<\/ul>\n\n\n\n<p>For example, Uber has an amazing MLOps platform called Michaelangelo.<\/p>\n\n\n\n<p>They came to us as they recognized that their engineering cycles were better spent in other places.<\/p>\n\n\n\n<p>Comet is integrated harmoniously with their Michelangelo platform.<\/p>\n\n\n\n<p>This way, their internal customers can get value from day 1, and they can spend their resources in other critical areas.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>When to build your own MLOps platform and when to buy it? Here\u2019s the framework: This depends on the level of maturity and size of the organization. For large enterprises that have no internal resources whatsoever to build, the only option is to buy. But for most enterprises, the typical answer here is to do [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":366,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","footnotes":""},"categories":[12],"tags":[],"coauthors":[107],"class_list":["post-364","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-thought-leadership"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Managing ML operations When Does It Make Sense To Build<\/title>\n<meta name=\"description\" content=\"Blog post on managing ML operations: when does it make sense to build and when to buy? It depends on the level of maturity and size of the organization.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Managing ML Operations: When to Build vs Buy\" \/>\n<meta property=\"og:description\" content=\"Blog post on managing ML operations: when does it make sense to build and when to buy? It depends on the level of maturity and size of the organization.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2021-08-03T23:37:44+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-04-24T17:30:02+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2021\/08\/gideon-video-image.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"499\" \/>\n\t<meta property=\"og:image:height\" content=\"268\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Gideon Mendels\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Gideon Mendels\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Managing ML operations When Does It Make Sense To Build","description":"Blog post on managing ML operations: when does it make sense to build and when to buy? It depends on the level of maturity and size of the organization.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/","og_locale":"en_US","og_type":"article","og_title":"Managing ML Operations: When to Build vs Buy","og_description":"Blog post on managing ML operations: when does it make sense to build and when to buy? It depends on the level of maturity and size of the organization.","og_url":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2021-08-03T23:37:44+00:00","article_modified_time":"2025-04-24T17:30:02+00:00","og_image":[{"width":499,"height":268,"url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2021\/08\/gideon-video-image.jpeg","type":"image\/jpeg"}],"author":"Gideon Mendels","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Gideon Mendels","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/#article","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/"},"author":{"name":"Matt Peternell","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/85aa446f8be987e848ea929ef524b67b"},"headline":"Managing ML Operations: When to Build vs Buy","datePublished":"2021-08-03T23:37:44+00:00","dateModified":"2025-04-24T17:30:02+00:00","mainEntityOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/"},"wordCount":182,"commentCount":0,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2021\/08\/gideon-video-image.jpeg","articleSection":["Thought Leadership"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/","url":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/","name":"Managing ML operations When Does It Make Sense To Build","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/#primaryimage"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2021\/08\/gideon-video-image.jpeg","datePublished":"2021-08-03T23:37:44+00:00","dateModified":"2025-04-24T17:30:02+00:00","description":"Blog post on managing ML operations: when does it make sense to build and when to buy? It depends on the level of maturity and size of the organization.","breadcrumb":{"@id":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/#primaryimage","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2021\/08\/gideon-video-image.jpeg","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2021\/08\/gideon-video-image.jpeg","width":499,"height":268,"caption":"Gideon Video | Comet ML"},{"@type":"BreadcrumbList","@id":"https:\/\/www.comet.com\/site\/blog\/managing-ml-operations-when-does-it-make-sense-to-build-and-when-to-buy\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"Managing ML Operations: When to Build vs Buy"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/85aa446f8be987e848ea929ef524b67b","name":"Matt Peternell","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/da003ee51bbeeccfb95147ec69139879","url":"https:\/\/secure.gravatar.com\/avatar\/36058153d701caaf237a96d5d6fb9c2d1678325c3ed0d8e88bf5e487019a2a53?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/36058153d701caaf237a96d5d6fb9c2d1678325c3ed0d8e88bf5e487019a2a53?s=96&d=mm&r=g","caption":"Matt Peternell"},"description":"We re-implemented the architecture of this model to incorporate patient and study information. By comparing our updated model to the original Github repository, we were able to quantify the benefits of classifying by patient as opposed to classifying by individual X-ray. We observed a 0.0254 increase in AUROC when evaluating the DenseNet121 on patients instead of on individual scans.","sameAs":["http:\/\/atre.net"],"url":"https:\/\/www.comet.com\/site\/blog\/author\/mpeternellatre-net\/"}]}},"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/364","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=364"}],"version-history":[{"count":1,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/364\/revisions"}],"predecessor-version":[{"id":15685,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/364\/revisions\/15685"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media\/366"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=364"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=364"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=364"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=364"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}