{"id":2311,"date":"2021-05-25T13:38:45","date_gmt":"2021-05-25T21:38:45","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/"},"modified":"2021-05-25T13:38:45","modified_gmt":"2021-05-25T21:38:45","slug":"comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/","title":{"rendered":"Issue 2: ML at Google I\/O, CodeCarbon, Twitter’s Abandoned Image Cropping Algorithm"},"content":{"rendered":"\n

ML updates from Google I\/O, a Python library that helps you calculate your code’s carbon footprint, and more<\/em><\/h3>\n\n\n\n

Welcome to issue #2 of The Comet Newsletter!<\/p>\n\n\n\n

This week, we take a closer look at the wide range of interesting ML news coming out of Google I\/O, and share a blog post from Twitter discussing why their team scrapped an image cropping model.<\/p>\n\n\n\n

Additionally, you might enjoy a new Talk Python podcast episode exploring a Python library that you can use to track the carbon footprint of your code\u2014as well as a tutorial showing you how to integrate the library with Comet.\u00a0<\/p>\n\n\n\n

Like what you\u2019re reading? Subscribe here.<\/a><\/h4>\n\n\n\n

And be sure to follow us on Twitter<\/a> and LinkedIn<\/a> \u2014 drop us a note if you have something we should cover in an upcoming issue!<\/p>\n\n\n\n

Happy Reading,<\/p>\n\n\n\n

Austin<\/p>\n\n\n\n

Head of Community, Comet<\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY<\/strong> | WHAT WE’RE READING | PROJECTS | OPINION<\/p>\n\n\n\n

\n
\"\"\n
Image Source<\/a><\/figcaption>\n<\/figure>\n<\/div>\n\n\n\n

Google I\/O 2021: Enhanced speech and image tech, ML privacy on Android, and the introduction of Vertex<\/h2>\n\n\n\n

This year\u2019s Google I\/O saw the company make big ML announcements\u2014in Speech and Image technology, as well as in tooling for Machine Learning model development on cloud and mobile platforms.\u00a0\u00a0\u00a0\u00a0<\/p>\n\n\n\n

The star of the show was LaMBDA<\/a> (Language Model for Dialogue Applications), Google\u2019s new conversation model. LaMBDA continues the trend of applying large transformer models to solve natural language problems. Unlike most other language models, LaMDA has been trained on dialogue data. The intent here is to find ways for the model to address the open ended-ness of real conversations.\u00a0<\/p>\n\n\n\n

\u201cA chat with a friend about a TV show could evolve into a discussion about the country where the show was filmed before settling on a debate about that country\u2019s best regional cuisine,\u201d explained Eli Collins and Zoubin Ghahramani of Google. \u201cThat meandering quality can quickly stump modern conversational agents (commonly known as chatbots), which tend to follow narrow, pre-defined paths.\u201d\u00a0<\/p>\n\n\n\n

In the computer vision space, the company has taken steps towards updating its camera and imaging technology to be more inclusive of skin tone. Historically, image processing tends to be tuned for lighter skin tones and not that of black and brown subjects. Google has taken steps to\u00a0 improve its auto-white balance and exposure algorithms to have better accuracy for dark skin tones based on a broader dataset of images featuring black and brown faces.\u00a0

Google is also providing enhanced tooling and support for privacy-preserving ML for Android. Russell Brandom discussed these new capabilities in his write-up in The Verge<\/a>: \u201cAndroid\u2019s new Private Compute Core will be a privileged space within the operating system, similar to the partitions used for passwords or sensitive biometric data. But instead of holding credentials, the computing core will hold data for use in machine learning, like the data used for the Smart Reply text message feature.\u201d<\/p>\n\n\n\n

Greater public scrutiny of how large tech companies collect and use customer data is the likely motivator behind this move. One may see this as a preemptive effort from Google to avoid legal altercations similar to the ongoing one between Apple and Facebook<\/a>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/p>\n\n\n\n

Finally, Google announced their new Cloud ML Platform, Vertex AI<\/a>. The goal of the platform is to provide a single UI and API for all of Google\u2019s Cloud Services for building, training, and deploying machine learning models at scale.\u00a0<\/p>\n\n\n\n

There is on-going debate as to whether the MLOps market is best suited for end-to-end platforms or a best-of-breeds model. Machine Learning as a field moves very quickly, and it is difficult to encompass all the needs of a machine learning team into a single product that can be effectively maintained. Read more about this debate here<\/a>.\u00a0<\/p>\n\n\n\n

Looking for more? Check out this full rundown<\/a> of all the announcements from this year\u2019s event.<\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY | WHAT WE’RE READING<\/strong> | PROJECTS | OPINION<\/p>\n\n\n\n

\n
\"\"\n
Twitter’s Image Cropping algorithm in action. Source<\/a><\/figcaption>\n<\/figure>\n<\/div>\n\n\n\n

Twitter shares learning from their image cropping algorithm<\/h2>\n\n\n\n

In this retrospective, Dr. Rumman Chowdhury, a Director of Software Engineering at Twitter, explains the issues leading up to the decision to ditch their Image Cropping algorithm. In early 2018, Twitter started using ML to automate image cropping on it\u2019s platform. In October of 2020, they started receiving complaints that the cropping did not serve all people equitably. Dr. Chowdhry\u2019s team went through an extensive review of the algorithm, and put into place improvements for assessing algorithms for potential bias and for understanding whether ML is the best solution to the problem at hand. They uncovered three key areas where the model was failing, and eventually decided that the best solution was to include a cropping preview option within the product so that users had final say over how their images were presented.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/p>\n\n\n\n

\u201cThis really highlights the importance of thinking about the potential impact of ML models and why we build them in the first place. Sometimes, it is easier to just fix the root cause\u201d – Jacques Verre, Product Manager @Comet\u00a0<\/p>\n\n\n\n

Read Dr. Chowdhury\u2019s full retro here.<\/a><\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY | WHAT WE’RE READING | PROJECTS <\/strong> | OPINION<\/p>\n\n\n\n

\n
\"\"\n
Image Source<\/a><\/figcaption>\n<\/figure>\n<\/div>\n\n\n\n

CodeCarbon: Calculate and visualize your code’s C02 impact<\/h3>\n\n\n\n

Check out this excellent episode<\/a> of the Talk Python<\/a> podcast, where the team behind CodeCarbon<\/a>\u2014including our own Boris Feld\u2014discusses the Python library, which lets you calculate and visualize your ML code’s carbon footprint. Given the huge compute costs associated with training state of the art machine learning models, it is imperative that the ML community embrace tools that allow us to better gauge the impact of our work on the environment.\u00a0<\/p>\n\n\n\n

You can also learn more about the open-source CodeCarbon library\u2014and how to integrate it with Comet\u2014in an excellent write up by Niko Laskaris.<\/p>\n\n\n\n

Read Niko\u2019s blog post here<\/a><\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY | WHAT WE’RE READING | PROJECTS | OPINION<\/strong><\/p>\n\n\n\n

\n
\"\"\n
Image Source<\/a><\/figcaption>\n<\/figure>\n<\/div>\n\n\n\n

Towards Human-Centered Explainable AI: the journey so far<\/h3>\n\n\n\n

In this post, Upol Ehsan<\/a> questions the myth that \u201cIf you can just open the black box, everything else will be fine\u201d.\u00a0 Ehsan talks about his experience building Explainable AI Systems, and the importance of understanding the \u201cwho\u201d the human in the loop is when building such systems.\u00a0<\/p>\n\n\n\n

\u201cExplainability is a human factor. It is a shared meaning-making process that occurs between explainer(s) and explainee(s).\u201d<\/p>\n\n\n\n

Read Ehsan\u2019s full post here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

In this week’s Comet Newsletter, we…<\/p>\n","protected":false},"author":1,"featured_media":2304,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","footnotes":""},"categories":[10],"tags":[],"coauthors":[130],"class_list":["post-2311","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-industry"],"yoast_head":"\nIssue 2: ML at Google I\/O, CodeCarbon, Twitter's Abandoned Image Cropping Algorithm - Comet<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Issue 2: ML at Google I\/O, CodeCarbon, Twitter's Abandoned Image Cropping Algorithm\" \/>\n<meta property=\"og:description\" content=\"In this week's Comet Newsletter, we...\" \/>\n<meta property=\"og:url\" content=\"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2021-05-25T21:38:45+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"627\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Austin Kodra\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Austin Kodra\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Issue 2: ML at Google I\/O, CodeCarbon, Twitter's Abandoned Image Cropping Algorithm - Comet","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/","og_locale":"en_US","og_type":"article","og_title":"Issue 2: ML at Google I\/O, CodeCarbon, Twitter's Abandoned Image Cropping Algorithm","og_description":"In this week's Comet Newsletter, we...","og_url":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2021-05-25T21:38:45+00:00","og_image":[{"width":1200,"height":627,"url":"http:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","type":"image\/jpeg"}],"author":"Austin Kodra","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Austin Kodra","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/#article","isPartOf":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/"},"author":{"name":"engineering@atre.net","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/550ac35e8e821db8064c5bd1f0a04e6b"},"headline":"Issue 2: ML at Google I\/O, CodeCarbon, Twitter’s Abandoned Image Cropping Algorithm","datePublished":"2021-05-25T21:38:45+00:00","mainEntityOfPage":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/"},"wordCount":1067,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","articleSection":["Industry"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/","url":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/","name":"Issue 2: ML at Google I\/O, CodeCarbon, Twitter's Abandoned Image Cropping Algorithm - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/#primaryimage"},"image":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","datePublished":"2021-05-25T21:38:45+00:00","breadcrumb":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/#primaryimage","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","width":1200,"height":627,"caption":"Comet Newsletter"},{"@type":"BreadcrumbList","@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-2-ml-googleio-codecarbon-twitter-image-cropping\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"Issue 2: ML at Google I\/O, CodeCarbon, Twitter’s Abandoned Image Cropping Algorithm"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/550ac35e8e821db8064c5bd1f0a04e6b","name":"engineering@atre.net","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/027c18177377edf459980f0cfb83706c","url":"https:\/\/secure.gravatar.com\/avatar\/d002a459a297e0d1779329318029aee19868c312b3e1f3c9ec9b3e3add2740de?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d002a459a297e0d1779329318029aee19868c312b3e1f3c9ec9b3e3add2740de?s=96&d=mm&r=g","caption":"engineering@atre.net"},"sameAs":["https:\/\/live-cometml.pantheonsite.io"],"url":"https:\/\/www.comet.com\/site\/blog\/author\/engineeringatre-net\/"}]}},"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2311","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=2311"}],"version-history":[{"count":0,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2311\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media\/2304"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=2311"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=2311"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=2311"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=2311"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}