{"id":2345,"date":"2021-06-16T14:05:55","date_gmt":"2021-06-16T22:05:55","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/"},"modified":"2021-06-16T14:05:55","modified_gmt":"2021-06-16T22:05:55","slug":"comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/","title":{"rendered":"Issue 5: Comet + Gradio, AI Microchip Floor Planning, Reinforcement Learning for Android"},"content":{"rendered":"\n

Using Gradio to run ML models in the Comet UI, AI beating humans on microchip floorplanning, reinforcement learning for Android, and more<\/em><\/h3>\n\n\n\n

Welcome to issue #5 of The Comet Newsletter!\u00a0<\/p>\n\n\n\n

This week, we take a closer look at a GPT-3-like model<\/a> that reportedly achieves similar performance to the original, along with a new way to run and test ML models in the Comet UI with Gradio<\/a>.<\/p>\n\n\n\n

Additionally, you might enjoy learning about an AI system that outperforms humans in designing microchip floorplans<\/a>, as well as a Reinforcement Learning environment on Android<\/a> that promises more customized user experiences.<\/p>\n\n\n\n

Like what you\u2019re reading? Subscribe here.<\/a><\/h3>\n\n\n\n

And be sure to follow us on Twitter<\/a> and LinkedIn<\/a> \u2014 drop us a note if you have something we should cover in an upcoming issue!<\/p>\n\n\n\n

Happy Reading,<\/p>\n\n\n\n

Austin<\/p>\n\n\n\n

Head of Community, Comet<\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY<\/strong> | WHAT WE’RE READING | PROJECTS | OPINION<\/p>\n\n\n\n

EleutherAI claims new NLP model approaches GPT-3-level performance<\/strong><\/a><\/h2>\n\n\n\n

EleutherAI<\/a> is a decentralized, grassroots collective of volunteer researchers, engineers, and developers focused on AI alignment, scaling, and open source AI research.<\/p>\n\n\n\n

Their flagship project is the GPT\u2060-\u2060Neo family of models, which aim to replicate the functionality of GPT-3. Last week, the group released GPT-J-6B (GPT-J), a model they claim achieves performance on par with an equivalent-sized GPT-3 model on various tasks.\u00a0<\/p>\n\n\n\n

GPT-J is a 6 billion parameter model that took roughly 5 weeks to train on an 835 GB collection of 22 datasets. This dataset consisted of 400 billion tokens, ranging from academic texts on arXiv and Pubmed to code repositories from GitHub.\u00a0<\/p>\n\n\n\n

EleutherAI claims to have performed \u201cextensive bias analysis\u201d on The Pile and made \u201ctough editorial decisions\u201d to exclude datasets they felt were \u201cunacceptably negatively biased\u201d toward certain groups or views.\u00a0
GPT-J\u2019s code and the trained model are open-sourced under the Apache 2.0 license and can be used for free via EleutherAI\u2019s website<\/a>. \u00a0\u00a0<\/p>\n\n\n\n

Read Kyle Wiggers’ full article here.<\/a><\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY | WHAT WE’RE READING<\/strong> | PROJECTS | OPINION<\/p>\n\n\n\n

AI system outperforms humans in designing floorplans for microchips<\/strong><\/a><\/h2>\n\n\n\n

 <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Modern chips are a miracle of technology and economics, with billions of transistors laid out and interconnected on a piece of silicon the size of a fingernail. Each chip can contain tens of millions of logic gates, called standard cells, along with thousands of memory blocks, known as macro blocks, or macros.<\/p>\n\n\n\n

Macro blocks can be thousands or even millions of times larger than standard cells, and placing cells and blocks simultaneously is extremely challenging. Modern chip-design methods therefore place the macro blocks first, in a step called floorplanning.<\/p>\n\n\n\n

Success or failure in designing microchips depends heavily on these floorplanning steps, which determine where memory and logic elements are located on a chip. The locations, in turn, strongly affect whether the completed chip design can satisfy operational requirements such as processing speed and power efficiency. Currently this task is performed iteratively and painstakingly, over weeks or months, by expert human engineers.<\/p>\n\n\n\n

Optimizing the placement of these components has been beyond the scope of automation. That is until researchers at Google led by Azalia Mirhoseini (@Azaliamirh<\/a>) demonstrated that their Reinforcement Learning approach to optimizing floorplanning can produce placements that are superior to those developed by human experts for existing chips in under 6 hours! More interestingly, the proposed designs from their system look very different from the ones created by humans.<\/p>\n\n\n\n

Advancements in the automation of chip placement help keep the trajectory of Moore\u2019s Law alive. The most telling revelation of Mirhoseini\u2019s paper is that these designs are already being incorporated into Google\u2019s next-gen AI processors, which means that they\u2019re good enough for mass production. Expect to see other chip manufacturers partnering with Google or developing their own automated solutions based on these learnings.<\/p>\n\n\n\n

Read the full article in Nature.<\/strong><\/a><\/p>\n\n\n\n

Link to the original paper.<\/strong><\/a><\/p>\n\n\n\n

 <\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY | WHAT WE’RE READING | PROJECTS <\/strong> | OPINION<\/p>\n\n\n\n

New Comet Integration: Gradio<\/a><\/h2>\n\n\n\n

 <\/p>\n\n\n\n

\n
\"\"<\/figure>\n<\/div>\n\n\n\n

Gradio is an excellent open-source Python library (with more than 2,600 stars<\/a>) that enables ML engineers and teams to create demos and GUIs from their models very easily, with just a few lines of Python.\u00a0<\/p>\n\n\n\n

Gradio\u2019s focus on increasing visibility and collaboration within the ML lifecycle makes it a perfect addition to Comet\u2019s experiment management platform, which is centered on creating a system of record for experimentation pipelines.<\/p>\n\n\n\n

In this overview of the new integration, Gradio\u2019s Co-founder and CEO Abubakar Abid explores how well Gradio and Comet work together, giving you even more ways to visualize and understand your ML experiments.<\/p>\n\n\n\n

Read Abubakar’s full overview here.<\/a><\/p>\n\n\n\n

Running PyTorch Hub Models in Your Browser with Gradio<\/strong><\/a><\/h2>\n\n\n\n

Gradio\u2019s integration with Comet isn\u2019t the only news to report this week\u2014Gradio is also now integrated directly into PyTorch\u2019s Model Hub<\/a>, so you can easily try out a model before using it in your own projects. And Gradio\u2019s new integration with Comet allows you to try out and visualize these models directly in the Comet UI.<\/p>\n\n\n\n

Read the full blog post by Gradio’s Abubakar Abid.<\/a><\/p>\n\n\n\n

AndroidEnv: The Android Reinforcement Learning Environment<\/strong><\/a><\/h2>\n\n\n\n

AndroidEnv is a Python library from Deepmind that exposes an Android device as a Reinforcement Learning (RL) environment. The library provides a flexible platform for defining custom tasks on top of the Android OS, including any Android application. Agents interact with the device through a universal action interface.\u00a0<\/p>\n\n\n\n

The release of the AndroidEnv points to a future where personal learning agents run continuously on a user’s smartphone data, ias a means of understanding behaviors and executing complex actions that are unique to individual users. For instance, your personal agent would be able to learn the common actions you perform in the morning and adapt to changes in these routines over time.<\/p>\n\n\n\n

Explore the GitHub repo here.<\/a><\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY | WHAT WE’RE READING | PROJECTS | OPINION<\/strong><\/p>\n\n\n\n

Biden\u2019s AI czar focuses on societal risks, preventing harm<\/strong><\/a><\/h2>\n\n\n\n

Last week, the Biden administration announced that they would be appointing Dr. Lynne Parker as the Director of the National AI Initiative Office. Her job will entail establishing U.S. government partnerships with small businesses, research universities, and international allies on efforts in artificial intelligence.\u00a0<\/p>\n\n\n\n

Dr. Parker\u2019s focus is to enact policy that\u00a0 \u201c[Ensures the] responsible use of AI so that we\u2019re not disadvantaging certain people, we\u2019re not achieving biased outcomes.\u201d She points to the policies introduced in Europe<\/a> that aim to regulate the risky applications of the technology as a source of guidance.<\/p>\n\n\n\n

\u201cAll of those efforts are very much about like-minded countries coming together to demonstrate how we can use AI in an appropriate way, not violate the human rights that has been demonstrated in China and other authoritarian countries.\u201d<\/p>\n\n\n\n

Dr. Parker has a long history of work in cooperative robotics, earning her Ph.D. in computer science from the Massachusetts Institute of Technology. Her dissertation research (1994) on ALLIANCE, a distributed architecture for multi-robot cooperation, was the first PhD dissertation worldwide on the topic of multi-robot systems, and is considered a pioneering work in the field.\u00a0\u00a0<\/p>\n\n\n\n

Additionally, Dr. Parker is a leading international researcher in the field of cooperative multi-robot systems, and has performed research in the areas of mobile robot cooperation, human-robot cooperation, robotic learning, intelligent agent architectures, and robot navigation.\u00a0<\/p>\n\n\n\n

Before being appointed to the position of Director at the National AI Initiative Office, she served as an an Associate Dean and Professor in the Tickle College of Engineering at the University of Tennessee-Knoxville (UTK).<\/p>\n\n\n\n

Read the full article from The AP here.<\/a><\/p>\n\n\n\n

 <\/p>\n\n\n\n

Comet CEO Gideon Mendels on The Inference Podcast<\/strong><\/a><\/h2>\n\n\n\n

 <\/p>\n\n\n\n

\n
\"\"<\/figure>\n<\/div>\n\n\n\n

And last but not least, check out the newest episode of The Inference Podcast, in which host Merve Noyan (@mervenoyann<\/a>) chats with Comet CEO and Co-founder Gideon Mendels about key differences between MLOps and DevOps, MLOps best practices, and much more.<\/p>\n\n\n\n

Check out the full conversation here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

Using Gradio to run PyTorch models in the browser, AI beating humans on microchip floorplanning, reinforcement learning on Android, and more<\/p>\n","protected":false},"author":1,"featured_media":2304,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","footnotes":""},"categories":[10],"tags":[],"coauthors":[130],"class_list":["post-2345","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-industry"],"yoast_head":"\nIssue 5: Comet + Gradio, AI Microchip Floor Planning, Reinforcement Learning for Android - Comet<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Issue 5: Comet + Gradio, AI Microchip Floor Planning, Reinforcement Learning for Android\" \/>\n<meta property=\"og:description\" content=\"Using Gradio to run PyTorch models in the browser, AI beating humans on microchip floorplanning, reinforcement learning on Android, and more\" \/>\n<meta property=\"og:url\" content=\"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2021-06-16T22:05:55+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"627\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Austin Kodra\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Austin Kodra\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Issue 5: Comet + Gradio, AI Microchip Floor Planning, Reinforcement Learning for Android - Comet","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/","og_locale":"en_US","og_type":"article","og_title":"Issue 5: Comet + Gradio, AI Microchip Floor Planning, Reinforcement Learning for Android","og_description":"Using Gradio to run PyTorch models in the browser, AI beating humans on microchip floorplanning, reinforcement learning on Android, and more","og_url":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2021-06-16T22:05:55+00:00","og_image":[{"width":1200,"height":627,"url":"http:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","type":"image\/jpeg"}],"author":"Austin Kodra","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Austin Kodra","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/#article","isPartOf":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/"},"author":{"name":"engineering@atre.net","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/550ac35e8e821db8064c5bd1f0a04e6b"},"headline":"Issue 5: Comet + Gradio, AI Microchip Floor Planning, Reinforcement Learning for Android","datePublished":"2021-06-16T22:05:55+00:00","mainEntityOfPage":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/"},"wordCount":1311,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","articleSection":["Industry"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/","url":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/","name":"Issue 5: Comet + Gradio, AI Microchip Floor Planning, Reinforcement Learning for Android - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/#primaryimage"},"image":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","datePublished":"2021-06-16T22:05:55+00:00","breadcrumb":{"@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/#primaryimage","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","width":1200,"height":627,"caption":"Comet Newsletter"},{"@type":"BreadcrumbList","@id":"http:\/\/www.comet.com\/site\/blog\/comet-newsletter-5-comet-gradio-ai-microchip-reinforcement-learning-android\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"Issue 5: Comet + Gradio, AI Microchip Floor Planning, Reinforcement Learning for Android"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/550ac35e8e821db8064c5bd1f0a04e6b","name":"engineering@atre.net","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/027c18177377edf459980f0cfb83706c","url":"https:\/\/secure.gravatar.com\/avatar\/d002a459a297e0d1779329318029aee19868c312b3e1f3c9ec9b3e3add2740de?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d002a459a297e0d1779329318029aee19868c312b3e1f3c9ec9b3e3add2740de?s=96&d=mm&r=g","caption":"engineering@atre.net"},"sameAs":["https:\/\/live-cometml.pantheonsite.io"],"url":"https:\/\/www.comet.com\/site\/blog\/author\/engineeringatre-net\/"}]}},"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2345","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=2345"}],"version-history":[{"count":0,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2345\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media\/2304"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=2345"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=2345"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=2345"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=2345"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}