{"id":2514,"date":"2021-09-16T14:04:25","date_gmt":"2021-09-16T22:04:25","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/"},"modified":"2021-09-16T14:04:25","modified_gmt":"2021-09-16T22:04:25","slug":"comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/","title":{"rendered":"Issue 18: Self-regulating AI Ethics, TensorFlow Similarity, 3D Dance Generation, and Textless NLP"},"content":{"rendered":"\n

Welcome to issue #18 of The Comet Newsletter!

In this week’s issue, we share a report that examines how big tech players are working to\u00a0self-regulate their approaches to AI ethics<\/a>.

Additionally, we share details on several new projects, including\u00a0a textless NLP model from Facebook<\/a>, a novel approach to\u00a03D dance generation from Google<\/a>, and a\u00a0new TensorFlow Python package that makes it easier than ever to train similarity models<\/a>.<\/p>\n\n\n\n

Like what you\u2019re reading? Subscribe here.<\/a><\/h3>\n\n\n\n

And be sure to follow us on Twitter<\/a> and LinkedIn<\/a> \u2014 drop us a note if you have something we should cover in an upcoming issue!<\/p>\n\n\n\n

Happy Reading,<\/p>\n\n\n\n

Austin<\/p>\n\n\n\n

Head of Community, Comet<\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY<\/strong> | PROJECTS<\/p>\n\n\n\n

Money, mimicry, and mind control: Big Tech slams ethics brakes on AI<\/a><\/h2>\n\n\n\n

While we\u2019ve previously covered issues of bias and ethics in the industry, this report from Paresh Dave and Jeffrey Dastin for Reuters unearths some of the ways the big tech players are debating the ethical concerns of AI internally.<\/p>\n\n\n\n

The authors cite examples like Google pulling back from AI features that predict who should receive loans, Microsoft weighing speech tech that could help those with vocal impairments\u2014but could also give rise to troubling political deepfakes.<\/p>\n\n\n\n

Beyond these examples, this report touches on a deeper point that is less frequently discussed\u2014should these companies be tasked with creating their own ethics regulations, committees, and policies to begin with? Or should governments and regulatory agencies step in and provide oversight that would standardize the way the industry must tackle these difficult challenges and questions?<\/p>\n\n\n\n

Read the full report in Reuters here.<\/a>\u00a0<\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY | PROJECTS<\/strong><\/p>\n\n\n\n

Introducing TensorFlow Similarity<\/a><\/h2>\n\n\n\n

This new Python package from the TensorFlow team is intended to make training similarity models (often used in search applications) much faster and easier. The TF team tackled this problem by relying on contrastive deep learning approaches, which teach models how to learn a given embedding space \u201cin which similar examples are close together while dissimilar ones are far apart.\u201d<\/p>\n\n\n\n

While not necessarily a new technical approach to the problem of identifying similarity, this new library allows ML engineers to quickly and efficiently access a new Keras model that natively supports indexing and querying for these embeddings. To help the community get started with this new library, the TensorFlow team has provided a\u00a0Hello World Tutorial<\/a>, as well as more information and code resources on\u00a0the project\u2019s GitHub repo<\/a>.<\/p>\n\n\n\n

Read the full blog post announcement here.<\/a><\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY | PROJECTS<\/strong><\/p>\n\n\n\n

Music Conditioned 3D Dance Generation with AIST++<\/a><\/h2>\n\n\n\n

For many of us, learning to dance is…difficult. For those of us who aren\u2019t naturally inclined to the art form, matching our movement patterns to musical rhythms can be a daunting task. But developing a machine learning system that can learn to dance is even more difficult\u2014the movements by an ML system need to be continuous, have a high degree of kinematic complexity, and somehow understand the often non-linear relationship between movements and a given piece of music.<\/p>\n\n\n\n

In this technical blog post from the Google AI team, their researchers set out to tackle this exact problem. At a high level, the team had to construct a complicated, extensively-annotated dataset of computer-generated movements mapped onto different pieces of music. They then used this dataset to train a \u201cFull Attention Cross-Modal Transformer (FACT) Model\u201d, which is designed to generate novel 3D dance from music inputs.<\/p>\n\n\n\n

It\u2019s an impressive and unique approach, and you can read a whole lot more about the technical specifics in their full write-up, as well as information about how they\u2019ve\u00a0 evaluated the model\u2019s performance.<\/p>\n\n\n\n

Read Google AI\u2019s full blog post here.<\/a><\/p>\n\n\n

——————————–<\/center>\n\n\n

INDUSTRY | PROJECTS<\/strong><\/p>\n\n\n\n

Textless NLP: Generating expressive speech from raw audio<\/a><\/h2>\n\n\n\n

Without a doubt, large language models represent one of the most important advancements in the ML industry in recent years. But while these models have spurred incredible and creative use cases, they also have a number of significant limitations. One of the main ones is that applications are generally limited to languages for which there are massive datasets suitable for training these models.<\/p>\n\n\n\n

Facebook AI is looking to address this problem with its latest NLP architecture: Generative Spoken Language Model (GSLM). This novel architecture centers on the use of new representation learning mechanisms, which allows it to learn directly from raw audio signals\u2014without any labels or text.<\/p>\n\n\n\n

The deep dive on Facebook AI\u2019s blog covers the benefits of a textless NLP approach, their team\u2019s development of a baseline model, a discussion about the model\u2019s limitations, and what they plan to do next.<\/p>\n\n\n\n

Read the full Facebook AI blog post here.<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Self-regulating AI ethics, TensorFlow Similarity, 3D dance generation, and textless NLP<\/p>\n","protected":false},"author":1,"featured_media":2304,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","footnotes":""},"categories":[10],"tags":[],"coauthors":[130],"class_list":["post-2514","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-industry"],"yoast_head":"\nIssue 18: Self-regulating AI Ethics, TensorFlow Similarity, 3D Dance Generation, and Textless NLP - Comet<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Issue 18: Self-regulating AI Ethics, TensorFlow Similarity, 3D Dance Generation, and Textless NLP\" \/>\n<meta property=\"og:description\" content=\"Self-regulating AI ethics, TensorFlow Similarity, 3D dance generation, and textless NLP\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2021-09-16T22:04:25+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"627\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Austin Kodra\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Austin Kodra\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Issue 18: Self-regulating AI Ethics, TensorFlow Similarity, 3D Dance Generation, and Textless NLP - Comet","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/","og_locale":"en_US","og_type":"article","og_title":"Issue 18: Self-regulating AI Ethics, TensorFlow Similarity, 3D Dance Generation, and Textless NLP","og_description":"Self-regulating AI ethics, TensorFlow Similarity, 3D dance generation, and textless NLP","og_url":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2021-09-16T22:04:25+00:00","og_image":[{"width":1200,"height":627,"url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","type":"image\/jpeg"}],"author":"Austin Kodra","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Austin Kodra","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/#article","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/"},"author":{"name":"engineering@atre.net","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/550ac35e8e821db8064c5bd1f0a04e6b"},"headline":"Issue 18: Self-regulating AI Ethics, TensorFlow Similarity, 3D Dance Generation, and Textless NLP","datePublished":"2021-09-16T22:04:25+00:00","mainEntityOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/"},"wordCount":787,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","articleSection":["Industry"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/","url":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/","name":"Issue 18: Self-regulating AI Ethics, TensorFlow Similarity, 3D Dance Generation, and Textless NLP - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/#primaryimage"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","datePublished":"2021-09-16T22:04:25+00:00","breadcrumb":{"@id":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/#primaryimage","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2022\/06\/Comet-Newsletter-Ad-1200x627-02.jpg","width":1200,"height":627,"caption":"Comet Newsletter"},{"@type":"BreadcrumbList","@id":"https:\/\/www.comet.com\/site\/blog\/comet-newsletter-18-self-regulating-ai-ethics-tensorflow-similarity-3d-dance-generation-textless-nlp\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"Issue 18: Self-regulating AI Ethics, TensorFlow Similarity, 3D Dance Generation, and Textless NLP"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/550ac35e8e821db8064c5bd1f0a04e6b","name":"engineering@atre.net","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/027c18177377edf459980f0cfb83706c","url":"https:\/\/secure.gravatar.com\/avatar\/d002a459a297e0d1779329318029aee19868c312b3e1f3c9ec9b3e3add2740de?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d002a459a297e0d1779329318029aee19868c312b3e1f3c9ec9b3e3add2740de?s=96&d=mm&r=g","caption":"engineering@atre.net"},"sameAs":["https:\/\/live-cometml.pantheonsite.io"],"url":"https:\/\/www.comet.com\/site\/blog\/author\/engineeringatre-net\/"}]}},"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2514","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=2514"}],"version-history":[{"count":0,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/2514\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media\/2304"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=2514"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=2514"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=2514"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=2514"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}