{"id":12817,"date":"2025-02-10T14:13:47","date_gmt":"2025-02-10T22:13:47","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/?page_id=12817"},"modified":"2025-06-12T18:06:04","modified_gmt":"2025-06-12T18:06:04","slug":"jayeeta-putatunda","status":"publish","type":"page","link":"https:\/\/www.comet.com\/site\/convergence\/jayeeta-putatunda\/","title":{"rendered":"Jayeeta Putatunda"},"content":{"rendered":"\n
<\/div><\/span>
\n
\n

\u2190 BACK TO EVENT PAGE<\/a><\/p>\n\n\n\n

\n
\n
\"\"<\/figure>\n<\/div>\n\n\n\n
\n

Jayeeta Putatunda<\/h1>\n\n\n

Sr. Data Scientist at Fitch Ratings<\/h2>\n<\/div>\n\n\n\n
\n
\n<\/div>\n\n\n\n

Jayeeta is a Senior Data Scientist with several years of industry experience in Natural Language Processing (NLP), Statistical Modeling, Product Analytics, and implementing ML solutions for specialized use cases in B2C as well as B2B domains. Currently, Jayeeta works at Fitch Ratings, a global leader in financial information services. She is an avid NLP researcher and gets to explore a lot of state-of-the-art open-source models to build impactful products and firmly believes that data, of all forms, is the best storyteller. Jayeeta also led multiple NLP workshops in association with Women Who Code, and GitNation among others. Jayeeta has also been invited to speak at the International Conference on Machine Learning (ICML 2022), ODSC East, MLConf EU, WomenTech Global Conference, Data Science Salon, The AI Summit, and Data Summit Connect, to name a few. Jayeeta is also an ambassador for Women in Data Science, at Stanford University, and was a Data Science Mentor at Girl Up, United Nations Foundation, and WomenTech Network where she aims to inspire more women to take up STEM. Jayeeta has been nominated for the WomenTech Global Awards 2020 and has been spotlighted in the List of Top 100 Women Who Break the Bias 2022.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div><\/div>\n\n\n\n

May 8, 2024<\/p>\n\n\n\n

Decoding LLMs: Challenges in Evaluation<\/h2>\n\n\n\n
\n\n\n\n

Large Language Models (LLMs) gave a new life to the domain of natural language processing, revolutionizing various fields from conversational AI to content generation. However, as these models grow in complexity and scale, evaluating their performance presents many challenges. One of the primary challenges in LLM evaluation lies in the absence of standardized benchmarks that comprehensively capture the capabilities of these models across diverse tasks and domains. Secondly, the black-box nature of LLMs poses significant challenges in understanding their decision-making processes and identifying biases. In this talk, we address the fundamental questions such as what constitutes effective evaluation metrics in the context of LLMs, and how these metrics align with real-world applications. As the LLM field is seeing dynamic growth and rapid evolution of new architectures, it also requires continuous evaluation methodologies that adapt to changing contexts. Open source initiatives play a pivotal role in addressing the challenges of LLM evaluation, driving progress, facilitating the development of standardized benchmarks, and enabling researchers to consistently benchmark LLM performance across various tasks and domains. We will also evaluate some of the OS evaluation metrics and walkthrough of code using demo data from Kaggle.<\/p>\n\n\n\n

\n
Register now<\/a><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"parent":12738,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"convergence","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","footnotes":""},"coauthors":[126],"class_list":["post-12817","page","type-page","status-publish","hentry"],"yoast_head":"\nJayeeta Putatunda - Comet<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.comet.com\/site\/convergence\/jayeeta-putatunda\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Jayeeta Putatunda\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.comet.com\/site\/convergence\/jayeeta-putatunda\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-12T18:06:04+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/10\/Share-image-3.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1800\" \/>\n\t<meta property=\"og:image:height\" content=\"945\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n\t<meta name=\"twitter:label2\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data2\" content=\"engineering@atre.net\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Jayeeta Putatunda - Comet","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.comet.com\/site\/convergence\/jayeeta-putatunda\/","og_locale":"en_US","og_type":"article","og_title":"Jayeeta Putatunda","og_url":"https:\/\/www.comet.com\/site\/convergence\/jayeeta-putatunda\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_modified_time":"2025-06-12T18:06:04+00:00","og_image":[{"width":1800,"height":945,"url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/10\/Share-image-3.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@Cometml","twitter_misc":{"Est. reading time":"3 minutes","Written by":"engineering@atre.net"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.comet.com\/site\/convergence\/jayeeta-putatunda\/","url":"https:\/\/www.comet.com\/site\/convergence\/jayeeta-putatunda\/","name":"Jayeeta Putatunda - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"datePublished":"2025-02-10T22:13:47+00:00","dateModified":"2025-06-12T18:06:04+00:00","breadcrumb":{"@id":"https:\/\/www.comet.com\/site\/convergence\/jayeeta-putatunda\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.comet.com\/site\/convergence\/jayeeta-putatunda\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.comet.com\/site\/convergence\/jayeeta-putatunda\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"Convergence 2025","item":"https:\/\/www.comet.com\/site\/convergence\/"},{"@type":"ListItem","position":3,"name":"Jayeeta Putatunda"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]}]}},"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/pages\/12817","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=12817"}],"version-history":[{"count":3,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/pages\/12817\/revisions"}],"predecessor-version":[{"id":16662,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/pages\/12817\/revisions\/16662"}],"up":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/pages\/12738"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=12817"}],"wp:term":[{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=12817"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}