{"id":12810,"date":"2025-02-10T14:03:04","date_gmt":"2025-02-10T22:03:04","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/?page_id=12810"},"modified":"2025-06-12T18:11:53","modified_gmt":"2025-06-12T18:11:53","slug":"sanghamitra-deb","status":"publish","type":"page","link":"https:\/\/www.comet.com\/site\/convergence\/sanghamitra-deb\/","title":{"rendered":"Sanghamitra Deb"},"content":{"rendered":"\n<div class=\"wp-block-cover alignfull has-parallax\" style=\"margin-bottom:var(--wp--preset--spacing--100);padding-top:var(--wp--preset--spacing--160);padding-bottom:var(--wp--preset--spacing--100)\"><div class=\"wp-block-cover__image-background wp-image-16488 has-parallax\" style=\"background-position:50% 50%;background-image:url(https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/02\/convergence-hero-background-scaled.jpg)\"><\/div><span aria-hidden=\"true\" class=\"wp-block-cover__background has-background-dim-0 has-background-dim\" style=\"background-color:#4a1e26\"><\/span><div class=\"wp-block-cover__inner-container is-layout-constrained wp-block-cover-is-layout-constrained\">\n<div class=\"wp-block-group alignwide is-content-justification-left is-layout-constrained wp-container-core-group-is-layout-12dd3699 wp-block-group-is-layout-constrained\">\n<p class=\"has-background-color has-text-color has-link-color wp-elements-5a2024186819c231e941dc556eed5a54\"><a href=\"https:\/\/www.comet.com\/site\/convergence\/\">\u2190 BACK TO EVENT PAGE<\/a><\/p>\n\n\n\n<div class=\"wp-block-columns alignwide is-layout-flex wp-container-core-columns-is-layout-b61b2f12 wp-block-columns-is-layout-flex\" style=\"margin-top:var(--wp--preset--spacing--50)\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:275px\">\n<figure class=\"wp-block-image size-large is-resized is-style-opik is-style-opik--1\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"300\" src=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/06\/a03a9f383d79e353a778a64eacf05131.jpeg\" alt=\"Sanghamitra Deb headshot\" class=\"wp-image-16667\" style=\"aspect-ratio:1;object-fit:cover;width:275px\" srcset=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/06\/a03a9f383d79e353a778a64eacf05131.jpeg 300w, https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/06\/a03a9f383d79e353a778a64eacf05131-150x150.jpeg 150w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<div class=\"wp-block-group is-content-justification-left is-layout-constrained wp-container-core-group-is-layout-a0d49d46 wp-block-group-is-layout-constrained\"><h1 style=\"font-style:normal;font-weight:400;\" class=\"wp-block-post-title has-display-m-font-size\">Sanghamitra Deb<\/h1>\n\n\n<h2 class=\"wp-block-heading has-body-l-font-size\" id=\"h-data-science-educator-and-vanishing-gradients-host\" style=\"font-style:normal;font-weight:400\">AI &amp; ML Leadership at Chegg<\/h2>\n<\/div>\n\n\n\n<div class=\"wp-block-group is-nowrap is-layout-flex wp-container-core-group-is-layout-6c531013 wp-block-group-is-layout-flex\">\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-opik is-style-opik--2\"\/>\n<\/div>\n\n\n\n<p>Sanghamitra believes in data driven decision making. Her goals are to generate business insights and design ideas using insights gleaned from data. Sanghamitra works on different aspects of machine learning ranging from time-series modeling, anomaly detection, data sampling, simulations to semantic modeling, topic molding, NLP, and data mapping. She enjoys telling data stories using powerful interactive visualizations.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div><\/div>\n\n\n\n<p class=\"has-text-align-center has-custom-opik-red-color has-text-color has-link-color wp-elements-6a0f093506b739352a934c628ca14f2e\">May 8, 2024 @ 1:40 \u2013 2:10 pm ET<\/p>\n\n\n\n<h2 class=\"wp-block-heading has-text-align-center\" id=\"h-evaluation-driven-development-building-reliable-ai-systems\" style=\"margin-top:var(--wp--preset--spacing--8)\">Developing Conversational AI Agents to Enhance Academic Learning<\/h2>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-opik is-style-opik--3\" style=\"margin-top:var(--wp--preset--spacing--40);margin-bottom:var(--wp--preset--spacing--40)\"\/>\n\n\n\n<p class=\"has-text-align-center\">In the past year Generative AI and Large Language Models(LLMs) have disrupted the Education Landscape. We are in the paradigm where AI not only helps with immediate learning needs of students but also plan and design a study guide that can be personalized based on individual needs. Conversational AI agents are perfect for solving this problem. In this presentation I am going to speak about building a conversational learning experience at Chegg. Chegg is a centralized hub where students come to get help with writing, science, math, and other educational needs. In order to impact a student\u2019s learning capabilities we are enabling a personalized chat experience powered by an LLM agent. As a user experience this comes in the form of students being able to not just ask questions, but get clarifications on the solution or independent concepts. It\u2019s similar to a tutor helping out with different learning needs. Behind the scenes this experience is powered an LLM agent. An agent is an intelligent system with cognitive abilities to take decisions and make appropriate choices. The first job of the agent is to understand what a student needs when they come to Chegg, they might be wanting quick help when they are stuck on a problem or they could want a study guide for the semester. Once the need of the student is clear the agent has over a decade years of content and student interaction data that it can use and form plans for the conversational learning session. Next the plans are executed by plugging into API such as search and calling traditional Machine Learning models and LLMs from external API and ones fine-tuned on Chegg data. There are several moving parts to building a system that can robustly provide high quality content and scale to millions of students. This requires a robust engineering infrastructure, the agility to adapt to a constantly changing world of LLMs powering the experience and develop a system to monitor and evaluate performance of the conversational AI system. The unique feature of LLMs is they might not give the same result for the same prompt every time, this might cause unexpected behavior when the system is used by millions of students. Building scalable applications with streaming functionality has its own challenges. Fast iterations are extremely important to keep up with the pace of innovation, at the same time creating best practices to ensure accountability and reproducibility is important for experimentation and to create an optimal customer experience. Some of these include prompt versioning, model versioning and monitoring models as they go into production. Another important factor to consider while building an LLM or Generative AI assisted application, does it make sense to build smaller ML models that do classifications, summarizations, NER to reduce the ask from Generative models such that it can scale to larger traffic at lower latency and cost. Is the tradeoff higher development cycles or is it possible to build these models faster using LLM assisted training data? I will address how to answer these questions that come up in the lifecycle of a Generative AI driven application.<\/p>\n\n\n\n<div class=\"wp-block-buttons is-content-justification-center is-layout-flex wp-container-core-buttons-is-layout-d234f690 wp-block-buttons-is-layout-flex\" style=\"margin-top:var(--wp--preset--spacing--50);margin-bottom:var(--wp--preset--spacing--50)\">\n<div class=\"wp-block-button is-style-opik is-style-opik--4\"><a class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/www.comet.com\/site\/events\/convergence\/#register\">Register now<\/a><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"parent":12738,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"convergence","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","footnotes":""},"coauthors":[126],"class_list":["post-12810","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v25.9 (Yoast SEO v25.9) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Sanghamitra Deb - Comet<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.comet.com\/site\/convergence\/sanghamitra-deb\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Sanghamitra Deb\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.comet.com\/site\/convergence\/sanghamitra-deb\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-12T18:11:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/10\/Share-image-3.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1800\" \/>\n\t<meta property=\"og:image:height\" content=\"945\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n\t<meta name=\"twitter:label2\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data2\" content=\"engineering@atre.net\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Sanghamitra Deb - Comet","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.comet.com\/site\/convergence\/sanghamitra-deb\/","og_locale":"en_US","og_type":"article","og_title":"Sanghamitra Deb","og_url":"https:\/\/www.comet.com\/site\/convergence\/sanghamitra-deb\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_modified_time":"2025-06-12T18:11:53+00:00","og_image":[{"width":1800,"height":945,"url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/10\/Share-image-3.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@Cometml","twitter_misc":{"Est. reading time":"3 minutes","Written by":"engineering@atre.net"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.comet.com\/site\/convergence\/sanghamitra-deb\/","url":"https:\/\/www.comet.com\/site\/convergence\/sanghamitra-deb\/","name":"Sanghamitra Deb - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"datePublished":"2025-02-10T22:03:04+00:00","dateModified":"2025-06-12T18:11:53+00:00","breadcrumb":{"@id":"https:\/\/www.comet.com\/site\/convergence\/sanghamitra-deb\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.comet.com\/site\/convergence\/sanghamitra-deb\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.comet.com\/site\/convergence\/sanghamitra-deb\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"Convergence 2025","item":"https:\/\/www.comet.com\/site\/convergence\/"},{"@type":"ListItem","position":3,"name":"Sanghamitra Deb"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]}]}},"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/pages\/12810","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=12810"}],"version-history":[{"count":2,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/pages\/12810\/revisions"}],"predecessor-version":[{"id":16669,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/pages\/12810\/revisions\/16669"}],"up":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/pages\/12738"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=12810"}],"wp:term":[{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=12810"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}