{"id":9117,"date":"2024-02-12T06:00:50","date_gmt":"2024-02-12T14:00:50","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/?p=9117"},"modified":"2025-05-08T10:19:27","modified_gmt":"2025-05-08T10:19:27","slug":"learning-path-to-building-llm-based-solutions-for-practitioner-data-scientists","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/learning-path-to-building-llm-based-solutions-for-practitioner-data-scientists\/","title":{"rendered":"Learning Path to Building LLM-Based Solutions\u200a-\u200aFor Practitioner Data Scientists"},"content":{"rendered":"\n

As everyone would agree, the advent of LLM has transformed the technology industry, and technocrats have had a huge surge of interest in learning about LLMs.<\/p>\n\n\n\n

Within a short time, technologies around LLMs have evolved so well, and different learning streams are catering to learners’ varying needs. This article primarily captures my understanding and my learning path to build LLM-based solutions.<\/p>\n\n\n\n

\"graphic
Img src<\/a><\/figcaption><\/figure>\n\n\n\n

 <\/p>\n\n\n\n

This article is more useful for practitioner data scientists who want to get into the LLM field and expand their scope of skills.<\/p>\n\n\n\n

So, let’s get started\u2026<\/p>\n\n\n\n

Proprietary vs Open Source LLMs<\/h4>\n\n\n\n

Though OpenAI’s ChatGPT is the leader among the LLM models and has revolutionized the industry with its offerings, open-source LLM ecosystems are rapidly evolving and are becoming as good as proprietary LLMs in terms of performance.<\/p>\n\n\n\n

Open-source LLMs, especially for data scientists, give a broader scope to learn and apply new things. The best resource to monitor the current status of open source LLMS is Hugging Face Open LLM Leaderboard, where the open source LLMs are ranked based on various evaluations.<\/p>\n\n\n\n

Open LLM Leaderboard – a Hugging Face Space by HuggingFaceH4<\/strong><\/a><\/p>\n\n\n\n

In this article, the learning path I explain is primarily associated with building large language model solutions based on open-source LLMs.<\/p>\n\n\n\n

Broad Streams of LLM Applications<\/h3>\n\n\n\n

Though LLM applications are vast, we can broadly categorize the LLM applications into the following streams:<\/p>\n\n\n\n

Prompt Engineering: <\/em><\/strong><\/h4>\n\n\n\n

This is the most basic and widely applicable one. Here, we primarily work with proprietary large language models such as ChatGPT. This is about learning the best way to compose the prompt messages so LLMs would give you the most appropriate answer.<\/p>\n\n\n\n

Data scientists may not have much scope here, as it is primarily about learning how to best use available chat-based LLM solutions.<\/p>\n\n\n\n

Langchain Integrations: <\/em><\/strong><\/h4>\n\n\n\n

Langchain is a framework built to interface large language model solutions with other technologies. Say you have a use case that requires you to feed the input from your database to large language models\u200a\u2014\u200athen you would need Langchain for integration. Langchain is very comprehensive, and its applications are evolving rapidly.<\/p>\n\n\n\n

\nhttps:\/\/python.langchain.com\/docs\/get_started\/introduction.html\n<\/div><\/figure>\n\n\n\n

Again, data scientists have limited scope here. Its primary applications are with engineers who build enterprise-scale solutions leveraging LLM outputs.<\/p>\n\n\n\n

Fine-tuning LLMs:<\/h4>\n\n\n\n

LLM fine-tuning is one of the exciting areas where we curate the dataset specific to our needs and tune the LLM models built by the providers. This has a broad scope of learning for data scientists, and it’s necessary to have a good grasp of the following concepts to excel here.<\/p>\n\n\n\n

 \u2192 Hugging Face Text Generation Pipeline: <\/em><\/strong>Hugging Face has become synonymous with large models, and they have built amazing libraries to aid the fine-tuning of pre-trained models.<\/p>\n\n\n\n

Also, please note that large language models are causal language models that generate responses by predicting the best words to complete the sentence. So, it is essential to have a good grasp of training a causal language model from scratch, and the article below is beneficial:<\/p>\n\n\n\n

Training a causal language model from scratch – Hugging Face NLP Course<\/strong><\/a><\/p>\n\n\n\n

 \u2192 PEFT, LORA, QLora concepts<\/em><\/strong>: Fine-tuning LLM models is not as straightforward as ‘transfer learning’ that we do with other models. Since we must deal with parameters in the billions scale, we must employ a more sophisticated process based on PEFT (Parameter Efficient Fine Tuning) concepts.<\/p>\n\n\n\n

The following videos and articles were very useful to learn about the mentioned concepts:<\/p>\n\n\n\n

Parameter-Efficient Fine-Tuning using \ud83e\udd17 PEFT<\/a><\/strong><\/p>\n\n\n\n

\n