Topic 1 Introduction to Large Language Models (LLM) and AI Agents
Overview of transformer architecture and attention mechanisms in LLMs
Introduction to AI agents
NLP applications Powered by LLM and AI agents
Use cases of LLMs and AI agents
Topic 2 Retrieval-Augmented Generation (RAG)
Introduction to Retrieval-Augmented Generation (RAG)
Use cases of RAG
Overview of tokenization and word embeddings
Overview of chunking strategies and vector databases
Build a RAG system
Topic 3: Fundamentals of Fine Tunning LLM
Fundamentals of LLM Fine Tuning
Supervised Fine-Tuning (SFT) for custom LLM Tasks
Parameter Efficient Fine Tuning (PEFT)
Low-Rank Adaptation (LoRA) for fine tuning LLM
Group Relative Policy Optimization (GRPO)
Reinforcement Learning (RT Learning) for fine tunning
Topic 4 Fine Tuning LLM Implementation and Deployments
Overview of Hugging Face Fine Tuning Libraries
Implementing Fine Tuning wiht Hugging Face Libraires
Using Hugging Face datasets and tokenizers for LLMs fine tunning
Deploying and testing Fine-Tuned models