A free course for learners who want to go from math and Python basics to building, training and deploying large language models. It is split into three tracks: optional fundamentals, the LLM Scientist for building models, and the LLM Engineer for creating and deploying LLM applications.
The Scientist track covers architecture, pre-training, supervised fine-tuning, preference alignment, evaluation and quantization. The Engineer track covers running LLMs, vector storage, retrieval-augmented generation, agents, inference optimization, deployment and security. Topics link to Colab notebooks and articles by the author, and the repository also lists tools such as evaluation and model-merging notebooks.
Categories
Similar apps
Open-source library of community AI prompts, formerly Awesome ChatGPT Prompts
Open-source AI agent, agent skill and RAG app examples to run and adapt
Companion code for building a GPT-style language model in PyTorch step by step