Ecole Centrale Paris, MIT. Twin of @shervinea. New book on Transformers & Large Language Models: superstudy.guide/

Joined August 2014
28 Photos and videos
Our new Stanford class "CME 296: Diffusion & Large Vision Models" is now available on YouTube!
11
177
1,607
60,508
• Training (pre-training, post-training, tuning, distillation, optimizations) • Common tricks (RoPE-based emebddings, noise schedule, curriculum learning) • Evaluation (FID, IS, LPIPS and feature-based metrics, Multimodal LLMs)
1
16
2,739
All lectures are posted on the "syllabus" page of the course website as they are released: cme296.stanford.edu/syllabus… Happy learning!
1
5
39
2,585
Afshine Amidi reposted
Our Stanford class "CME 295: Transformers & Large Language Models" is now available on YouTube!
2
20
94
6,746
Afshine Amidi reposted
Stanford University released the best cheatsheets you'll ever find to learn LLMs & Transformers! These cheatsheets cover: • Self-attention, Flash Attention, LoRA, SFT • Mixture of Experts, Distillation, Quantization • RAG, Agents, LLM-as-a-judge 100% Free and Open Source
13
236
1,405
134,184
Afshine Amidi reposted
Geminiの開発エンジニアが書いたスタンフォード講義資料「Transformer と大規模言語モデル」の日本語版 by @yoshiyukinakai これはがっつり読みたい。書籍紹介ページ superstudy.guide/transformer… と、無償のチートシートもある。github.com/afshinea/stanford…
2
211
1,413
105,766
Afshine Amidi reposted
Transformers & LLMs cheatsheets for Stanford's CME-295! Covering tokenization, self-attention, prompting, fine-tuning, LLM-as-a-judge, RAG, AI Agents, and reasoning models. 100% free and open-source.
20
202
1,146
101,607
Announcing the VIP Cheatsheet for Stanford's CME 295 Transformers & Large Language Models class. Topics include: - Transformers: self-attention, architecture, variants, optimization techniques (sparse attention, low-rank attention, flash attention) - LLMs: prompting, finetuning (SFT, LoRA), preference tuning, optimization techniques (mixture of experts, distillation, quantization) - Applications: LLM-as-a-judge, RAG, agents, reasoning models (train-time and test-time scaling from DeepSeek-R1)
1
6
24
3,607
This Spring, my twin brother @shervinea and I will be teaching a new class at Stanford called "Transformers & Large Language Models" (CME 295). The goal of this class is to understand where LLMs come from, how they are trained, and where they are most used. We will also explore more recent topics such as reasoning models and agentic workflows. We will be posting updates on the class website and uploading some relevant material in the coming weeks. For reference, a large portion of the class is based on our recent book "Super Study Guide: Transformers & Large Language Models". Stay tuned & happy learning!
2
5
42
3,351
Class website: cme295.stanford.edu
4
768
「Super Study Guide: Transformer と大規模言語モデル」日本語版が発売されました。250 ページにわたり約 600 点のカラーの図を交えて Transformer と LLM の詳細を解説しています。
1
4
8
1,806
内容は以下のとおりです。 - Transformer(仕組み、詳細な例) - LLM(事前学習、プロンプトエンジニアリング、ファインチューニング、プリファレンスチューニング、量子化などの最適化手法) - 応用(RAG、翻訳など)
1
4
734
Afshine Amidi reposted
Book Review Video : Super Study Guide: Transformers & Large Language Models by @afshinea & @shervinea 🙂 Video Link : youtube.com/watch?v=VLTj3Se3… #LLM #GenerativeAI #DataScience #MachineLearning #NLP
1
5
2,569
Afshine Amidi reposted
Transformers and LLMs have revolutionized AI by dramatically improving how machines understand and generate language. They excel at capturing context and meaning in text, enabling breakthroughs in applications like chatbots, translation, coding, and creative content generation. If you are looking to get into LLMs, then "Super Study Guide: Transformers & Large Language Model" by @shervinea and @afshinea is a must have study companion. The book is structured into five comprehensive parts: 1. Foundations: Offers a primer on neural networks and essential deep learning concepts related to training and evaluation. 2. Embeddings: Delves into tokenization algorithms, word embeddings like word2vec, and sentence embeddings using RNNs, LSTMs, and GRUs. 3. Transformers: Explores the motivation behind the self-attention mechanism, provides a detailed overview of the encoder-decoder architecture, and discusses variations such as BERT, GPT, and T5. It also includes tips on optimizing computations. 4. Large Language Models: Covers key techniques for tuning transformer-based models, including prompt engineering, parameter-efficient fine-tuning, and preference tuning. 5. Applications: Addresses common challenges like sentiment extraction, machine translation, and retrieval-augmented generation. This concise, illustrated guide is designed to deepen your understanding of LLMs, making it ideal for interviews, projects, or personal enrichment.
5
20
124
7,306
Afshine Amidi reposted
Folks although i have written books on machine learning (although not specifically on NLP but planning to) but this book is the best! This is not sponsored i purchased it with my own money This book is good because: - There is no other book which is as up to date - There is no book that has such good illustrations - This book does not have any extra irrelevant info - No excessive maths Here is the link to the book - superstudy.guide/transformer… Thanks to the author for such a nice book - @shervinea @afshinea
1
2
8
997
Afshine Amidi reposted
If you are looking to have a better understanding of LlMs and how they (really) work, do yourself a favor and get this book by @afshinea and @shervinea. It is amazing! It covers all the inportant concepts behind the Transformer architecture with deep learning foundations, tokenization techniques (what they are and how they are made), embeddings, fine-tuning and more. It’s of course packed with useful info and reminders for us in the field, but most importantly, it has one of the best and highest concentration of visual explanations of all time (I’d even say on par with the famous (also amazing) visuals of @JayAlammar’s visual transformer). If you feel like you are a “visual learner”, this one is for you. It’s also a really nice addition to the “Building LLMs for Production” book we released since this one does not focus on code but rather lays a nice and solid theoretical foundation that I still believe to be important for developing true expertise. Thanks for that amazing effort and book Afshine Amidi, Shervine Amidi :) #llms #ai #book
1
5
16
2,612
Afshine Amidi reposted
Really enjoying this visual study guide on Transformers and LLMs. It contains a very concise overview of the key concepts in Transformers and LLMs. Topics range from embeddings to attention mechanism to post-training techniques. Thanks for the great book @shervinea and @afshinea!
5
86
562
39,990