Schedule
Foundation ModelsFall 2025
Study sheetHow models build perception of images and text, generation lets them create images and videos, and multimodal LLMs unify both.
- Advisor
-
Prof. Sangwoo MoPOSTECH IME
- Student Representative
-
Jian Choichjohn1105 [at] postech.ac.kr
- Location & Time
Science Building 4, Room 307
Wednesdays 22:00 – 23:00 KST
- 01 · Sessions 1–5Perception How models understand what they see and read: the basics of networks and Transformers, then seeing images and linking them with text.
- 02 · Sessions 6–7Generation How models create new content: generating images, then videos, from a text prompt.
- 03 · Sessions 8–9Multimodal LLMs How one model brings the two together: scaled-up LLMs, then multimodal LLMs that unify perception and generation.
See also Stanford CS231n Deep Learning for Computer Vision (Spring 2025) and MIT 6.S978 Deep Generative Models (Fall 2024).
| # | Date | Topic | Papers | Demo | Presenters | Slides |
|---|---|---|---|---|---|---|
| 1 | Deep learning primerneural networks, loss functions, SGD | MIT DL primer | 박채원, 이현수 | |||
| 2 | Transformerattention, next token prediction, language modeling | Transformer | annotated transformer | 고현민, 지은수 | ||
| 3 | Visual perceptionimage patches, self-supervised learning | ViTDINOv3 | DINOv3 applications | 이현수, 최주연 | ||
| 4 | Multimodal perceptionimage-text encoder (CLIP), text encoder (BERT) | CLIPBERT | CLIP semantic search | 최지안, 공현성 | ||
| 5 | Visual groundingopen-world detection, segmentation | GroundingDINOSAM | GDINOSAMSAM2 | 박선영, 박채원 | ||
| 6 | Image generationtext-to-image generation, diffusion, flow matching | SD3Diffusion=Flow | SD3Suno | 박주연, 김유진 | ||
| 7 | Video generationtext-to-video generation, world models | SoraVeo3 abilities | Veo3Genie3 | 이수겸, 장승현 | ||
| 8 | LLMs and scaling lawsscaling laws, emergent abilities, in-context learning | GPT-3scaling lawemergent abilities | Qwen3 | 이민주, 이수겸 | ||
| 9 | Multimodal LLMunified perception and generation | Cambrian-1Transfusion | Gemini 3 | 최지안, 최주연 |
Large Language ModelsSpring 2026
Study sheetHow LLMs are trained through pretraining and post-training, and from there they grow into agents that reason, remember, and act.
- Advisor
-
Prof. Sangwoo MoPOSTECH IME
- Student Representative
-
Jian Choichjohn1105 [at] postech.ac.kr
- Location & Time
Science Building 4, Room 307
Tuesdays 21:00 – 22:30 KST
- 01 · Sessions 1–5Training LLMs How an LLM is trained and used: pretraining, then prompting that puts it to good use, and post-training that aligns it with what people want.
- 02 · Sessions 6–9From LLMs to Agents How an LLM grows into an agent: reasoning over many steps, memory beyond a single context, then acting in a loop with tools.
See also Princeton COS 597R Deep Dive into Large Language Models (Fall 2024).
Review Sessions 2 and 8 of Fall 2025 (Transformer, LLMs and scaling laws)
| # | Date | Topic | Papers | Demo | Presenters | Slides |
|---|---|---|---|---|---|---|
| 1 | LLM reviewTransformer and LLM basics | why decoder-only? | ||||
| 2 | CoTchain-of-thought | CoTzero-shot CoTself-consistency | 김승호, 정윤 | |||
| 3 | SFTinstruction fine-tuning | FLANFLAN-T5LIMA | 박채원, 임성은 | PDF 1, 2 | ||
| 4 | RLHFreinforcement learning, human feedback | RLHFInstructGPT | 양광모, 안준서 | |||
| 5 | RLAIF (rubric)alignment, rubric-based RL | HHConstitutional AI | 이수겸, 최주연 | PDF 1, 2 | ||
| 6 | Reasoning modelstest-time scaling, reward model (verifier) | test-time scalePRMDeepSeek-R1 | 고현민, 지은수 | |||
| 7 | Long contextcontext extension, efficient attention, attention sink | lost in the middleStreamingLLM | 장세림, 정민호 | |||
| 8 | RAGretrieval-augmented generation | RAGlong-context vs RAG | 최지안, 진동환 | PDF 1, 2 | ||
| 9 | Agenttool-augmented LLM, autonomous agent | ReActToolformer | OpenClaw | 이현수, 박선영 |
Deep LearningSummer 2026
Study sheetHow architectures are designed and trained, representation and generation model data, and generalization carries them to new data.
- Advisor
-
Prof. Sangwoo MoPOSTECH IME
- Student Representative
-
Jian Choichjohn1105 [at] postech.ac.kr
- Location & Time
Science Building 4, Room 307
Tuesdays 15:30 – 16:30 KST
- 01 · Sessions 1–3Architectures and Training How deep networks are built and trained: backpropagation first, then architectures with the right inductive bias for each data type.
- 02 · Sessions 4–7Representation and Generation How networks model data: they encode it into representations and decode them into new samples.
- 03 · Sessions 8–10Generalization and Theory How models generalize beyond the training data: to shifted distributions and new tasks, and why this works at all.
Based on MIT 6.7960 Deep Learning (Fall 2025).
| # | Date | Topic | Lectures | Presenters | Slides |
|---|---|---|---|---|---|
| 1 | Training neural networksbackpropagation, computational graph | Lec 2 | 최지안 | ||
| 2 | Architectures: GridCNN, neural field | Lec 4 | 정윤 | ||
| 3 | Architectures: SequenceRNN, Transformer | Lec 5, 6 | |||
| 4 | Representation Learning: Reconstruction-basedMAE, BERT | Lec 8 | 진동환 | ||
| 5 | Representation Learning: Similarity-basedcontrastive learning | Lec 9, 10 | 장연종 | ||
| 6 | Generative Models: VAE and GANVAE, GAN | Lec 13, 14 | 오승준 | PDF 1, 2 | |
| 7 | Generative Models: Diffusion and Flowsdiffusion, flow | Lec 16 | 최지안 | ||
| 8 | Generalizationdistribution shift | Lec 17 | 김도연 | ||
| 9 | Transfer Learningfine-tuning, few-shot, meta-learning | Lec 18 | 오승준 | ||
| 10 | OptionalDL Theoryuniversal approximation, generalization bounds | Lec 3, 7 | 박채원 |
Physical AIFall 2026
Study sheetHow robots learn to do what humans do with arms and legs, and foundation models help them perceive and plan.
- Advisor
-
Prof. Sangwoo MoPOSTECH IME
- Student Representative
-
Jian Choichjohn1105 [at] postech.ac.kr
- Location & Time
Science Building 4, Room 302
Tuesdays 21:00 – 22:00 KST
- 01 · Sessions 1–6Robot Embodiment How robot tasks mirror human abilities: arms that grasp, legs that walk, a sense of where to go, and humanoid bodies with dexterous hands, all learned from data.
- 02 · Sessions 7–11Foundation Models for Robotics How foundation models help robots act: an understanding of 3D space, vision and language turned into action, and world models that bring perception and planning.
See also Berkeley CS 294-277 Robots That Learn (Spring 2026) and Berkeley CS 294-43 Large Scale Vision, Language, and Action Models (Fall 2025).
| # | Date | Topic | Papers | Demo | Presenters | SlidesLab |
|---|---|---|---|---|---|---|
| 1 | Data sourcesteleoperation, simulation, human video | OXERoboCasaEgo4D | 최지안, 김하은 | PDF 1, 2Lab | ||
| 2 | Manipulationimitation learning, action chunking, diffusion policy | ALOHADiffusion Policy | LeRobot | 김재원, 고정윤 | PDF 1, 2 | |
| 3 | Locomotionprivileged information, proprioception, exteroception | RMAperceptive locomotion | MuJoCo Playground | 진동환, 정윤 | PDF 1, 2Lab | |
| 4 | Navigationgoal-conditioned navigation, topological map, SLAM | Active Neural SLAMViNT | OmniVLA | 이수겸, 유소은 | PDF 1, 2 | |
| 5 | Humanoidwhole-body control, motion retargeting, tracking | DeepMimicOmniRetarget | ASAP | 최원준, 윤서현 | PDF 1, 2 | |
| 6 | Dexterous manipulationin-hand manipulation, visuo-tactile | Visual Dexterity3D-ViTac | T-Rex | 이지윤, 윤서현 | PDF 1, 2 | |
| 7 | 3D representationray tracing, rasterization | NeRF3DGS | SuperSplat | 안준서, 김태하 | ||
| 8 | 3D reconstructionmulti-view geometry, feed-forward 3D | DUSt3RVGGT | VGGT-Ω | 김나령, 이유찬 | ||
| 9 | Spatial reasoningvisual grounding, affordance | SpatialVLMRoboPoint | MolmoPoint | 최진현, 김태경 | ||
| 10 | VLAvision-language-action, action tokenization, flow matching | SayCanOpenVLAπ0 | π0.7 | 최지안, 정윤 | ||
| 11 | World modelmodel-based RL, latent dynamics | DreamerV3DreamDojo | DreamDojo | 진동환, 신예원 | ||
| A1 | OptionalRLpolicy gradient, on-policy, off-policy | PPOSAC | ||||
| A2 | OptionalSim-to-realdomain randomization, system identification | domain randomizationactuator network | ||||
| A3 | OptionalControloptimal control, MPC | PETSTD-MPC2 | ||||
| A4 | Optional3D data structurespoint cloud, voxel, mesh, surfel | PointNetVoxelNetMeshCNN |