Hands-on Modern AI and Physical AI courses accelerated by AMD GPUs.
This repository brings together popular Deep Learning, Computer Vision, LLM, and Physical AI topics as runnable notebooks. The course content is validated on AMD hardware and includes straightforward Docker environments where applicable.
The Physical AI curriculum forms a complete learning path from physical simulation to embodied intelligence and deployment:
| Track | Course | What you will build | Demo |
|---|---|---|---|
| Physical Simulation | Genesis Simulation | Load and control a Franka Panda, tune PD controllers, solve inverse kinematics, execute pick-and-place, and scale to parallel GPU environments. |  |
| MuJoCo + PyTorch | Build Gymnasium environments, collect demonstrations, train behavior cloning and PPO policies, fine-tune SmolVLA, and explore cross-domain reinforcement learning. |  |
|
| MuJoCo MJX | Learn MJCF, robot control, and inverse kinematics before scaling to JIT-compiled parallel rollouts, domain randomization, and Playground PPO. |  |
|
| Real Deployment | Robot Policy Deployment | Teleoperate a real SO-101 arm, record a LeRobot dataset, train ACT from scratch, and fine-tune SmolVLA for autonomous manipulation. |  |
| ROS2 Deployment | Build maps with stereo depth and RTAB-Map, explore autonomously, localize with Nav2, and drive a LeKiwi to task-specific goals. |  |
Physical AI is supported by a full progression through computer vision, deep learning, and language models:
| Course | Journey |
|---|---|
| Computer Vision | Image classification and ResNet → object detection → segmentation and SAM → tracking → VAE and diffusion models |
| Deep Learning | PCA, SVM, clustering, and trees → neural networks and CNNs → Word2Vec, autoencoders, Seq2Seq, GANs, and Transformers |
| LLM from Scratch | Tensor fundamentals and autograd → tokenization and attention → FlashAttention, MoE, LoRA, training, KV cache, and a Tiny LLaMA capstone |
The labs can be run locally using the provided notebooks and environment instructions. Selected courses also integrate with AUP Learning Cloud, which provides pre-built Jupyter environments with AMD GPU acceleration through ROCm.
- Browse the hosted course portal: amdresearch.github.io/aup-teaching-labs
- Learn about the cloud platform: AUP Learning Cloud documentation
AUP would like to thank the following universities, professors, and labs. This teaching content was made possible through the joint efforts of these partners.
| University | Professors and Labs | Course Contributions |
|---|---|---|
| National Taiwan University | Prof. Chun-Yi Lee, ELSA Lab | DL, CV |
| Nanjing University | Prof. Jingwei Xu, NJUDeepEngine | LLM |
| National Yang Ming Chiao Tung University | Prof. Ping-Chun Hsieh, Reinforcement Learning and Bandits Lab | Physical AI, Reinforcement Learning on MuJoCo |
We also thank the open-source projects that make these labs possible, including Genesis and MuJoCo.
Lab notebooks retain the copyright and license terms from their source projects. See individual notebooks and project folders for details.
Copyright (C) 2026 Advanced Micro Devices, Inc. All rights reserved. Portions of this file consist of AI-generated content. SPDX-License-Identifier: MIT