manual implementation of large language models
- LLM guidelines and resources: Awesome-LLM
- Reproduction of the ChatGPT technical roadmap from scratch: Zero-Chatgpt
- Complete LLM training pipeline: OLMo-core
- A practice from pretraining to DPO: Cortex
- Language Modeling from Scratch: Stanford CS336