Study Surveys

Study Surveys

• Training_LLMs
  • Model Compression
• Basic RL for LLMs
  • GRPO
    • GRPO Code slides
    • GRPO Code blog
• DSPy
• Lean Conjecturer
  
• Scaling Model Training and inference - Coming Soon!
  • NBDistributed <!– - Distributed Data Parallel - Coming Soon!
  • Zero 1 Modeling Strategy - Coming Soon!
  • Zero 2 Modeling Strategy - Coming Soon!
  • Zero 3 Modeling Strategy - Coming Soon!
  • Tensor Parallelism - Coming Soon!
  • Pipeline Parallelism - Coming Soon!
  • FP8 training - Coming Soon! –>