Skip to main content

AI on SageMaker HyperPod

Orchestrated by EKS

Initial cluster setup
AWS Trainium
Distributed Data Parallel
Fully Sharded Data Parallel
NVIDIA Megatron LM
Ray Train

Orchestrated by SLURM

Initial cluster setup
AWS Trainium
Distributed Data Parallel
Fully Sharded Data Parallel
NVIDIA Megatron LM

Introduction
Getting Started
EKS Blueprints
SLURM Blueprints
- Training
- Fine Tuning
  - PEFT
  - Preference Alignment
    - DPO
    - PPO
    - GRPO
Sagemaker Hyperpod Recipes
Add-Ons
Validation and Testing
Infrastructure as a Code
Tips

SLURM Blueprints
Fine Tuning
Preference Alignment
PPO

ppo

Coming Soon

This section is under development. PPO fine-tuning documentation will be available soon.

Docs

Orchestrated by EKS
Orchestrated by SLURM

Sites with Sagemaker AI content

Awsome Distributed Training
SageMaker HyperPod Recipes

Other AWS related sites

AWS Training & Certification
Amazon SageMaker HyperPod
AWS re:Post

Copyright © 2025 AWS WWSO ML Frameworks team. Built with ❤️ at AWS.