Skip to main content

AI on SageMaker HyperPod

Orchestrated by EKS

Initial cluster setup
AWS Trainium
Distributed Data Parallel
Fully Sharded Data Parallel
NVIDIA Megatron LM
Ray Train

Orchestrated by SLURM

Initial cluster setup
AWS Trainium
Distributed Data Parallel
Fully Sharded Data Parallel
NVIDIA Megatron LM

Introduction
Getting Started
EKS Blueprints
SLURM Blueprints
Sagemaker Hyperpod Recipes
Add-Ons
Validation and Testing
Infrastructure as a Code
Tips

EKS Blueprints
Fine Tuning
Preference Alignment
DPO

dpo

Coming Soon

This section is under development. DPO fine-tuning documentation will be available soon.

QLoRA (Quantized LoRA)

Docs

Orchestrated by EKS
Orchestrated by SLURM

Sites with Sagemaker AI content

Awsome Distributed Training
SageMaker HyperPod Recipes

Other AWS related sites

AWS Training & Certification
Amazon SageMaker HyperPod
AWS re:Post

Copyright © 2025 AWS WWSO ML Frameworks team. Built with ❤️ at AWS.