4 skills · sorted by relevance
Guide for selecting and configuring distributed training strategies in NeMo AutoModel, including FSDP2, Megatron FSDP, DDP, and parallelism settings.
The English summary is being prepared. Showing the original description.
Create and modify NeMo AutoModel training and evaluation recipes, including YAML structure, builders, and execution flow.
The English summary is being prepared. Showing the original description.
Guide for onboarding new model architectures into NeMo AutoModel, including architecture discovery, implementation patterns, registration, and validation.
The English summary is being prepared. Showing the original description.
Configure NeMo AutoModel job launches for interactive runs, Slurm clusters, and SkyPilot cloud execution.
The English summary is being prepared. Showing the original description.