“megatron-lm”的搜索结果

Set up reinforcement learning, training guided by rewards, for language models with slime. The skill covers Megatron-LM training, SGLang response generation, data preparation, asynchronous execution, and custom workflows for agents that use tools across multiple turns.

中文简介正在准备中。当前显示英语简介。

• Prepare GRPO training for GLM or Qwen3 models
• Overlap response generation and model training
• Train agents with multi-turn tool use

指导通过评价回答的强化学习对大语言模型进行后训练。结合Megatron-LM与SGLang，涵盖数据准备、并行执行及自定义生成流程。

• 开始语言模型的GRPO训练
• 并行运行回答生成与训练
• 训练使用工具的智能体

Guide reinforcement learning, training models through rewards, with slime. Prepare data, configure Megatron-LM training and SGLang response generation, and set up asynchronous runs or custom multi-turn workflows for supported language models.

中文简介正在准备中。当前显示英语简介。

• Preparing reward-based training for GLM or Qwen models
• Overlapping response generation and training
• Training agents that use tools across multiple turns

Guides LLM training with verl using rewards to improve model responses. Covers data preparation, reward functions, GRPO and PPO configuration, distributed GPU training, and troubleshooting memory shortages or unstable training.

中文简介正在准备中。当前显示英语简介。

• Train math reasoning models with GRPO and answer-based rewards
• Configure PPO training with a separate value-estimation model
• Run large-model training across multiple GPU nodes

Guides large language model reinforcement learning with miles, covering environment setup, low-precision training, consistency between training and inference, and speculative decoding, where a smaller model proposes tokens for a larger model to verify.

中文简介正在准备中。当前显示英语简介。

• Configure reinforcement learning for large MoE models
• Investigate instability in FP8 training
• Set up speculative decoding for faster rollout generation

Fornece orientação para pós-treinamento de LLM com RL usando slime, um framework Megatron+SGLang. Use ao treinar modelos GLM, implementar fluxos de trabalho personalizados de geração de dados, ou precisar de integração estreita com Megatron-LM para escalabilidade em RL.

中文简介正在准备中。当前显示原文说明。

Provides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data generation workflows, or needing tight Megatron-LM integration for RL scaling.

中文简介正在准备中。当前显示原文说明。

Set up reinforcement learning, which trains models using rewards, with verl. Follow workflows for preparing data, configuring GRPO or PPO training, scaling across GPUs, and addressing memory errors or unstable training.

中文简介正在准备中。当前显示英语简介。

• Training a math reasoning model with GRPO
• Configuring PPO training with a critic model
• Scaling large model training across multiple nodes

Guides large language model reinforcement learning with miles, including MoE models that route work to specialized components. Covers low-precision training, matching training and inference behavior, and accelerating training response generation with draft models.

中文简介正在准备中。当前显示英语简介。

• Setting up reinforcement learning for large MoE models
• Configuring FP8 or INT4 training
• Checking consistency between training and inference

Run Megatron-LM (MLM) and Megatron Bridge training with mock or real data. Covers correlation testing, available recipes, and multi-GPU examples.

中文简介正在准备中。当前显示原文说明。

Test system for Megatron-LM. Covers test layout, recipe YAML structure, adding and running unit and functional tests, golden values, marker filters, and CI parity.

中文简介正在准备中。当前显示原文说明。

Linting and formatting for Megatron-LM. Covers running autoformat.sh, tools (ruff, black, isort, pylint, mypy), and code style rules.

中文简介正在准备中。当前显示原文说明。

How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules across hardware and parallelism modes, container conventions, monitoring, and per-rank failure diagnosis.

中文简介正在准备中。当前显示原文说明。

Fornece orientação para treinamento RL de nível empresarial usando miles, um fork pronto para produção do slime. Use ao treinar grandes modelos MoE com FP8/INT4, necessitando alinhamento treino-inferência ou exigindo RL especulativo para máxima taxa de transferência.

中文简介正在准备中。当前显示原文说明。

Provides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data generation workflows, or needing tight Megatron-LM integration for RL scaling.

中文简介正在准备中。当前显示原文说明。