82 skills · sorted by relevance
Guides LLM fine-tuning with Axolotl, from YAML configuration and dataset formats to distributed training across GPUs. Covers LoRA and QLoRA, methods that train on preferences, multimodal support, and troubleshooting using documentation references and code examples.
Answer Python questions and write code using examples fetched from pythonsheets.com. Find patterns for syntax, asynchronous tasks, networking, databases, machine learning, and distributed computing, or use topic-based questions to prepare for Python interviews.
Use when training models across multiple GPUs or nodes, handling large models that don't fit in memory, or optimizing training throughput - covers DDP, FSDP, DeepSpeed ZeRO, model/data parallelism, and gradient checkpointingUse when ", " mentioned.
The English summary is being prepared. Showing the original description.
Guides multi-GPU pre-training: DDP, FSDP2, ZeRO, tensor/pipeline/expert parallelism, fp8/Muon. Use when scaling a run, training MoE, or reproducing GPT-2 on rented GPUs.
The English summary is being prepared. Showing the original description.
Fornece orientação para treinar LLMs com aprendizado por reforço usando verl (Volcano Engine RL). Use ao implementar RLHF, GRPO, PPO ou outros algoritmos de RL para pós-treinamento de LLMs em escala com backends de infraestrutura flexíveis.
The English summary is being prepared. Showing the original description.
Framework RLHF de alta performance com aceleração Ray+vLLM. Use para treinamento PPO, GRPO, RLOO, DPO de modelos grandes (7B-70B+). Construído em Ray, vLLM, ZeRO-3. 2× mais rápido que DeepSpeedChat com arquitetura distribuída e compartilhamento de recursos GPU.
The English summary is being prepared. Showing the original description.
Treina modelos de linguagem grandes (2B-462B de parâmetros) usando NVIDIA Megatron-Core com estratégias avançadas de paralelismo. Use ao treinar modelos >1B de parâmetros, precisar de máxima eficiência de GPU (47% MFU em H100), ou necessitar de paralelismo tensor/pipeline/sequência/contexto/expert. Framework pronto para produção usado em Nemotron, LLaMA, DeepSeek.
The English summary is being prepared. Showing the original description.
Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2
The English summary is being prepared. Showing the original description.
Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2
The English summary is being prepared. Showing the original description.
Train, deploy, and manage neural networks with Flow Nexus in isolated E2B environments. Use custom architectures or ready-made templates, run predictions, monitor distributed training across multiple environments, and evaluate models before sharing them.
Create and manage Volcano jobs and scheduling queues in KubeSphere. Use YAML templates for PyTorch, TensorFlow, MPI, and batch workloads, configure resource requests and execution policies, and investigate jobs that remain pending or fail to create pods.
Train and deploy neural networks in distributed E2B sandboxes with Flow Nexus
The English summary is being prepared. Showing the original description.
Deep learning framework (PyTorch Lightning). Organize PyTorch code into LightningModules, configure Trainers for multi-GPU/TPU, implement data pipelines, callbacks, logging (W&B, TensorBoard), distributed training (DDP, FSDP, DeepSpeed), for scalable neural network training.
The English summary is being prepared. Showing the original description.
How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules across hardware and parallelism modes, container conventions, monitoring, and per-rank failure diagnosis.
The English summary is being prepared. Showing the original description.
Set up infrastructure for fine-tuning LLMs with QLoRA, LoRA, and full fine-tuning using Hugging Face TRL, Axolotl, and distributed training with DeepSpeed or FSDP. Covers dataset prep, training runs, and model export.
The English summary is being prepared. Showing the original description.
Train and deploy neural networks in distributed E2B sandboxes with Flow Nexus
The English summary is being prepared. Showing the original description.
Train and deploy neural networks in distributed E2B sandboxes with Flow Nexus
The English summary is being prepared. Showing the original description.
Train and deploy neural networks in distributed E2B sandboxes with Flow Nexus
The English summary is being prepared. Showing the original description.
Train and deploy neural networks in distributed E2B sandboxes with Flow Nexus
The English summary is being prepared. Showing the original description.
Orchestrate end-to-end machine learning pipelines using Prefect or Airflow with DAG construction, task dependencies, retry logic, scheduling, monitoring, and integration with MLflow, DVC, and feature stores for production ML workflows. Use when automating multi-step ML workflows from data ingestion to deployment, scheduling periodic model retraining, coordinating distributed training tasks, or managing retry logic and failure recovery across pipeline stages.
The English summary is being prepared. Showing the original description.
Framework PyTorch de alto nível com classe Trainer, treinamento distribuído automático (DDP/FSDP/DeepSpeed), sistema de callbacks e boilerplate mínimo. Escala de laptop para supercomputador com o mesmo código. Use quando quiser loops de treinamento limpos com boas práticas integradas.
The English summary is being prepared. Showing the original description.
High-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate. Scales from laptop to supercomputer with same code. Use when you want clean training loops with built-in best practices.
The English summary is being prepared. Showing the original description.
Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.
The English summary is being prepared. Showing the original description.
Use FedML for setup, CLI operations, MLOps launch, distributed and federated training, model serving, and workflow orchestration.
The English summary is being prepared. Showing the original description.