帮助编写和检查PyTorch模型与训练代码,涵盖数据加载、实验可复现性、训练状态保存与恢复,并提供改善GPU显存占用和运行速度的方法。
- 编写与审查PyTorch训练代码
- 排查实验结果不一致的原因
- 改善加载速度与GPU显存占用
236 个 · 按相关度排序
帮助编写和检查PyTorch模型与训练代码,涵盖数据加载、实验可复现性、训练状态保存与恢复,并提供改善GPU显存占用和运行速度的方法。
Organize PyTorch models and data pipelines with PyTorch Lightning, automate training, save checkpoints, and track experiments. Includes templates and guidance for configuring training across multiple GPUs or TPUs.
中文简介正在准备中。当前显示英语简介。
Guides adapting OpenPI robot models to custom datasets and serving them to produce actions from observations. Covers JAX and PyTorch training, checkpoint conversion, and troubleshooting for normalization statistics and GPU memory.
中文简介正在准备中。当前显示英语简介。
Organize PyTorch training code with LightningModule and Trainer. This skill guides training, validation, logging, model checkpoint saving, early stopping when progress stalls, and configuration for running the same model across multiple GPUs.
中文简介正在准备中。当前显示英语简介。
Add a CUDA/C++ GPU operation to sgl-kernel using AOT, meaning compilation before use. Follow the implementation through PyTorch registration, Python API exposure, SGLang integration, correctness tests, and benchmarks that account for cache reuse.
中文简介正在准备中。当前显示英语简介。
Organize PyTorch training code with LightningModule and Trainer. Follow examples for validation, logging, model saving, and distributed training across multiple GPUs, with callbacks that add monitoring or stop training when progress stalls.
中文简介正在准备中。当前显示英语简介。
Optimize transformer attention, the calculation that relates tokens to one another, using Flash Attention. The skill guides PyTorch integration, GPU memory reduction, performance measurement, and output comparisons for training or inference with long sequences.
中文简介正在准备中。当前显示英语简介。
Integrate Flash Attention into transformer models to reduce processing time and GPU memory use for long sequences. Covers PyTorch integration, advanced attention options, and benchmarks that compare speed, memory use, and output accuracy.
中文简介正在准备中。当前显示英语简介。
Add PyTorch FSDP2 to training scripts so model state can be split across GPUs. Covers distributed initialization, mixed precision, CPU offloading, and checkpoint saving and loading for models that exceed a single GPU's memory.
中文简介正在准备中。当前显示英语简介。
Helps organize PyTorch model training with LightningModule and Trainer, including validation, logging, model saving, and early stopping. It also guides distributed training across multiple GPUs and settings for reduced-precision computation.
中文简介正在准备中。当前显示英语简介。
Build and optimize quantum circuits with PennyLane, including models that combine quantum circuits with PyTorch or JAX. Explore molecular energy estimation and optimization problems, validate values and gradients in simulation, and prepare tested circuits for provider plugins.
中文简介正在准备中。当前显示英语简介。
Get guidance on distributed training with PyTorch FSDP, which splits model parameters across devices. The skill covers implementation, mixed precision, moving data to CPU memory, communication setup, and debugging distributed training code.
中文简介正在准备中。当前显示英语简介。
Adapt PyTorch training scripts for multiple GPUs or machines with Accelerate. This skill guides code changes, configuration, and launch commands, including mixed precision, which combines numerical formats, and DeepSpeed or FSDP integration for distributed training.
中文简介正在准备中。当前显示英语简介。
Create and manage Volcano jobs and scheduling queues in KubeSphere. Use YAML templates for PyTorch, TensorFlow, MPI, and batch workloads, configure resource requests and execution policies, and investigate jobs that remain pending or fail to create pods.
中文简介正在准备中。当前显示英语简介。
Adapt existing PyTorch training scripts to use multiple GPUs or machines with limited code changes. The skill guides configuration, launch commands, mixed precision, which uses lower-precision numbers, and DeepSpeed or FSDP settings for distributing training work and memory.
中文简介正在准备中。当前显示英语简介。
Build graph neural networks, models that learn from connected nodes, with PyTorch Geometric. Supports node and graph classification, link prediction, custom datasets, and training approaches for large graphs or graphs containing multiple types of nodes and connections.
中文简介正在准备中。当前显示英语简介。
Adapt machine learning training to run across multiple GPUs or machines with Ray Train. Covers changes to existing code, comparing training settings with Ray Tune, and saving checkpoints so training can resume after failures.
中文简介正在准备中。当前显示英语简介。
Create a Chinese interview preparation guide for a focused machine learning or LLM topic, with formula derivations, PyTorch implementations, comparison tables, and 25 questions across three difficulty levels. The workflow reviews the content and renders it as HTML.
中文简介正在准备中。当前显示英语简介。
Track machine learning experiments with SwanLab by recording training settings, metrics, and media such as images and audio. Learn to compare runs, inspect training charts, and connect existing training code to local, cloud, or self-hosted dashboards.
中文简介正在准备中。当前显示英语简介。
Adapt existing PyTorch training scripts to run across multiple GPUs or machines with Accelerate. This skill covers device setup, distributed training configuration, and mixed precision, which uses lower-precision numbers to reduce memory use.
中文简介正在准备中。当前显示英语简介。
Helps adapt machine learning training to multiple GPUs and machines with Ray Train. Covers resource allocation, recovery from saved training states, and Ray Tune searches that compare settings such as learning rate and batch size.
中文简介正在准备中。当前显示英语简介。
Use TensorBoard to visualize training loss and accuracy, compare experiments, and inspect model structure. Includes PyTorch and TensorFlow logging examples for examining weight distributions, predictions, and performance bottlenecks during machine learning training.
中文简介正在准备中。当前显示英语简介。
Guides machine learning work from data preparation and model training to evaluation and production monitoring. Covers PyTorch, scikit-learn, experiment tracking, and reproducible workflows so teams can compare models and maintain them after deployment.
中文简介正在准备中。当前显示英语简介。
Use TensorBoard to visualize training loss and accuracy, compare experiments, and inspect model structure. Guides logging for PyTorch and TensorFlow, including weight distributions and performance profiling to investigate training problems and processing bottlenecks.
中文简介正在准备中。当前显示英语简介。