Integrate Flash Attention into transformer models to reduce processing time and GPU memory use for long sequences. Covers PyTorch integration, advanced attention options, and benchmarks that compare speed, memory use, and output accuracy.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Speeding up transformer training on long sequences
- Reducing GPU memory use during attention
- Adding Flash Attention to a PyTorch model
davila7/claude-code-templates☆ 3.3만2026년 10월 21일 업데이트
Build data processing pipelines for machine learning, from preprocessing to batch predictions. Uses Ray Data to handle datasets larger than memory, distribute work across CPUs and GPUs, and feed data into training frameworks.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Preprocessing datasets larger than memory
- Running batch predictions across multiple GPUs
- Preparing image and tabular data for training
davila7/claude-code-templates☆ 3.3만2026년 10월 21일 업데이트
Adapt machine learning training to run across multiple GPUs or machines with Ray Train. Covers changes to existing code, comparing training settings with Ray Tune, and saving checkpoints so training can resume after failures.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Adapting existing PyTorch code for multiple GPUs
- Training HuggingFace models across multiple machines
- Comparing learning rates and batch sizes with Ray Tune
davila7/claude-code-templates☆ 3.3만2026년 10월 21일 업데이트
Turn a research experiment plan into training and evaluation code, run a small setup check, and launch GPU experiments. Collect initial metrics and update progress records so the results are ready for further review.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Implementing experiments from a written plan
- Checking a small run before full GPU experiments
- Collecting baseline and main-method results
wanshuiyin/Auto-claude-code-research-in-sleep☆ 1.8만2026년 10월 20일 업데이트
Guide MNN Metal backend development and optimization, from finding performance bottlenecks to changing GPU computation, combining operators, and adjusting execution scheduling. A task-based document index directs work toward relevant implementation rules, benchmarks, and correctness checks.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Finding bottlenecks in Metal inference
- Adding or modifying Metal kernels
- Combining operators into one GPU dispatch
alibaba/MNN☆ 1.6만2026년 10월 21일 업데이트
Build data processing pipelines for machine learning, from preprocessing to batch predictions. Uses Ray Data to handle datasets larger than memory, distribute work across CPUs and GPUs, and feed data into training frameworks.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Preprocessing datasets larger than memory
- Running batch predictions across multiple GPUs
- Preparing image and tabular data for training
Orchestra-Research/AI-Research-SKILLs☆ 1.4만2026년 10월 11일 업데이트
Helps adapt machine learning training to multiple GPUs and machines with Ray Train. Covers resource allocation, recovery from saved training states, and Ray Tune searches that compare settings such as learning rate and batch size.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Adapt existing PyTorch training to multiple GPUs
- Run HuggingFace training across multiple machines
- Compare learning rates and batch sizes with Ray Tune
Orchestra-Research/AI-Research-SKILLs☆ 1.4만2026년 10월 11일 업데이트
Guides reinforcement learning, where models learn from rewards, using torchforge and PyTorch. Covers reward design, custom loss functions, and distributed training so researchers can experiment with algorithms while keeping infrastructure concerns separate.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Train mathematical reasoning models with GRPO
- Experiment with custom loss functions
- Scale training across multiple GPUs or nodes
Orchestra-Research/AI-Research-SKILLs☆ 1.4만2026년 10월 11일 업데이트
Guides LLM fine-tuning with Axolotl, from YAML configuration and dataset formats to distributed training across GPUs. Covers LoRA and QLoRA, methods that train on preferences, multimodal support, and troubleshooting using documentation references and code examples.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Prepare YAML settings for LLM fine-tuning
- Explore LoRA, QLoRA, and preference training options
- Check dataset formats and input handling
Orchestra-Research/AI-Research-SKILLs☆ 1.4만2026년 10월 11일 업데이트
Guides LLM training with verl using rewards to improve model responses. Covers data preparation, reward functions, GRPO and PPO configuration, distributed GPU training, and troubleshooting memory shortages or unstable training.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Train math reasoning models with GRPO and answer-based rewards
- Configure PPO training with a separate value-estimation model
- Run large-model training across multiple GPU nodes
Orchestra-Research/AI-Research-SKILLs☆ 1.4만2026년 10월 11일 업데이트
Guides PyTorch model training and fine-tuning, from choosing architectures to configuring optimizers and learning rates. Provides troubleshooting steps for unstable loss and memory shortages, plus methods for improving GPU throughput and comparing experiments.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Choose model architectures for the available data type and scale
- Configure optimizers and learning-rate schedules
- Investigate loss spikes, NaNs, and GPU memory shortages
Orchestra-Research/AI-Research-SKILLs☆ 1.4만2026년 10월 11일 업데이트
Optimize transformer attention, the calculation that relates tokens to one another, using Flash Attention. The skill guides PyTorch integration, GPU memory reduction, performance measurement, and output comparisons for training or inference with long sequences.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Reducing GPU memory use with long sequences
- Integrating Flash Attention into PyTorch models
- Comparing runtime and outputs before and after changes
Orchestra-Research/AI-Research-SKILLs☆ 1.4만2026년 10월 11일 업데이트
Fine-tune vision models on custom images using Hugging Face Jobs cloud GPUs. Covers object detection, image classification, and segmentation—identifying image regions—with dataset validation, hardware selection, cost estimates, monitoring, and saving trained models to the Hub.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Train an object detector on custom images
- Fine-tune an image classifier
- Adapt SAM/SAM2 to custom image masks
huggingface/skills☆ 1.1만2026년 10월 9일 업데이트
Analyze GPU operation timings and execution traces to find costly data access, repeated computation, launch overhead, and synchronization waits. Check whether improving an individual operation actually reduces the time needed to complete a full request.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Investigating slow GPU operations
- Assessing whether combining operations reduces data access
- Checking pipeline dependencies and buffer reuse
bojieli/ai-infra-book☆ 6.8천2026년 10월 1일 업데이트
Structure PyTorch training code with PyTorch Lightning, separating model logic, data preparation, and training settings. Use templates and configuration examples to add checkpoints, experiment logs, and distributed training that runs across multiple GPUs or TPUs.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Restructuring PyTorch code into LightningModules
- Building reusable data preparation pipelines
- Configuring training across multiple GPUs or TPUs
foryourhealth111-pixel/Vibe-Skills☆ 3.8천2026년 10월 20일 업데이트
Prepare a public CodonFM v1 environment and download supported Encodon checkpoints, the files containing trained model weights. Covers container or host setup, GPU access checks, and verification of downloaded weights and configuration files.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Prepare a CodonFM development container
- Set up CodonFM directly on the host
- Download public Encodon model weights
NVIDIA/skills☆ 3.7천2026년 10월 21일 업데이트
Choose how to distribute tokens, the units a model processes, across MoE model experts during training. The guide compares alltoall, DeepEP, and HybridEP by GPU hardware, parallelism scale, memory needs, and optimization stage.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Choosing a MoE dispatcher for specific GPU hardware
- Establishing an alltoall baseline for initial setup
- Comparing DeepEP and HybridEP under matching conditions
NVIDIA/skills☆ 3.7천2026년 10월 21일 업데이트
Enable Megatron FSDP in Megatron-Bridge to distribute model training state across GPUs. Follow configuration and checkpoint requirements, investigate memory failures or performance regressions, and verify the setup with an existing two-GPU functional test.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Switch from DDP to Megatron FSDP
- Investigate memory failures after FSDP configuration changes
- Check checkpoint formats and incompatible settings
NVIDIA/skills☆ 3.7천2026년 10월 21일 업데이트
Helps configure training across multiple GPUs or machines in NeMo AutoModel. Guides strategy selection, YAML settings, and parallelism choices that split model computation or data, with constraints for large models, long sequences, and expert models.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Choosing a strategy for multi-GPU training
- Configuring parallelism for large models
- Splitting long input sequences across GPUs
NVIDIA/skills☆ 3.7천2026년 10월 21일 업데이트
Run training with mock or real data in Megatron-LM and Megatron Bridge, match their settings, and compare loss curves, which show training error over time. Includes recipes and multi-GPU examples for checking training behavior.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Compare Megatron-LM and Bridge loss curves
- Translate MLM command-line arguments into Bridge settings
- Check training on multiple GPUs
NVIDIA/skills☆ 3.7천2026년 10월 21일 업데이트
Build and troubleshoot custom plug-ins for workloads that doca-bench cannot measure with its built-in modes. Use the shipped CUDA example to guide shared-library construction, check loading and version compatibility, and verify a small test before larger runs.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Checking whether a workload needs a custom extension
- Building a GPU benchmark plug-in from the shipped example
- Diagnosing a custom shared library that will not load
NVIDIA/skills☆ 3.7천2026년 10월 21일 업데이트
Write and debug nvMolKit Python code for processing large molecule batches on GPUs. Covers molecular fingerprints, compact representations of molecular features, plus similarity calculations, 3D conformer generation, optimization, clustering, and molecular searches using RDKit objects.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Calculate fingerprints and similarities for large molecule libraries
- Generate and optimize batches of molecular conformers
- Cluster conformers by differences in their 3D structures
NVIDIA/skills☆ 3.7천2026년 10월 21일 업데이트
Get guidance on installing CUDA-Q, writing quantum processing functions, and choosing CPU or GPU simulation targets. Also covers connecting to quantum processors, running a Bell-state example, and selecting approaches for execution across multiple devices.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Installing CUDA-Q and checking a first example
- Choosing CPU or GPU simulation targets
- Writing and debugging Python quantum kernels
NVIDIA/skills☆ 3.7천2026년 10월 21일 업데이트
Metal/wgpu/WGSL shader surfaces for native Rust gpui apps (Zed-family, pd-console), stockpiled with beautiful copy-pasteable shader-toy examples. Use for custom GPU fragment passes behind/around gpui panes: ocean/water shaders, pixelated waves and boats, a living harbor, dithered chrome borders, sonar sweeps, aurora/starfields, CRT/scanline post. Trigger on: wgsl, wgpu, metal shader, gpui shader, shadertoy, fragment shader, SDF, noise/fbm, ordered dithering, pixelation, render-to-texture, "pixelated waves and boats", living harbor water. NOT for: web/GLSL/three.js shaders (use a web tool), non-shader gpui motion (use rust-gpui-motion), general GUI layout/color (use beautiful-gui-design), CLI/TUI (use beautiful-cli-design).
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
curiositech/windags-skills☆ 162026년 10월 19일 업데이트