Build data processing pipelines for machine learning, from preprocessing to batch predictions. Uses Ray Data to handle datasets larger than memory, distribute work across CPUs and GPUs, and feed data into training frameworks.
中文简介正在准备中。当前显示英语简介。
- Preprocessing datasets larger than memory
- Running batch predictions across multiple GPUs
- Preparing image and tabular data for training
Orchestra-Research/AI-Research-SKILLs☆ 1.4万2026年10月11日 更新
Answer Python questions and write code using examples fetched from pythonsheets.com. Find patterns for syntax, asynchronous tasks, networking, databases, machine learning, and distributed computing, or use topic-based questions to prepare for Python interviews.
中文简介正在准备中。当前显示英语简介。
- Preparing for Python interviews
- Learning asyncio through examples
- Writing a socket server
crazyguitar/pysheeet☆ 81612026年10月20日 更新
Use when training models across multiple GPUs or nodes, handling large models that don't fit in memory, or optimizing training throughput - covers DDP, FSDP, DeepSpeed ZeRO, model/data parallelism, and gradient checkpointingUse when ", " mentioned.
中文简介正在准备中。当前显示原文说明。
omer-metin/skills-for-antigravity☆ 1682026年1月22日 更新
Guides multi-GPU pre-training: DDP, FSDP2, ZeRO, tensor/pipeline/expert parallelism, fp8/Muon. Use when scaling a run, training MoE, or reproducing GPT-2 on rented GPUs.
中文简介正在准备中。当前显示原文说明。
vasilyu1983/AI-Agents-public☆ 1012026年10月16日 更新
Framework RLHF de alta performance com aceleração Ray+vLLM. Use para treinamento PPO, GRPO, RLOO, DPO de modelos grandes (7B-70B+). Construído em Ray, vLLM, ZeRO-3. 2× mais rápido que DeepSpeedChat com arquitetura distribuída e compartilhamento de recursos GPU.
中文简介正在准备中。当前显示原文说明。
artubss/SKILLS-CLAUDE-CODE☆ 112026年5月17日 更新
Fornece orientação para treinar LLMs com aprendizado por reforço usando verl (Volcano Engine RL). Use ao implementar RLHF, GRPO, PPO ou outros algoritmos de RL para pós-treinamento de LLMs em escala com backends de infraestrutura flexíveis.
中文简介正在准备中。当前显示原文说明。
artubss/SKILLS-CLAUDE-CODE☆ 112026年5月17日 更新
Treina modelos de linguagem grandes (2B-462B de parâmetros) usando NVIDIA Megatron-Core com estratégias avançadas de paralelismo. Use ao treinar modelos >1B de parâmetros, precisar de máxima eficiência de GPU (47% MFU em H100), ou necessitar de paralelismo tensor/pipeline/sequência/contexto/expert. Framework pronto para produção usado em Nemotron, LLaMA, DeepSeek.
中文简介正在准备中。当前显示原文说明。
artubss/SKILLS-CLAUDE-CODE☆ 112026年5月17日 更新
Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2
中文简介正在准备中。当前显示原文说明。
huang-sh/DeepScience☆ 42026年7月15日 更新
Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2
中文简介正在准备中。当前显示原文说明。
Lord1Egypt/awesome-skill-forge☆ 22026年6月10日 更新
Train, deploy, and manage neural networks with Flow Nexus in isolated E2B environments. Use custom architectures or ready-made templates, run predictions, monitor distributed training across multiple environments, and evaluate models before sharing them.
中文简介正在准备中。当前显示英语简介。
- Train an image classification model
- Forecast time series with LSTM
- Deploy a sentiment analysis template
ruvnet/ruflo☆ 7.7万2026年10月19日 更新
Create and manage Volcano jobs and scheduling queues in KubeSphere. Use YAML templates for PyTorch, TensorFlow, MPI, and batch workloads, configure resource requests and execution policies, and investigate jobs that remain pending or fail to create pods.
中文简介正在准备中。当前显示英语简介。
- Prepare distributed training jobs for PyTorch or TensorFlow
- Create MPI and batch processing jobs
- Configure queue capacity and scheduling weight
kubesphere/kubesphere☆ 1.7万2026年7月15日 更新
Train and deploy neural networks in distributed E2B sandboxes with Flow Nexus
中文简介正在准备中。当前显示原文说明。
ruvnet/RuVector☆ 45992026年10月19日 更新
Deep learning framework (PyTorch Lightning). Organize PyTorch code into LightningModules, configure Trainers for multi-GPU/TPU, implement data pipelines, callbacks, logging (W&B, TensorBoard), distributed training (DDP, FSDP, DeepSpeed), for scalable neural network training.
中文简介正在准备中。当前显示原文说明。
foryourhealth111-pixel/Vibe-Skills☆ 37292026年10月20日 更新
How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules across hardware and parallelism modes, container conventions, monitoring, and per-rank failure diagnosis.
中文简介正在准备中。当前显示原文说明。
NVIDIA/skills☆ 36562026年10月20日 更新
Set up infrastructure for fine-tuning LLMs with QLoRA, LoRA, and full fine-tuning using Hugging Face TRL, Axolotl, and distributed training with DeepSpeed or FSDP. Covers dataset prep, training runs, and model export.
中文简介正在准备中。当前显示原文说明。
BagelHole/DevOps-Security-Agent-Skills☆ 11682026年5月22日 更新
Train and deploy neural networks in distributed E2B sandboxes with Flow Nexus
中文简介正在准备中。当前显示原文说明。
ruvnet/agentic-flow☆ 8222026年10月12日 更新
Train and deploy neural networks in distributed E2B sandboxes with Flow Nexus
中文简介正在准备中。当前显示原文说明。
Microck/ordinary-claude-skills☆ 4062026年9月7日 更新
Train and deploy neural networks in distributed E2B sandboxes with Flow Nexus
中文简介正在准备中。当前显示原文说明。
ruvnet/midstream☆ 1492026年10月10日 更新
Train and deploy neural networks in distributed E2B sandboxes with Flow Nexus
中文简介正在准备中。当前显示原文说明。
ruvnet/agentdb☆ 932026年10月12日 更新
Orchestrate end-to-end machine learning pipelines using Prefect or Airflow with DAG construction, task dependencies, retry logic, scheduling, monitoring, and integration with MLflow, DVC, and feature stores for production ML workflows. Use when automating multi-step ML workflows from data ingestion to deployment, scheduling periodic model retraining, coordinating distributed training tasks, or managing retry logic and failure recovery across pipeline stages.
中文简介正在准备中。当前显示原文说明。
pjt222/agent-almanac☆ 422026年10月15日 更新
Framework PyTorch de alto nível com classe Trainer, treinamento distribuído automático (DDP/FSDP/DeepSpeed), sistema de callbacks e boilerplate mínimo. Escala de laptop para supercomputador com o mesmo código. Use quando quiser loops de treinamento limpos com boas práticas integradas.
中文简介正在准备中。当前显示原文说明。
artubss/SKILLS-CLAUDE-CODE☆ 112026年5月17日 更新
High-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate. Scales from laptop to supercomputer with same code. Use when you want clean training loops with built-in best practices.
中文简介正在准备中。当前显示原文说明。
ibragimov-oasis/vibe-coder☆ 32026年6月24日 更新
Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.
中文简介正在准备中。当前显示原文说明。
ibragimov-oasis/vibe-coder☆ 32026年6月24日 更新
Estimate cross-server traffic, network bottlenecks, and synchronization waits for AI training or inference. Map communication onto physical network paths and assess how topology or communication changes affect the time needed to complete the job.
中文简介正在准备中。当前显示英语简介。
- Find communication bottlenecks in distributed AI workloads
- Compare network topologies and communication paths
- Estimate synchronization waits under concurrent traffic
bojieli/ai-infra-book☆ 67592026年10月1日 更新