Evaluate language models with over 100 benchmark tests covering knowledge, math, coding, safety, and image understanding. Configure runs on Docker, Slurm computing clusters, or cloud infrastructure, compare models, and export results.
中文简介正在准备中。当前显示英语简介。
- Compare models using the same benchmark tests
- Run large evaluations on a Slurm cluster
- Evaluate safety and image understanding
davila7/claude-code-templates☆ 3.3万2026年10月18日 更新
Evaluate language models on knowledge, math, coding, safety, and image understanding benchmarks. The skill guides reproducible runs in containers using local Docker, Slurm clusters, or cloud execution, with shared configurations for model comparison and result export.
中文简介正在准备中。当前显示英语简介。
- Comparing models on the same benchmark tasks
- Running a small evaluation sample before a full benchmark
- Running large evaluations on a Slurm cluster
Orchestra-Research/AI-Research-SKILLs☆ 1.4万2026年10月11日 更新
Diagnostic-only skill for Slurm scheduler and node-daemon issues on Amazon SageMaker HyperPod Slurm clusters. Scope mirrors the HyperPod troubleshooting guide. Invoke when the user reports a Slurm node stuck in down/drain, "Node unexpectedly rebooted" after auto-repair, slurmd not running, jobs stuck PENDING with REASON=Resources while sinfo shows idle nodes, jobs stuck COMPLETING after node replacement, GRES/GPU counts wrong, scontrol ping failing, slurmctld unresponsive, an Action:Reboot/Replace request that did not trigger HyperPod auto-recovery, or auto-resume not restarting a job. Also triggers on "drain before reboot", "diagnose a Slurm node", "investigate stuck jobs."
中文简介正在准备中。当前显示原文说明。
awslabs/agent-plugins☆ 9242026年10月15日 更新
Set up large language model pretraining with TorchTitan and PyTorch. Configure training across multiple GPUs, combine four ways of splitting the workload, enable Float8 calculations on H100 hardware, and manage checkpoints for saving and resuming training.
中文简介正在准备中。当前显示英语简介。
- Pretraining Llama 3.1 8B on a single node
- Launching training across multiple nodes with SLURM
- Configuring Float8 training for H100 GPUs
NousResearch/hermes-agent☆ 25.5万2026年10月19日 更新
Configure large language model pretraining with torchtitan across multiple GPUs. Covers ways to split training work, launch jobs on computing clusters, enable Float8 numerical processing, and save or resume training through distributed checkpoints.
中文简介正在准备中。当前显示英语简介。
- Pretraining Llama 3.1 8B on eight GPUs
- Configuring multi-node training with SLURM
- Enabling Float8 training on H100 GPUs
davila7/claude-code-templates☆ 3.3万2026年10月18日 更新
Configure large language model pretraining with torchtitan across multiple GPUs. Covers ways to split training work, launch jobs on computing clusters, enable Float8 numerical processing, and save or resume training through distributed checkpoints.
中文简介正在准备中。当前显示英语简介。
- Pretraining Llama 3.1 8B on eight GPUs
- Configuring multi-node training with SLURM
- Enabling Float8 training on H100 GPUs
Orchestra-Research/AI-Research-SKILLs☆ 1.4万2026年10月11日 更新
Prepare and launch nf-core/pacsomatic workflows for matched tumor and normal PacBio HiFi samples. Generate sample sheets and launch files from unaligned BAM inputs, run local checks, submit cluster launchers, and troubleshoot startup failures.
中文简介正在准备中。当前显示英语简介。
- Prepare sample sheets for matched tumor and normal samples
- Review generated launch files with a dry run
- Submit a Nextflow launcher to a computing cluster
K-Dense-AI/scientific-agent-skills☆ 5.3万2026年10月16日 更新
Inspect CPU, memory, disk, and accelerator information alongside container and scheduler limits. Produce a JSON snapshot with identifying details removed and conservative worker and memory estimates for planning local workloads, without running stress tests.
中文简介正在准备中。当前显示英语简介。
- Choosing worker counts before a large local job
- Checking CPU and memory limits inside a container
- Comparing resource snapshots before and after changes
K-Dense-AI/scientific-agent-skills☆ 5.3万2026年10月16日 更新
Build, run, and troubleshoot data processing pipelines with Nextflow and nf-core. The skill guides modular workflow development, input preparation, testing, cached restarts, and configuration for local computers, computing clusters, or cloud environments.
中文简介正在准备中。当前显示英语简介。
- Run an nf-core workflow with a samplesheet
- Build and test reusable DSL2 modules
- Investigate failed runs and restart with cached results
K-Dense-AI/scientific-agent-skills☆ 5.3万2026年10月16日 更新
Plan and troubleshoot large language and vision model training and inference. This guide uses hardware measurements to identify bottlenecks, address memory shortages and unstable training, and improve checkpointing, recovery, and performance across multiple GPUs and machines.
中文简介正在准备中。当前显示英语简介。
- Diagnosing slow training and GPU memory shortages
- Investigating loss spikes and invalid numerical values
- Debugging communication hangs across GPUs and machines
stas00/ml-engineering☆ 2万2026年10月17日 更新
Manage GPU compute jobs on Qizhi through a command-line tool. Find available nodes, submit distributed training runs, launch batches with different parameter combinations, and inspect, monitor, or stop jobs across workspaces.
中文简介正在准备中。当前显示英语简介。
- Finding available GPU nodes across workspaces
- Submitting distributed training jobs
- Launching evaluation batches with different parameter combinations
wanshuiyin/Auto-claude-code-research-in-sleep☆ 1.8万2026年10月17日 更新
Convert single-node scripts to multi-node Slurm sbatch jobs and debug common multi-node failures. Covers srun-native vs uv run torch.distributed approaches, container setup, NCCL timeouts, OOM sizing for MoE models, and interactive allocation.
中文简介正在准备中。当前显示原文说明。
NVIDIA/skills☆ 36462026年10月18日 更新
How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules across hardware and parallelism modes, container conventions, monitoring, and per-rank failure diagnosis.
中文简介正在准备中。当前显示原文说明。
NVIDIA/skills☆ 36462026年10月18日 更新
Use when the user asks to run, submit, monitor, or cancel a job on a remote machine over SSH — their own GPU/CPU server, a workstation, or a Slurm cluster ("the cluster", a login node, "my 3090 box", "the compute server"). Picks a saved machine, runs the work directly over SSH (or via Slurm when present), tracks it, and fetches results back into the workspace.
中文简介正在准备中。当前显示原文说明。
ai4s-research/open-science☆ 19022026年10月14日 更新
Diagnose and remediate per-node issues on a HyperPod cluster (EKS or Slurm) — a specific node is unhealthy, unresponsive, stuck, or needs replacing. Covers on-node EFA, GPU / accelerator hardware (XID, ECC, NVLink, row-remap, DCGM), Slurm node down/drained, disk and memory pressure, per-node lifecycle-script failures, SSM agent, container runtime, kernel panics, pod networking. Read-only. Not for cluster-wide provisioning (→ hyperpod-cluster-debugger), NCCL (→ hyperpod-nccl), or MFU (→ hyperpod-mfu-debugger).
中文简介正在准备中。当前显示原文说明。
awslabs/agent-plugins☆ 9242026年10月15日 更新
Avalia LLMs em 100+ benchmarks de 18+ harnesses (MMLU, HumanEval, GSM8K, segurança, VLM) com execução multi-backend. Use quando precisar de avaliação escalável em Docker local, HPC Slurm ou plataformas cloud. Plataforma enterprise-grade da NVIDIA com arquitetura container-first para benchmarking reproduzível.
中文简介正在准备中。当前显示原文说明。
artubss/SKILLS-CLAUDE-CODE☆ 112026年5月17日 更新
Evaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution. Use when needing scalable evaluation on local Docker, Slurm HPC, or cloud platforms. NVIDIA's enterprise-grade platform with container-first architecture for reproducible benchmarking.
中文简介正在准备中。当前显示原文说明。
huang-sh/DeepScience☆ 42026年7月15日 更新
ConoHa VPS3 CLIによるインフラ構築スキル。サーバー作成、アプリデプロイ、 Kubernetesクラスター、OpenStackプラットフォーム、Slurmクラスターの構築を支援。 「ConoHaでサーバーを作って」「k8sクラスターを構築して」「アプリをデプロイして」 などのリクエストでトリガー。
中文简介正在准备中。当前显示原文说明。
crowdy/conoha-cli☆ 22026年7月7日 更新
Prepare reproducible setup instructions and validate a user-managed named software environment on an Open-Science SSH Compute Host, including direct SSH and Slurm hosts. Use when a remote job needs packages, modules, cache variables, or a repeatable activation that the host does not already provide.
中文简介正在准备中。当前显示原文说明。
aipoch/open-science☆ 52592026年10月19日 更新
Configure NeMo AutoModel job launches for interactive runs, Slurm clusters, and SkyPilot cloud execution.
中文简介正在准备中。当前显示原文说明。
NVIDIA/skills☆ 36462026年10月18日 更新
Use when the user asks to run heavy or GPU work on Modal (the cloud compute platform) — writing a Modal function in the workspace, running it with the user's own `modal` CLI + token, and bringing results back. Data-to-compute for jobs too big for the laptop, without a Slurm cluster.
中文简介正在准备中。当前显示原文说明。
ai4s-research/open-science☆ 19022026年10月14日 更新
Read-only evo run reporting. Use when the user invokes /evo:report, asks what happened overnight, asks what improved recently, asks for the best/frontier candidates, asks for a quick score chart without opening the dashboard, or wants the scatter plot in chat output. Never run benchmarks, gates, Slurm commands, evo run, or ad-hoc verification scripts for report requests.
中文简介正在准备中。当前显示原文说明。
evo-hq/evo☆ 14752026年10月5日 更新
Diagnose NCCL failures and adjacent training-pod failures on HyperPod GPU clusters (EKS or Slurm) — training hangs, AllReduce / collective-op timeouts, EFA or libfabric errors, rendezvous failures, EFA TCP fallback, /dev/shm or memlock issues, NCCL version mismatch across pods, container OOM / exit-137 / OOMKilled, GPU OOM (CUDA out of memory), CrashLoopBackOff / Pending pods, MASTER_ADDR DNS, NetworkPolicy blocking. Not for single-node hardware faults (→ hyperpod-node-debugger § G) or cluster-creation EFA / SSM failures (→ hyperpod-cluster-debugger § A / § F).
中文简介正在准备中。当前显示原文说明。
awslabs/agent-plugins☆ 9242026年10月15日 更新
Generate comprehensive issue reports from HyperPod clusters (EKS and Slurm) by collecting diagnostic logs and configurations for troubleshooting and AWS Support cases. Use when users need to collect diagnostics from HyperPod cluster nodes, generate issue reports for AWS Support, investigate node failures or performance problems, document cluster state, or create diagnostic snapshots. Triggers on requests involving issue reports, diagnostic collection, support case preparation, or cluster troubleshooting that requires gathering logs and system information from multiple nodes.
中文简介正在准备中。当前显示原文说明。
awslabs/agent-plugins☆ 9242026年10月15日 更新