Merge multiple fine-tuned models using mergekit to combine capabilities without retraining. Use when creating specialized models by blending domain-specific expertise (math + coding + chat), improving performance beyond single models, or experimenting rapidly with model variants. Covers SLERP, TIES-Merging, DARE, Task Arithmetic, linear merging, and production deployment strategies.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Train Mixture of Experts (MoE) models using DeepSpeed or HuggingFace. Use when training large-scale models with limited compute (5× cost reduction vs dense models), implementing sparse architectures like Mixtral 8x7B or DeepSeek-V3, or scaling model capacity without proportional compute increase. Covers MoE architectures, routing mechanisms, load balancing, expert parallelism, and inference optimization.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Reduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT. Use when compressing models without retraining, achieving 50% sparsity with minimal accuracy loss, or enabling faster inference on hardware accelerators. Covers unstructured pruning, structured pruning, N:M sparsity, magnitude pruning, and one-shot methods.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Provides guidance for interpreting and manipulating neural network internals using nnsight with optional NDIF remote execution. Use when needing to run interpretability experiments on massive models (70B+) without local GPU resources, or when working with any PyTorch architecture.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
High-performance reinforcement learning framework optimized for speed and scale. Use when you need fast parallel training, vectorized environments, multi-agent systems, or integration with game environments (Atari, Procgen, NetHack). Achieves 2-10x speedups over standard implementations. For quick prototyping or standard algorithm implementations with extensive documentation, use stable-baselines3 instead.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
High-performance RLHF framework with Ray+vLLM acceleration. Use for PPO, GRPO, RLOO, DPO training of large models (7B-70B+). Built on Ray, vLLM, ZeRO-3. 2× faster than DeepSpeedChat with distributed architecture and GPU resource sharing.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
This skill should be used at the start of any computationally intensive scientific task to detect and report available system resources (CPU cores, GPUs, memory, disk space). It creates a JSON file with resource information and strategic recommendations that inform computational approach decisions such as whether to use parallel processing (joblib, multiprocessing), out-of-core computing (Dask, Zarr), GPU acceleration (PyTorch, JAX), or memory-efficient strategies. Use this skill before running analyses, training models, processing large datasets, or any task where resource constraints matter.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Package agent-generated scientific code, figures, tables, data, logs, and conclusions into a navigable workspace result with stable paths and a concise manifest. Use near the end of computational tasks.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Train Physics-Informed Neural Networks (PINNs) using DeepXDE. Solve forward and inverse PDE problems by embedding physics equations into the neural network loss function. Supports 1D/2D/3D, time-dependent, and parametric PDEs.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Comprehensive Python library for astronomy and astrophysics. This skill should be used when working with astronomical data including celestial coordinates, physical units, FITS files, cosmological calculations, time systems, tables, world coordinate systems (WCS), and astronomical data analysis. Use when tasks involve coordinate transformations, unit conversions, FITS file manipulation, cosmological distance calculations, time scale conversions, or astronomical data processing.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Nonlinear curve fitting for physics data with proper error propagation, chi-squared analysis, residual diagnostics, confidence intervals, and model comparison (AIC/BIC). Use for any parameter extraction from experimental or simulation data.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision without needing calibration datasets, for fast quantization workflows, or when deploying with vLLM or HuggingFace Transformers.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
RNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux Foundation AI project. Production at Windows, Office, NeMo. RWKV-7 (March 2025). Models up to 14B parameters.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, or tracking training progress. Industry standard used by EleutherAI, HuggingFace, and major labs. Supports HuggingFace, vLLM, APIs.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Compress large language models using knowledge distillation from teacher to student models. Use when deploying smaller models with retained performance, transferring GPT-4 capabilities to open-source models, or reducing inference costs. Covers temperature scaling, soft targets, reverse KLD, logit distillation, and MiniLLM training strategies.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Rigorous methodology for evaluating ML models on established benchmarks. Covers proper train/val/test splits, baseline verification from original papers, exact metric formula discrepancies, data-leak detection checklist, multi-seed robustness, and honest reporting templates. Use when claiming to beat published baselines, writing methods papers, or auditing existing results.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Expert guidance for GRPO/RL fine-tuning with TRL for reasoning and task-specific model training
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow - framework-agnostic ML lifecycle platform
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
This skill should be used when working with genomic interval data (BED files) for machine learning tasks. Use for training region embeddings (Region2Vec, BEDspace), single-cell ATAC-seq analysis (scEmbed), building consensus peaks (universes), or any ML-based analysis of genomic regions. Applies to BED file collections, scATAC-seq data, chromatin accessibility datasets, and region-based genomic feature learning.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Provides guidance for training and analyzing Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features. Use when discovering interpretable features, analyzing superposition, or studying monosemantic representations in language models.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026