'sparse models' 검색 결과

Guides LLM compression through pruning, which removes selected model weights. Covers Wanda and SparseGPT methods without retraining, accuracy comparisons, and structured weight patterns that can accelerate inference on compatible hardware.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Trying model compression without retraining
• Comparing accuracy before and after pruning
• Choosing between Wanda and SparseGPT

Build and train Mixture of Experts models, which activate selected specialist networks for each input. Use DeepSpeed or HuggingFace workflows to configure routing, balance workloads, distribute experts across GPUs, and optimize inference.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Designing MoE models for a limited compute budget
• Implementing Mixtral-style expert routing
• Adjusting expert workloads and training stability

Reduce LLM weight usage through pruning, which removes selected model parameters. Explore Wanda and SparseGPT for compression without retraining, choose hardware-friendly patterns for faster inference, and compare the compressed model's accuracy with the original.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Compressing an LLM without retraining
• Comparing pruning methods
• Exploring faster inference on supported hardware

Train sentence-transformers models for search, similarity, and reranking, which reorders search results by relevance. Choose a model type, prepare data, configure training, compare results against a baseline, and publish the trained model to Hugging Face Hub.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Fine-tuning an embedding model for domain-specific search
• Training a model to rerank search results
• Training SPLADE or ColBERT retrieval models

Train Mixture of Experts models, which activate selected specialist networks for each input. The skill guides architecture, input routing, workload balancing, and GPU distribution using DeepSpeed or HuggingFace, with examples for training configuration and inference optimization.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Designing a model that activates only selected expert networks
• Balancing workloads across expert networks
• Distributing experts across multiple GPUs

Train sentence-transformers models for search, similarity, and reranking, which reorders search results by relevance. Choose a model type, prepare data, configure training, compare results against a baseline, and publish the trained model to Hugging Face Hub.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Fine-tuning an embedding model for domain-specific search
• Training a model to rerank search results
• Training SPLADE or ColBERT retrieval models

Use SAELens to train and analyze sparse autoencoders, which separate neural network activity into features that may represent recognizable concepts. Explore pretrained features, evaluate reconstruction quality, and investigate how individual features influence language model outputs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Exploring features with a pretrained SAE
• Training and evaluating a custom SAE
• Studying overlapping concepts in model activity

Use SAELens to train and analyze sparse autoencoders, which break model activations into a small set of interpretable features. Explore pretrained features, evaluate reconstruction quality, troubleshoot training, and test how individual features influence generated text.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Exploring features in a pretrained SAE
• Training an SAE for a selected model layer
• Investigating inactive features and reconstruction errors

Train Mixture of Experts (MoE) models using DeepSpeed or HuggingFace. Use when training large-scale models with limited compute (5× cost reduction vs dense models), implementing sparse architectures like Mixtral 8x7B or DeepSeek-V3, or scaling model capacity without proportional compute increase. Covers MoE architectures, routing mechanisms, load balancing, expert parallelism, and inference optimization.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Build graph neural networks, models that learn from connected nodes, with PyTorch Geometric. Supports node and graph classification, link prediction, custom datasets, and training approaches for large graphs or graphs containing multiple types of nodes and connections.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Build node and graph classification models
• Predict links between nodes
• Train models on graphs with multiple node and connection types

Helps configure and troubleshoot DeepSpeed for training large models across multiple devices. Covers memory optimization, parallel training, and DeepNVMe storage transfers, with examples for tuning data movement and configuring models that divide work among specialized components.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Configuring distributed training for large models
• Tuning tensor transfers to NVMe storage
• Setting up models with specialized expert components

Applies the engineering and research philosophies of Jeff Dean, Chief Scientist at Google DeepMind and Google Research. Reach for this skill whenever you are designing large-scale distributed systems, optimizing latency and energy efficiency, or making architectural decisions about machine learning infrastructure. It should trigger automatically for topics involving hardware-ML co-design, model distillation, sparse activation, massively multi-task models, or scaling systems by 5x to 10x. Use this skill to evaluate system bottlenecks, transition from specialized to unified models, and optimize experimental velocity. Apply his mental models to avoid premature 100x scaling and to treat AI models as reasoning engines rather than memorization databases.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Applies the engineering and research philosophies of Jeff Dean, Chief Scientist at Google DeepMind and Google Research. Reach for this skill whenever you are designing large-scale distributed systems, optimizing latency and energy efficiency, or making architectural decisions about machine learning infrastructure. It should trigger automatically for topics involving hardware-ML co-design, model distillation, sparse activation, massively multi-task models, or scaling systems by 5x to 10x. Use this skill to evaluate system bottlenecks, transition from specialized to unified models, and optimize experimental velocity. Apply his mental models to avoid premature 100x scaling and to treat AI models as reasoning engines rather than memorization databases.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

언어 모델 내부 반응을 소수의 특징으로 분해해 학습한 개념을 조사합니다. 사전 학습 SAE 분석, 자체 SAE 훈련, 특징을 통한 출력 조정과 재구성 품질 평가를 안내합니다.

• 사전 학습 SAE로 특징을 조사합니다
• 특정 모델 층을 대상으로 SAE를 훈련합니다
• 입력 문장별 특징 반응을 비교합니다

Provides guidance for training and analyzing Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features. Use when discovering interpretable features, analyzing superposition, or studying monosemantic representations in language models.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Train or fine-tune sentence-transformers models across `SentenceTransformer` (bi-encoder, dense or static embedding model for retrieval, similarity, clustering, classification, paraphrase mining, dedup, multimodal), `CrossEncoder` (reranker, pair scoring for two-stage retrieval / pair classification), `SparseEncoder` (SPLADE, sparse embedding model for learned-sparse retrieval), and `MultiVectorEncoder` (ColBERT / late-interaction, per-token embeddings scored with MaxSim). Covers loss selection, hard-negative mining, evaluators, distillation, LoRA, Matryoshka, and Hugging Face Hub publishing. Use for any sentence-transformers training task.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Sparse Identification of Nonlinear Dynamics (SINDy) — discover governing equations from time-series data. Builds sparse dynamical system models dx/dt = f(x) from measurements using PySINDy. Use when you have trajectory data and want to find the underlying ODE.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Provides guidance for training and analyzing Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features. Use when discovering interpretable features, analyzing superposition, or studying monosemantic representations in language models.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Provides guidance for training and analyzing Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features. Use when discovering interpretable features, analyzing superposition, or studying monosemantic representations in language models.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Reduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT. Use when compressing models without retraining, achieving 50% sparsity with minimal accuracy loss, or enabling faster inference on hardware accelerators. Covers unstructured pruning, structured pruning, N:M sparsity, magnitude pruning, and one-shot methods.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Provides guidance for training and analyzing Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features. Use when discovering interpretable features, analyzing superposition, or studying monosemantic representations in language models.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Implement and troubleshoot large-model training with DeepSpeed across multiple GPUs. The skill covers memory optimization, parallel training, and numerical precision choices, alongside examples for storage transfers and models that divide work among specialized components.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Review settings for distributed model training
• Tune transfers between NVMe storage and tensors
• Configure training with specialized model components

Use for formulating, solving, debugging, and validating mixed-integer linear optimization models with open-source solvers, including variable indexing, sparse constraints, linearized costs, solver limits, MIP gaps, incumbent extraction, numerical tolerances, and deterministic output reporting.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Train or fine-tune SentenceTransformer bi-encoders, CrossEncoder rerankers, or SparseEncoder models, including losses, negatives, evaluation, distillation, LoRA, and Matryoshka. Use for sentence-transformers training tasks.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.