'large models' 검색 결과

Compress large language models to 4-bit weights to reduce GPU memory use and accelerate inference. Covers loading compressed models, configuring quantization, and using Transformers or vLLM, with guidance on hardware requirements and backend choices.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Running large models with limited GPU memory
• Compressing a model with domain-specific sample text
• Serving AWQ models with vLLM

Train smaller language models using knowledge distillation, where a larger model supplies examples or prediction targets. This skill covers training losses, generated training data, parameter choices, and output comparisons to support model compression and specialized student models.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Training a smaller model from a larger teacher
• Fine-tuning with teacher-generated responses
• Distilling domain knowledge into a specialized model

Reduce GPU memory use by loading language models in 8-bit or 4-bit formats with bitsandbytes and HuggingFace Transformers. Includes configuration examples, QLoRA fine-tuning of compressed models, and optimizers that reduce memory needed during training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Load larger models within limited GPU memory
• Compare 8-bit and 4-bit model settings
• Fine-tune a model with QLoRA

Build and train Mixture of Experts models, which activate selected specialist networks for each input. Use DeepSpeed or HuggingFace workflows to configure routing, balance workloads, distribute experts across GPUs, and optimize inference.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Designing MoE models for a limited compute budget
• Implementing Mixtral-style expert routing
• Adjusting expert workloads and training stability

Helps configure and troubleshoot DeepSpeed for training large models across multiple devices. Covers memory optimization, parallel training, and DeepNVMe storage transfers, with examples for tuning data movement and configuring models that divide work among specialized components.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Configuring distributed training for large models
• Tuning tensor transfers to NVMe storage
• Setting up models with specialized expert components

Guide knowledge distillation, where a smaller language model learns from a larger teacher. Covers training from teacher responses or prediction scores, adjusting training settings, and comparing outputs to support model compression and specialized training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Compressing a large language model into a smaller model
• Training a specialized model from teacher-generated examples
• Comparing distillation methods and training settings

Compress large language model weights to four bits with AWQ, a method that uses model activation patterns to limit quality loss. Follow workflows for quantization, loading compressed models, and serving them with vLLM using less GPU memory.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Running large language models with limited GPU memory
• Quantizing a model with domain-specific text
• Serving an AWQ model with vLLM

Compress large language models to 4-bit weights to reduce GPU memory needs and accelerate text generation. Covers loading compressed models, converting your own models, choosing settings, and preparing memory-efficient fine-tuning with transformers and PEFT.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Run language models with limited GPU memory
• Convert your own model to 4-bit weights
• Compare compression settings for quality and speed

Guides large language model reinforcement learning with miles, including MoE models that route work to specialized components. Covers low-precision training, matching training and inference behavior, and accelerating training response generation with draft models.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Setting up reinforcement learning for large MoE models
• Configuring FP8 or INT4 training
• Checking consistency between training and inference

Guides large language model reinforcement learning with miles, covering environment setup, low-precision training, consistency between training and inference, and speculative decoding, where a smaller model proposes tokens for a larger model to verify.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Configure reinforcement learning for large MoE models
• Investigate instability in FP8 training
• Set up speculative decoding for faster rollout generation

Reduce the memory needed to run large language models with GPTQ quantization, which stores model weights at lower precision. Covers loading compressed models, quantizing your own models, choosing execution backends, and connecting to memory-efficient fine-tuning.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Run a language model within limited GPU memory
• Load a pre-quantized model for text generation
• Quantize and save your own trained model

Plan and configure large language model training with OpenRLHF to better match human preferences. Covers training method selection, distributed GPU setup, inference acceleration with vLLM, and troubleshooting memory or training stability issues.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Choosing a method for training models on human preferences
• Setting up PPO training with a reward model
• Configuring GRPO training without a critic model

Plan and troubleshoot large language and vision model training and inference. This guide uses hardware measurements to identify bottlenecks, address memory shortages and unstable training, and improve checkpointing, recovery, and performance across multiple GPUs and machines.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Diagnosing slow training and GPU memory shortages
• Investigating loss spikes and invalid numerical values
• Debugging communication hangs across GPUs and machines

Train Mixture of Experts models, which activate selected specialist networks for each input. The skill guides architecture, input routing, workload balancing, and GPU distribution using DeepSpeed or HuggingFace, with examples for training configuration and inference optimization.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Designing a model that activates only selected expert networks
• Balancing workloads across expert networks
• Distributing experts across multiple GPUs

Helps reduce GPU memory use by loading large language models in 4-bit or 8-bit formats, a technique called quantization. Covers bitsandbytes configuration, memory checks, QLoRA fine-tuning, and training with memory-saving optimizers.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Load a larger model within available GPU memory
• Compare 4-bit and 8-bit quantization settings
• Fine-tune a quantized model with QLoRA

Configure large language model training across multiple NVIDIA GPUs with Megatron-Core. The skill helps choose how to split models and workloads, set training parameters, monitor performance, and address memory shortages or low GPU utilization.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Planning distributed training for a LLaMA-style model
• Distributing MoE expert networks across GPUs
• Tuning GPU utilization and training throughput

Adapt large language models to specific tasks through fine-tuning, or additional training. Prepares and validates datasets, configures LoRA or QLoRA to train a small subset of parameters, and supplies training settings, evaluation scripts, and deployment optimization guidance.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Preparing and validating JSONL training data
• Choosing LoRA or QLoRA for available GPU memory
• Configuring training and monitoring overfitting

Set up vLLM to serve large language models through an OpenAI-compatible API or process prompts in batches. The skill covers deployment, performance monitoring, and quantization, which reduces model memory requirements.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Deploying an OpenAI-compatible language model API
• Generating text from large batches of prompts
• Serving large models with limited GPU memory

Evaluate large language models on shared tests of knowledge, reasoning, and code generation with lm-evaluation-harness. Save scores and individual predictions, compare models in tables, and track performance across saved stages of model training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Evaluating models on MMLU and GSM8K
• Building comparison tables for multiple models
• Tracking scores across training checkpoints

Implement and debug large-model training with PyTorch FSDP, which splits training state across devices. Consult documentation and code patterns for sharding choices, mixed precision, and checkpoints when building or reviewing distributed training code.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Implement distributed training for large models
• Compare FSDP wrapping and sharding patterns
• Review mixed-precision and checkpoint examples

Coordinate large research or generation tasks across a model team. An orchestrator plans and checks the work, workers execute subtasks in parallel, and an advisor reviews the plan and draft before the results are combined.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Research multiple competitors in parallel
• Split a large generation task across multiple models
• Have an advisor review plans and drafts

Build graph neural networks, models that learn from connected nodes, with PyTorch Geometric. Supports node and graph classification, link prediction, custom datasets, and training approaches for large graphs or graphs containing multiple types of nodes and connections.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Build node and graph classification models
• Predict links between nodes
• Train models on graphs with multiple node and connection types

Configure large language model training with NVIDIA Megatron-Core across multiple GPUs. This skill helps choose how to split computation, set training parameters, monitor GPU efficiency, and address memory limits or unstable training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Planning multi-GPU training for a LLaMA-style model
• Distributing MoE model experts across GPUs
• Tuning training throughput and GPU utilization

Process large email, document, and transcript archives by routing items to AI models according to their importance. Rule-based privacy checks run before model calls, while extracted information becomes linked knowledge pages with progress checkpoints.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Extract useful information from large email archives
• Organize decisions and advice from meeting transcripts
• Route reports to suitable models by importance