'gpu' 검색 결과

Compress large language model weights to four bits with AWQ, a method that uses model activation patterns to limit quality loss. Follow workflows for quantization, loading compressed models, and serving them with vLLM using less GPU memory.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Running large language models with limited GPU memory
• Quantizing a model with domain-specific text
• Serving an AWQ model with vLLM

Use this skill for hands-on DOCA GPI programming — wiring a GPU-Packet-Initiator context so a CUDA kernel drives RDMA queues directly from GPU memory without host CPU mediation. Covers picking GPI vs doca-gpunetio, the doca_gpi / domain / channel object model, the GPU-side handle handoff (doca_gpu_gpi_channel*), attaching GPU memory to a GPI domain, the domain and channel attribute objects, and debugging DOCA_ERROR_* from doca_gpi_* calls. Trigger even when the user does not explicitly mention "DOCA GPI" — implicit phrasings include "my CUDA kernel needs to post RDMA directly from GPU memory", "DOCA_ERROR_* from doca_gpi_gpu_channel_get", "how do I hand a GPU handle to my CUDA kernel", "how many channels can a GPI domain hold", or "GPU kernel driving RDMA without the host CPU on the path". Refuse and route elsewhere for the doca-gpunetio Send/Receive surface, the doca-rdma queue lifecycle, DPA-side initiation (doca-rdmi), or the CUDA programming model — those belong to other skills.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

AI demos and GPU compute with Gradio Spaces and Hugging Face Spaces ZeroGPU. Use when writing or reviewing code that uses `@spaces.GPU`, configuring `python_version` or `requirements.txt` for a ZeroGPU Space, or handling ZeroGPU-specific code constraints — pickle-based process isolation, `gr.State` semantics across the worker boundary, no `torch.compile` (use AoTI instead), CUDA wheel-only builds (no `nvcc` at build or runtime), large vs xlarge sizing, and dynamic duration callables. Make sure to use this skill whenever the user mentions ZeroGPU, `@spaces.GPU`, or the `spaces` Python package, or hits ZeroGPU-specific code errors like `PicklingError` across the worker boundary, `illegal duration`, or `flash-attn` wheel-build failures — even when the user does not explicitly ask for ZeroGPU coding guidance. Trigger on `import spaces` or `@spaces.GPU` in code.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Investigate recurring SGLang automated test failures by comparing logs, commit history, and GPU environments. Narrow down code changes or machine-specific problems, optionally reproduce failures remotely, and summarize the evidence in a structured report.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Finding the change behind a recurring test failure
• Checking whether failures depend on a GPU or runner
• Reproducing a test failure on a remote GPU server

Build similarity search with FAISS to find nearby matches in large collections of numeric vectors. The skill guides index selection, memory reduction, GPU use, and saving indexes while balancing search speed and accuracy.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Find similar items in large vector datasets
• Choose an index for search speed and accuracy
• Reduce memory use for vector search

Plan and configure large language model training with OpenRLHF to better match human preferences. Covers training method selection, distributed GPU setup, inference acceleration with vLLM, and troubleshooting memory or training stability issues.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Choosing a method for training models on human preferences
• Setting up PPO training with a reward model
• Configuring GRPO training without a critic model

Configure large language model pretraining with torchtitan across multiple GPUs. Covers ways to split training work, launch jobs on computing clusters, enable Float8 numerical processing, and save or resume training through distributed checkpoints.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Pretraining Llama 3.1 8B on eight GPUs
• Configuring multi-node training with SLURM
• Enabling Float8 training on H100 GPUs

Adapt PyTorch training scripts for multiple GPUs or machines with Accelerate. This skill guides code changes, configuration, and launch commands, including mixed precision, which combines numerical formats, and DeepSpeed or FSDP integration for distributed training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Moving single-GPU training to multiple GPUs
• Configuring mixed precision training
• Setting up DeepSpeed or FSDP

Investigate interruptions affecting GPU and TPU workloads on GKE using maintenance labels, monitoring queries, logs, and node scheduling restrictions. The skill helps determine whether host maintenance caused a disruption and recommends workload protection measures when maintenance is confirmed or expected.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigating unexpected GPU or TPU workload interruptions
• Checking upcoming host maintenance on GKE nodes
• Tracking maintenance interruptions with PromQL

Improve MNN's Vulkan backend by separating CPU scheduling bottlenecks from GPU computation costs. It guides operator and shader changes, new feature integration with compatibility fallbacks, and device testing to verify both correctness and end-to-end performance.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Finding CPU or GPU bottlenecks in Vulkan inference
• Optimizing a specific operator or shader
• Integrating cooperative matrix or subgroup features

Build similarity search with FAISS to find nearby matches in large collections of numeric vectors. The skill guides index selection, memory reduction, GPU use, and saving indexes while balancing search speed and accuracy.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Find similar items in large vector datasets
• Choose an index for search speed and accuracy
• Reduce memory use for vector search

Configure large language model pretraining with torchtitan across multiple GPUs. Covers ways to split training work, launch jobs on computing clusters, enable Float8 numerical processing, and save or resume training through distributed checkpoints.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Pretraining Llama 3.1 8B on eight GPUs
• Configuring multi-node training with SLURM
• Enabling Float8 training on H100 GPUs

Guides you through running large language models on CPUs, Apple Silicon, and AMD or Intel GPUs. Covers choosing GGUF model files, reducing memory through quantization, and starting an OpenAI-compatible chat server.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Running a local LLM on an Apple Silicon Mac
• Trying LLM inference on a CPU-only machine
• Choosing a model format that fits available memory

Adapt existing PyTorch training scripts to run across multiple GPUs or machines with Accelerate. This skill covers device setup, distributed training configuration, and mixed precision, which uses lower-precision numbers to reduce memory use.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Adapt a single-GPU training script for multiple GPUs
• Configure mixed precision to reduce training memory use
• Set up training with DeepSpeed or FSDP

Build and maintain machine learning apps on Hugging Face Spaces. Choose a suitable app framework and computing hardware, load models, deploy files, and check logs and outputs to diagnose build or runtime problems.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Publishing a machine learning demo
• Adapting an existing Gradio app for ZeroGPU
• Diagnosing Space build or runtime failures

Plan how to split AI models and workloads across multiple GPUs. Compare memory needs, computation, communication, and waiting time to estimate completion times and choose a layout suited to response time, throughput, or cost goals.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Running models that exceed a single GPU's memory
• Comparing ways to split work across GPUs
• Estimating communication costs within and between servers

vLLM으로 대규모 언어 모델을 API로 제공하거나 많은 입력을 일괄 처리하도록 돕습니다. 배포와 성능 모니터링, 메모리 절약, 응답 속도 조정도 다룹니다.

• OpenAI 호환 API를 제공할 때
• 많은 프롬프트를 일괄 처리할 때
• 제한된 GPU 메모리로 모델을 실행할 때

가사와 곡 분위기 및 악기 태그로 로컬에서 음악을 생성합니다. 설치와 입력 준비, GPU 메모리 절약 설정부터 MP3 저장까지 안내합니다.

• 직접 쓴 가사를 곡으로 만들기
• 태그로 곡 분위기와 악기 시험하기
• 로컬 환경에서 음악 생성하기

Wi-Fi 측정 데이터로 RuView 모델을 훈련하고 평가합니다. 자세 추정, 환경 적응, GPU 훈련과 Hugging Face 모델 공개를 다룹니다.

• 카메라와 레이블 없이 자세 추정 학습하기
• 카메라와 Wi-Fi 대응 데이터로 학습하기
• 다른 방이나 환경에 모델 적응시키기

Analyze LLM serving traces to identify GPU time usage, opportunities to run operations concurrently, and known patterns for combining operations. Produce three consistent tables from saved traces or live captures on supported servers.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Identify GPU operations that dominate inference time
• Compare input processing and token generation
• Trace GPU operations back to Python code

Investigate SGLang runs that freeze across multiple GPUs. It uses stack traces, communication logs, GPU memory dumps, and comparisons between processes to locate state differences, trace their causes, and guide fixes.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Locate where a multi-GPU inference run freezes
• Compare logs from distributed processes
• Trace the first difference in process state

Configure machine learning training and batch jobs across multiple clouds with SkyPilot. The skill guides GPU selection, lower-cost cloud and region choices, and automatic recovery when discounted spot instances are interrupted.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Choose a lower-cost cloud for GPU training
• Run long training jobs with recovery after interruptions
• Configure distributed training across multiple machines

Organize PyTorch training code with LightningModule and Trainer. Follow examples for validation, logging, model saving, and distributed training across multiple GPUs, with callbacks that add monitoring or stop training when progress stalls.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Converting an existing PyTorch training loop
• Adding validation, logs, and model checkpoints
• Configuring training across multiple GPUs

Run batches of machine learning experiments on remote GPUs over SSH, varying settings and random seeds. The skill schedules jobs, tracks progress, retries GPU memory failures, and cleans up leftover sessions before starting subsequent batches.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Run experiments across multiple random seeds
• Test combinations of model settings
• Chain teacher training and student distillation