'adamw' 검색 결과

Guides PyTorch model training and fine-tuning, from choosing architectures to configuring optimizers and learning rates. Provides troubleshooting steps for unstable loss and memory shortages, plus methods for improving GPU throughput and comparing experiments.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Choose model architectures for the available data type and scale
• Configure optimizers and learning-rate schedules
• Investigate loss spikes, NaNs, and GPU memory shortages

Battle-tested PyTorch training recipes for all domains — LLMs, vision, diffusion, medical imaging, protein/drug discovery, spatial omics, genomics. Covers training loops, optimizer selection (AdamW, Muon), LR scheduling, mixed precision, debugging, and systematic experimentation. Use when training or fine-tuning neural networks, debugging loss spikes or OOM, choosing architectures, or optimizing GPU throughput.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Train GPT-2 scale models (~124M parameters) efficiently on a single GPU. Covers GPT-124M architecture, tokenized dataset loading (e.g., HuggingFace Hub shards), modern optimizers (Muon, AdamW), mixed precision training, and training loop implementation.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Think and work like an expert Deep Learning Scientist. Use when a task calls for Deep Learning Scientist judgment. Reasons from CNN/Transformer inductive bias, Li et al. loss landscapes, grokking/mode connectivity, and Kaplan/Chinchilla scaling (~20 tokens/param); designs ResNet/ViT/DiT/MoE/FlashAttention stacks with FLOPs-matched ablations; trains AdamW+cosine/WSD via Megatron-FSDP/DeepSpeed; evaluates FID/MMLU-Pro/MMLU-CF with lm-eval decontamination and Pineau/NeurIPS reproducibility checklists.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Rust 製 AI/ML ライブラリ fandhe-ai のリファレンス。Burn / candle / tch 非依存の from-scratch 実装。 tape(), tape_for, Tape, Gradients, Tensor, Var, LinearVars, autodiff, kernel fusion, FusionPlan, BackendOps, Device (Cpu / Cuda / Metal), DeviceParamStore, compat::array, compat::Sequential, nn::Module, optim (AdamW / GradScaler), data::DataLoader, ONNX import / export, safetensors, inference::generate / KvCache, guardrail / self-repair CLI。

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.