32건 · 관련도순
Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
TorchTitan과 PyTorch로 대규모 언어 모델 사전 학습을 설정합니다. 여러 GPU에 작업을 나누고 단일·다중 노드 실행과 학습 저장·재개를 지원합니다.
Recommend and customize Megatron Bridge library and benchmark recipes for a user's model, GPU count, hardware, sequence length, and pretrain/SFT/PEFT goal. Use when selecting a starting recipe, comparing library and benchmark configs, resizing parallelism for a GPU allocation, or distinguishing convergence changes, semantics-preserving execution tuning, and benchmark-only shortcuts.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Decision SOP for serving LLMs with vLLM. Covers PagedAttention mental model, quantization/parallelism/batching tradeoffs, OOM triage, and when NOT to use vLLM. Activates when a coder-agent is choosing or tuning an inference engine, debugging vLLM throughput/latency/OOM, or comparing vLLM against TGI/SGLang/TensorRT-LLM/llama.cpp.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Use ColossalAI for distributed PyTorch training, large-model parallelism, Booster plugins, ShardFormer, Colossal-Inference, and first-party application workflow routing.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Multi-agent SWE team built on the Workshop model. Full-stack vertical workers, meeting room with @mention notification, private pipes, shared task board. Git worktree isolation, Leader-driven coordination. Mixed Codex/Claude Code engine. Use when a task needs engineering depth beyond a single agent. NOT for simple task parallelism (use agent-task-orchestration) or design discussions (use agent-brainstorm).
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.