'disagg' 검색 결과

Check whether a Dynamo deployment is ready for disaggregated serving, where input processing and token generation run separately. Read-only probes inspect transport settings, GPU networking capabilities, and NIXL transfer-test readiness, then report gaps and next steps.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Check communication readiness after deployment
• Inspect transport setup before benchmarking
• Investigate suspected communication bottlenecks

Validate that a Dynamo deployment's NIXL/UCX/NCCL interconnect is ready for disaggregated serving over RDMA/NVLink. Use after recipe-runner brings a deployment up (especially disagg/multi-node) to confirm the KV transport is correct; use troubleshoot for diagnosing already-failed pods.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Interactively gather parameters for `python -m cli.inference.throughput_optimizer`, generate a deployment simulation command, explain assumptions, ask for execution confirmation, then run the simulation and summarize the best parallel strategy. Use when the user wants to evaluate a model on one or more hardware profiles, compare hardware targets, compare aggregation versus disaggregation versus PD ratio optimization, choose TP/EP/MOE-DP search ranges, or obtain recommended concurrency, throughput, TTFT, and TPOT results from throughput modeling.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.