“disagg”的搜索结果

Check whether a Dynamo deployment is ready for disaggregated serving, where input processing and token generation run separately. Read-only probes inspect transport settings, GPU networking capabilities, and NIXL transfer-test readiness, then report gaps and next steps.

中文简介正在准备中。当前显示英语简介。

• Check communication readiness after deployment
• Inspect transport setup before benchmarking
• Investigate suspected communication bottlenecks

Validate that a Dynamo deployment's NIXL/UCX/NCCL interconnect is ready for disaggregated serving over RDMA/NVLink. Use after recipe-runner brings a deployment up (especially disagg/multi-node) to confirm the KV transport is correct; use troubleshoot for diagnosing already-failed pods.

中文简介正在准备中。当前显示原文说明。

Interactively gather parameters for `python -m cli.inference.throughput_optimizer`, generate a deployment simulation command, explain assumptions, ask for execution confirmation, then run the simulation and summarize the best parallel strategy. Use when the user wants to evaluate a model on one or more hardware profiles, compare hardware targets, compare aggregation versus disaggregation versus PD ratio optimization, choose TP/EP/MOE-DP search ranges, or obtain recommended concurrency, throughput, TTFT, and TPOT results from throughput modeling.

中文简介正在准备中。当前显示原文说明。