3 skills · sorted by relevance
Check whether a Dynamo deployment is ready for disaggregated serving, where input processing and token generation run separately. Read-only probes inspect transport settings, GPU networking capabilities, and NIXL transfer-test readiness, then report gaps and next steps.
Validate that a Dynamo deployment's NIXL/UCX/NCCL interconnect is ready for disaggregated serving over RDMA/NVLink. Use after recipe-runner brings a deployment up (especially disagg/multi-node) to confirm the KV transport is correct; use troubleshoot for diagnosing already-failed pods.
The English summary is being prepared. Showing the original description.
Interactively gather parameters for `python -m cli.inference.throughput_optimizer`, generate a deployment simulation command, explain assumptions, ask for execution confirmation, then run the simulation and summarize the best parallel strategy. Use when the user wants to evaluate a model on one or more hardware profiles, compare hardware targets, compare aggregation versus disaggregation versus PD ratio optimization, choose TP/EP/MOE-DP search ranges, or obtain recommended concurrency, throughput, TTFT, and TPOT results from throughput modeling.
The English summary is being prepared. Showing the original description.