跳到正文
cccskills
免费在 GitHub 公开

vllm-metax-model-upgrade

Review and upgrade MetaX model support against target vLLM and installed MACA components, including model-dependent attention, weight loading and kernels. Use for model adaptations and shared-upstream-bug attribution, not standalone patch or registry audits.

中文简介正在准备中。当前显示原文说明。

实测评分 未实测

查看安装方法

包含的文件(2)

  • SKILL.md5.1 KB
  • references/review-cases.md3.1 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

vLLM-MetaX Model Upgrade

Fully read and apply vllm-metax-upgrade-common before this workflow.

Cover the requested models under vllm_metax/models/, their registration/configuration, and required attention, cache, compressor, indexer, projection, MTP/draft, MoE and kernel wrappers. Model-private attention remains in scope wherever its files live.

Establish the MACA/upstream difference matrix

Build the matrix for each requested model family using the effective configuration after platform and speculative-decoding rewrites, not only the raw HF config.

  • Inspect the exact checkpoint variant/revision's official config.json for layer layout. Record backbone and MTP/draft counts separately, count layer-indexed arrays such as layer_types, rope_theta and partial_rotary_factors, and map zero-based checkpoint IDs to each part. Config defaults and the highest layer ID do not supply the layer count; identify missing official configuration as an evidence gap.
  • Verify the config class selected by target vLLM. Compare raw checkpoint values with the constructed configuration after overrides, truncation and other rewrites before model/MTP code indexes layer arrays.
ContractRecord for both upstream and MACA
WeightsCheckpoint/runtime dtype, per-channel/block/MX grouping, scale encoding, packing, post-load conversion and excluded modules.
Activations and projectionsCompute/output/accumulation dtype, fused/separate projections, grouped GEMM, padding, quantization and inverse RoPE order.
KV and indexer cachesLogical/physical dtype, quantization scales, compressed/SWA separation, page layout/stride and index units.
AttentionActual backend/model-private path, prefill/decode/MTP, head dimensions, sinks, causal behavior, compression and capability restrictions.
MoE and parallelismActual experts implementation, routing/scaling, shared experts, TP/PP/SP/EP/DCP collective ownership and supported combinations.
Optional featuresLoRA, MTP/DSpark, graph capture and each feature's actual dispatch and restrictions.
ComponentsSelected DeepGEMM, FlashAttention/FlashMLA, MCOPLIB and other callable contracts and verified semantics.

A model's FP8/FP4 checkpoint label does not replace required MACA BF16/INT8 compute, weight or cache paths. Inspect the model's executable selection and conversion rather than deriving these paths from its checkpoint label.

Follow model-dependent interfaces

Trace model registration, config rewriting, layer construction, weight loading, execution selection and kernels. Include model-private attention/compressor/FlashMLA implementations such as DeepSeek V4 even outside a generic attention directory.

Check config transforms and model/draft class selection alongside parameter mappings; identically named imported classes can bind to different local/upstream implementations. Verify binary API contracts at the installed boundary. Read relevant review-cases.md for quantization/loading, private attention, parallelism and model-identity cases; its historical examples are investigation prompts.

Bound repairs to shared upstream model bugs

When a defect also affects or may affect target upstream:

  • Prefer the smallest model-local fix/workaround that preserves the upstream model role and required MACA behavior. Its inline difference note must identify the shared upstream scope and why the local workaround is needed; retain the evidence and removal condition.
  • If repair requires changes to other modules/components, keep that shared-bug repair outside this model adaptation unless separately authorized. Add a targeted logger.warning or logger.warning_once with trigger, consequence and known workaround, and report the unresolved repair plan. Prefer construction/configuration time to repeated token-time logging.
  • Keep existing rejection/capability checks: the warning cannot enable an unsupported path or replace an existing error with silent success.
  • This boundary applies to shared-bug repair, while dependency updates required by the requested model's changed interface/semantics remain part of the upgrade.

Model acceptance cases

Verify registration and construction, real checkpoint loading, transformed parameter state, selected model/kernel paths and the affected numerical behavior. Derive boundary and rejection cases from the difference matrix, including loader ordering and cache scale/packing cases.

For parallel changes, verify collective ownership and residual semantics through the actual distributed path. LoRA/MTP support requires their model execution paths, and wrapper-only or kernel-only results cannot establish that support. State unresolved shared-bug warnings alongside the model-specific difference and dependency coverage.

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Review and adapt MetaX attention backends, MLA, sparse indexers, cache layouts, and kernel wrappers against target vLLM and installed MetaX component contracts. Use for attention work outside vllm_metax/patch/.

中文简介正在准备中。当前显示原文说明。

MetaX-MACA/vLLM-metax1842026年10月23日 更新

Trim large MetaX model directories for dummy smoke tests or real-checkpoint loading on limited GPUs. Preserve target execution paths while reducing depth; use the real-weight workflow when a loadable checkpoint is requested. Not for accuracy evaluation or model compatibility upgrades.

中文简介正在准备中。当前显示原文说明。

MetaX-MACA/vLLM-metax1842026年10月23日 更新

Audit and adapt monkey patches in vllm_metax/patch/ against a target upstream revision. Decide whether to retain, update, migrate, or remove each patch; maintain patch headers and explanations; validate changes and record evidence. Use only for compatibility work on this directory, not standalone attention backend, model, kernel, or other adaptations elsewhere in vllm_metax.

中文简介正在准备中。当前显示原文说明。

MetaX-MACA/vLLM-metax1842026年10月23日 更新

Review and adapt vllm_metax/registry registrations, quantization configurations, CustomOps and kernel dispatch against a target vLLM revision and installed MetaX APIs. Verify registration, inherited state, weight layouts and actual backend selection. Use for registry compatibility work, not standalone attention algorithms or monkey patches.

中文简介正在准备中。当前显示原文说明。

MetaX-MACA/vLLM-metax1842026年10月23日 更新

Orchestrate a repository-wide vLLM-MetaX compatibility upgrade or coordinated multi-component adaptation through a support matrix, dependency graph and scoped specialists. Use a domain skill for standalone component work.

中文简介正在准备中。当前显示原文说明。

MetaX-MACA/vLLM-metax1842026年10月23日 更新

Shared workflow for vLLM-MetaX compatibility adaptations and reviews, including confirmed environments, upstream-first code, dependency contracts, validation and durable progress. Required by standalone domain skills and the full-upgrade coordinator; collecting environment facts may precede confirmation.

中文简介正在准备中。当前显示原文说明。

MetaX-MACA/vLLM-metax1842026年10月23日 更新

查看 MetaX-MACA 的全部技能

报告此技能的问题