跳到正文
cccskills
免费在 GitHub 公开

resource-budget

Estimate whether a model execution fits the available hardware and identify likely performance limits. Separate memory capacity, computation, data movement, and sequential waiting to produce a table of assumptions, ideal minimum times, unknowns, and measurement priorities.

中文简介正在准备中。当前显示英语简介。

原文查看原文说明

估算一次模型执行能否放入给定硬件,并定位计算、访存和串行等待的下界。用于粗估容量、时延或优化收益;具体模型结构另用 model-footprint。

实测评分 未实测

查看安装方法

适用场景

  • Checking whether a model execution fits the hardware
  • Estimating ideal computation and data transfer times
  • Assessing the overall benefit of a local optimization
  • Choosing the next performance metric to measure

包含的文件(1)

  • SKILL.md1.6 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

模型执行资源初估

适用:尚未确定系统方案,需要判断可行性或找出最值得测量的瓶颈。依据 manuscripts/01-初识 AI Infra.md 第 1.2—1.4 节。

  1. 写清任务目标、输入/输出 token 数、并发、精度、硬件容量与带宽,以及时延或成本上限。区分已测值、规格峰值与假设。
  2. 分别估算驻留容量 $M$、运算量 $F$、每层存储接口读写量 $R$。权重、KV、激活、工作区和缓冲区按生命周期计入;保存一次与读取多次不能混为一项。
  3. 先检验 $M\le M_{cap}$,再计算 $F/\Pi$ 与 $R/\beta$ 的理想时间下界。对于多级存储或网络,沿实际路径分别计算,不把不同接口带宽相加。
  4. 沿依赖关系画关键路径:排队、模型计算、数据搬移、工具等待和输出展示哪些串行、哪些可重叠。用局部耗时占比估算优化的整体收益;不能只用峰值 FLOPS 宣称端到端加速。
  5. 对照实测,解释差距可能来自遗漏的数据量、带宽利用率、启动、同步或排队;列出下一项应采集的指标。

输出一张“输入/假设、容量检查、时间下界、实测或未知、瓶颈判断”的表。所有量标明单位与十进制/二进制容量口径。具体配置和可复算数字见 calculations/README.md;模型架构变化转用 model-footprint。

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Compare computing devices for a defined AI model workload using memory capacity, computing speed, data transfer, energy use, and cost. Build a comparison that separates predicted performance from measurements and identifies the constraints that determine the choice.

中文简介正在准备中。当前显示英语简介。

  • Choosing hardware for a specific AI model
  • Checking whether a model fits in device memory
  • Explaining gaps between advertised and measured performance
bojieli/ai-infra-book69122026年10月1日 更新

Plan when an agent’s tool environments are created, kept available, released, and restored. Estimate peak concurrency, resource use during work and waiting, total task duration, and cost across model calls, tool execution, validation, and retries.

中文简介正在准备中。当前显示英语简介。

  • Estimating peak concurrent agent environments
  • Comparing environment retention and recreation
  • Assessing cold starts and shared environment pools
bojieli/ai-infra-book69122026年10月1日 更新

Estimate cross-server traffic, network bottlenecks, and synchronization waits for AI training or inference. Map communication onto physical network paths and assess how topology or communication changes affect the time needed to complete the job.

中文简介正在准备中。当前显示英语简介。

  • Find communication bottlenecks in distributed AI workloads
  • Compare network topologies and communication paths
  • Estimate synchronization waits under concurrent traffic
bojieli/ai-infra-book69122026年10月1日 更新

Compare ways to distribute AI inference across multiple instances, including replicas and separate input-processing and generation stages. Estimate capacity, throughput, delays, state-transfer costs, and recovery overhead to support routing and scaling decisions.

中文简介正在准备中。当前显示英语简介。

  • Compare replicas with separate inference stages
  • Plan routing around compute capacity and cached state
  • Evaluate expert placement and load imbalance
bojieli/ai-infra-book69122026年10月1日 更新

Compare running models or tasks on a device, nearby edge infrastructure, or in the cloud. Break down interaction delays, data transfers, energy use, costs, and failure recovery to assess deployment choices for multimodal and real-time agents.

中文简介正在准备中。当前显示英语简介。

  • Comparing device, edge, and cloud execution
  • Estimating interaction delays on unstable networks
  • Assessing battery use and sustainable processing speed
bojieli/ai-infra-book69122026年10月1日 更新

Compare batching, request scheduling, and memory management for a single model serving instance. Assess concurrent request capacity, response times, generation speed, and GPU time per result that meets the required quality and deadline.

中文简介正在准备中。当前显示英语简介。

  • Comparing batching and request scheduling options
  • Checking memory capacity for concurrent requests
  • Assessing cache reuse and offloading tradeoffs
bojieli/ai-infra-book69122026年10月1日 更新

查看 bojieli 的全部技能

报告此技能的问题