跳到正文
cccskills
免费在 GitHub 公开

agent-runtime-capacity

Plan when an agent’s tool environments are created, kept available, released, and restored. Estimate peak concurrency, resource use during work and waiting, total task duration, and cost across model calls, tool execution, validation, and retries.

中文简介正在准备中。当前显示英语简介。

原文查看原文说明

规划 Agent 模型调用与工具环境的创建、驻留、释放和恢复。用于并发容量、沙箱成本与完整任务时延分析。

查看安装方法

适用场景

  • Estimating peak concurrent agent environments
  • Comparing environment retention and recreation
  • Assessing cold starts and shared environment pools
  • Budgeting task duration, retries, and resource costs

包含的文件(1)

  • SKILL.md1.4 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Agent 运行环境容量

适用:Agent 多轮调用模型和工具,工具环境的等待与驻留影响成本或期限。依据 manuscripts/11-资源调度与运行环境.md 第 11.1—11.5 节。

  1. 把一项任务展开为模型调用、环境准备、工具执行、验证和重试的依赖图。为每段记录 CPU、内存、GPU、存储占用及持续时间;区分实际工作与等待。
  2. 用到达率和持续时间估算同时驻留的模型会话与环境数,检查峰值内存而不只看平均 CPU 使用率。环境长时间等待模型时,计算提前准备或按轮重建能节省的资源时间。
  3. 明确跨轮必须保留的状态。文件、快照或外部持久化可以承载状态时,再比较释放环境的收益与重建、恢复和验证开销。
  4. 对共享池检查冷启动、镜像/环境多样性、抢占、成组分配和背压;对 RL rollout 将模型生成、工具执行与验证能否重叠写清楚。
  5. 调整模型服务并发或环境生命周期后,重新估算完整任务的关键路径、按期完成率和每合格任务成本。

输出各阶段资源时间、峰值并发、关键路径及故障重试预算。工具环境闲置时的内存仍算驻留,不可从 CPU 利用率推断容量足够。

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Compare computing devices for a defined AI model workload using memory capacity, computing speed, data transfer, energy use, and cost. Build a comparison that separates predicted performance from measurements and identifies the constraints that determine the choice.

中文简介正在准备中。当前显示英语简介。

  • Choosing hardware for a specific AI model
  • Checking whether a model fits in device memory
  • Explaining gaps between advertised and measured performance
bojieli/ai-infra-book67252026年10月1日 更新

Estimate cross-server traffic, network bottlenecks, and synchronization waits for AI training or inference. Map communication onto physical network paths and assess how topology or communication changes affect the time needed to complete the job.

中文简介正在准备中。当前显示英语简介。

  • Find communication bottlenecks in distributed AI workloads
  • Compare network topologies and communication paths
  • Estimate synchronization waits under concurrent traffic
bojieli/ai-infra-book67252026年10月1日 更新

Compare ways to distribute AI inference across multiple instances, including replicas and separate input-processing and generation stages. Estimate capacity, throughput, delays, state-transfer costs, and recovery overhead to support routing and scaling decisions.

中文简介正在准备中。当前显示英语简介。

  • Compare replicas with separate inference stages
  • Plan routing around compute capacity and cached state
  • Evaluate expert placement and load imbalance
bojieli/ai-infra-book67252026年10月1日 更新

Compare running models or tasks on a device, nearby edge infrastructure, or in the cloud. Break down interaction delays, data transfers, energy use, costs, and failure recovery to assess deployment choices for multimodal and real-time agents.

中文简介正在准备中。当前显示英语简介。

  • Comparing device, edge, and cloud execution
  • Estimating interaction delays on unstable networks
  • Assessing battery use and sustainable processing speed
bojieli/ai-infra-book67252026年10月1日 更新

Compare batching, request scheduling, and memory management for a single model serving instance. Assess concurrent request capacity, response times, generation speed, and GPU time per result that meets the required quality and deadline.

中文简介正在准备中。当前显示英语简介。

  • Comparing batching and request scheduling options
  • Checking memory capacity for concurrent requests
  • Assessing cache reuse and offloading tradeoffs
bojieli/ai-infra-book67252026年10月1日 更新

Analyze GPU operation timings and execution traces to find costly data access, repeated computation, launch overhead, and synchronization waits. Check whether improving an individual operation actually reduces the time needed to complete a full request.

中文简介正在准备中。当前显示英语简介。

  • Investigating slow GPU operations
  • Assessing whether combining operations reduces data access
  • Checking pipeline dependencies and buffer reuse
bojieli/ai-infra-book67252026年10月1日 更新

查看 bojieli 的全部技能

报告此技能的问题