Compare computing devices for a defined AI model workload using memory capacity, computing speed, data transfer, energy use, and cost. Build a comparison that separates predicted performance from measurements and identifies the constraints that determine the choice.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Choosing hardware for a specific AI model
- Checking whether a model fits in device memory
- Explaining gaps between advertised and measured performance
bojieli/ai-infra-book☆ 6.7천2026년 10월 1일 업데이트
Plan when an agent’s tool environments are created, kept available, released, and restored. Estimate peak concurrency, resource use during work and waiting, total task duration, and cost across model calls, tool execution, validation, and retries.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Estimating peak concurrent agent environments
- Comparing environment retention and recreation
- Assessing cold starts and shared environment pools
bojieli/ai-infra-book☆ 6.7천2026년 10월 1일 업데이트
Estimate cross-server traffic, network bottlenecks, and synchronization waits for AI training or inference. Map communication onto physical network paths and assess how topology or communication changes affect the time needed to complete the job.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Find communication bottlenecks in distributed AI workloads
- Compare network topologies and communication paths
- Estimate synchronization waits under concurrent traffic
bojieli/ai-infra-book☆ 6.7천2026년 10월 1일 업데이트
Compare ways to distribute AI inference across multiple instances, including replicas and separate input-processing and generation stages. Estimate capacity, throughput, delays, state-transfer costs, and recovery overhead to support routing and scaling decisions.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Compare replicas with separate inference stages
- Plan routing around compute capacity and cached state
- Evaluate expert placement and load imbalance
bojieli/ai-infra-book☆ 6.7천2026년 10월 1일 업데이트
Compare running models or tasks on a device, nearby edge infrastructure, or in the cloud. Break down interaction delays, data transfers, energy use, costs, and failure recovery to assess deployment choices for multimodal and real-time agents.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Comparing device, edge, and cloud execution
- Estimating interaction delays on unstable networks
- Assessing battery use and sustainable processing speed
bojieli/ai-infra-book☆ 6.7천2026년 10월 1일 업데이트
Compare batching, request scheduling, and memory management for a single model serving instance. Assess concurrent request capacity, response times, generation speed, and GPU time per result that meets the required quality and deadline.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Comparing batching and request scheduling options
- Checking memory capacity for concurrent requests
- Assessing cache reuse and offloading tradeoffs
bojieli/ai-infra-book☆ 6.7천2026년 10월 1일 업데이트