'latency' 검색 결과

Reduces LLM costs and improves response times through caching, model selection, batching, and prompt optimization. Provides cost breakdowns, latency hotspots, and configuration recommendations. Use for "cost reduction", "performance optimization", "latency improvement", or "efficiency".

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Identifies API latency hotspots and bottlenecks with profiling tools, slow endpoint detection, suspected causes, and fix roadmap. Use for "latency profiling", "performance bottlenecks", "slow APIs", or "backend performance".

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

현재 성능 측정, 가설별 변경안 비교, 정확성 검증으로 최적화를 진행합니다. 시간과 비용 한도 안에서 가장 빠르고 안전한 안을 고르고 재실행 절차를 남깁니다.

• 느린 작업을 측정하며 속도 개선
• 같은 입력 조건에서 구현안 비교
• 응답 시간, 처리량, 실행 비용 평가

Review Caveman Cloud spending, latency, errors, and potential improvements using current reports and traces, or individual execution records. Produce findings tied to time windows and trace IDs, while keeping measured costs, estimated opportunities, and verified savings separate.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Understanding which workflows drive LLM spending
• Investigating slow responses and errors
• Reviewing measured costs and verified savings separately

Coordinate background tasks with specialized agents for research, optimization, audits, and more. Use execution history, quality scores, success rates, and latency to guide agent selection, track performance, and check benchmark compliance.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Choose specialized agents for different task types
• Review agent quality, success rates, and latency
• Record execution feedback to inform future assignments

Tune vector indexes, which organize data for similarity searches, to balance speed, memory use, and missed matches. Choose index types, adjust HNSW settings, and assess compression options using benchmarks with real queries.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Reduce latency in similarity searches
• Tune HNSW settings to reduce missed matches
• Compare compression options for lower memory use

Set up monitoring for communication between services in Istio or Linkerd environments. Combine metrics, logs, and distributed traces, which follow requests across services, to investigate delays and errors, visualize dependencies, and define service quality targets.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Trace requests across multiple services
• Create communication metrics and dashboards
• Investigate latency, errors, and connectivity issues

Build search and recommendation features with Pinecone, a managed database for numerical representations of content. Covers data loading, combined meaning and keyword search, filtering by attributes, and separating data by user.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Build document retrieval for AI answers
• Combine meaning and keyword search
• Separate search data by user

Configure LLM inference and serving on NVIDIA GPUs with TensorRT-LLM. Covers quantization, which reduces numerical precision, batching requests during generation, and distributing models across GPUs to improve processing capacity and response times.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Setting up an LLM server on NVIDIA GPUs
• Configuring FP8 or INT4 quantization
• Distributing large models across multiple GPUs

Investigate stalled TPU training across multiple slices on GKE using hang reports, logs, and latency metrics. Separate compilation inconsistencies and data input stalls from hardware or network faults, and identify the relevant nodes for further investigation.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigating HANG_DETECTED logs during TPU training
• Separating input stalls from hardware faults
• Mapping reported faulty instances to GKE nodes

Create and validate Terraform alerts for GKE using PromQL, a monitoring query language. Cover response times, errors, traffic, memory usage, and cluster health, with checks for alert timing, duplicate signals, and metric ingestion costs.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Create alerts for GKE service latency and errors
• Detect frequent container restarts and unhealthy nodes
• Review existing Terraform alert configurations

Improve code, prompts, skills, or agent definitions through repeated changes and evaluation. Measure numerical targets such as latency or size, or use an LLM to judge pass-or-fail criteria, keeping changes that improve the result.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Improving page load performance
• Reducing build output size
• Refining prompts against evaluation criteria

Reduce LLM generation delays with speculative decoding, which proposes tokens ahead of verification. This skill compares small draft models, Medusa, and Lookahead Decoding, with implementation examples, tuning guidance, and deployment using vLLM.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Reducing response delays in chatbots
• Speeding up code generation
• Choosing a small model to draft candidate tokens

Build search and recommendation features with Pinecone, a managed database for numerical representations of content. Covers data loading, combined meaning and keyword search, filtering by attributes, and separating data by user.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Build document retrieval for AI answers
• Combine meaning and keyword search
• Separate search data by user

Configure LLM inference and serving on NVIDIA GPUs with TensorRT-LLM. Covers quantization, which reduces numerical precision, batching requests during generation, and distributing models across GPUs to improve processing capacity and response times.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Setting up an LLM server on NVIDIA GPUs
• Configuring FP8 or INT4 quantization
• Distributing large models across multiple GPUs

Set up monitoring for deployed agents to inspect execution paths, latency, and model interactions. It explains Cloud Trace, prompt and response logging, BigQuery analytics, and external monitoring integrations, with checks for missing data and unwanted content capture.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Investigating agent latency and execution errors
• Configuring prompt and response logging
• Analyzing agent events in BigQuery

Use this skill when the user runs doca_dpa_hl_tracer to capture/decode DPA-side traces at the programming-events layer (kernel entry/exit, sync points, comm primitive calls, RDMA WR submission, completion drain) — picking TRACE vs CRIT, tuning the JSON config (file-size limits + file_size_limit_policy, thread priorities/cores), decoding against the matching DPA-side ELF, or diagnosing empty/noisy captures. Trigger even when the user does not explicitly mention "DOCA DPA tracer" or "high-level tracer" — typical implicit phrasings include "DPA kernel returns wrong result but host completions look clean", "kernel-entry to first-comm latency is huge", "RDMA WR to drain gap on the DPA", "trace file truncated mid-run", "TRACE doubled my DPA latency", or "tracer wrote a file but parser shows zero events". Refuse and route elsewhere for writing DPA kernels, DPA-Comms/DPA-Verbs programming, raw per-cycle DPA profiling, host-side doca-dpa debugging, or production DPA telemetry — those belong to other skills.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Use this skill when building, deploying, evaluating, debugging, or measuring latency for the DeepStream SOP Inference Microservice — a GPU-accelerated FastAPI service that detects whether operators perform assembly-line steps in order via event boundary detection (GEBD) plus VLM classification. Trigger even if the user does not name it: verify operator step sequence, detect missing or out-of-order SOP steps, score factory/work-cell video for procedure compliance, run VLM-based SOP checking on industrial cameras, or call /v1/chat/completions with a file, RTSP, or Basler camera. Also trigger for its internals: SOPVideoProcessor, DeepStream GEBD model (e.g. DDM) via Triton CAPI, nvds_custom_postprocess, Cosmos Reason 1/2 vLLM, SSE streaming, Kafka NvProto/JSON output, Basler/Pylon camera + emulation, Docker compose, chunk-level latency. Do NOT trigger for generic DeepStream pipelines, object detection/tracking, NIM imports, or video summarization.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

[omh] Tracking cost, tokens, latency, or service health: prepare an operations command-board for wrapper-safe token, cost, latency, run history, queue, failure-mode, external metric-provider, and service-quality evidence boundaries. Use when the user says: ops-observability-card, observability card, operations command board, ops command board, service quality board, service quality, external metric provider, metric provider.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Activate when developers have latent caching needs: slow API responses, database read bottlenecks, DynamoDB throttling or cost, RDS/Aurora scaling pressure, Bedrock latency or cost, or adding a cache; activate when working with Redis, Valkey, Memcached, or any in-memory data store, cache-aside patterns, session stores, rate limiting, leaderboards, counters, streams, queues, pub/sub, distributed locks, feature flags, shopping carts, or other caching strategies. Activate for GenAI and ML retrieval: vector similarity search for low-latency retrieval, semantic caching, RAG, LLM response caching, embedding stores, AI agent memory, recommendation, personalization. Activate for ElastiCache lifecycle: provisioning (serverless or node-based), engine selection, CloudFormation/CDK/Terraform IaC, VPC connectivity, TLS, RBAC, IAM auth, Global Datastore, monitoring, troubleshooting, cost optimization, and migration from self-managed Redis. Do not trigger for browser caches, CDN/CloudFront, HTTP Cache-Control, CPU caches.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Analyze and tune AssemblyAI model choice, audio delivery, polling, Streaming v3 turns, concurrency, and downstream work. Use when pursuing measured latency or throughput goals. Trigger with "tune AssemblyAI" or "AssemblyAI latency".

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Optimize Apollo.io API performance. Use when improving API response times, reducing latency, or optimizing bulk operations. Trigger with phrases like "apollo performance", "optimize apollo", "apollo slow", "apollo latency", "speed up apollo".

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Optimize Claude API performance with prompt caching, model selection, streaming, and latency reduction techniques. Use when experiencing slow responses, optimizing token usage, or reducing time-to-first-token in production. Trigger with phrases like "anthropic performance", "claude speed", "optimize claude latency", "anthropic caching", "faster claude responses".

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Tune Alchemy-backed reads with measured latency, cache semantics, batching, concurrency, and freshness SLOs. Use when an integration is slow or wasteful. Trigger with "optimize Alchemy performance", "cache Alchemy data", or "reduce Alchemy latency".

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.