跳到正文
cccskills

“high throughput”的搜索结果

69 个 · 按相关度排序

Deploy language models with vLLM through an OpenAI-compatible API or offline batch processing. Tune response speed, throughput, and GPU memory use with quantization, which reduces numerical precision, and execution across multiple GPUs.

中文简介正在准备中。当前显示英语简介。

  • Deploy an OpenAI-compatible language model API
  • Generate text from many prompts in a batch
  • Serve quantized models with limited GPU memory
davila7/claude-code-templates3.3万2026年10月18日 更新

Deploy language model APIs and run batch generation with vLLM. Configure GPU memory use, quantization—lower precision model storage—and distribution across GPUs, then test response times and monitor how many requests the server handles.

中文简介正在准备中。当前显示英语简介。

  • Deploying an OpenAI-compatible language model API
  • Generating responses for a large set of prompts
  • Fitting a large model into limited GPU memory
Orchestra-Research/AI-Research-SKILLs1.4万2026年10月11日 更新

vllm

免费

Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.

中文简介正在准备中。当前显示原文说明。

huang-sh/DeepScience42026年7月15日 更新

Pick the right ComfyUI startup flags for VRAM, attention, caching, and speed. The full decision matrix for OOM (--novram / --cache-none / --disable-smart-memory), shared-VRAM creep on Windows (--reserve-vram N), model-switching with big text encoders (--cache-none), high-VRAM throughput (--gpu-only / --highvram), and attention-backend selection (--use-sage-attention for speed, --use-pytorch-cross-attention as the highest-quality / Z-Image-safe fallback). Also the acceleration-stack + Blackwell/RTX 5000 (sm_120) notes. Use when a graph OOMs (especially long video like LTX 2 / WAN), when the GPU spills into shared VRAM and slows to a crawl, when switching between models eats all RAM, when Z-Image produces black/garbled output under Sage, or when deciding which attention backend to launch with. Flag names verified against upstream comfy/cli_args.py; see Sources.

中文简介正在准备中。当前显示原文说明。

artokun/comfyui-mcp8402026年10月19日 更新

Use when you need to refactor Java code for high performance — including memory/allocation reduction, CPU hot-path optimization, and syntax/API/control-flow improvements. This should trigger for requests such as Review Java code for high performance; Optimize Java hot path; Reduce Java allocations; Improve Java latency/throughput. Part of Plinth Toolkit

中文简介正在准备中。当前显示原文说明。

jabrena/plinth4532026年10月19日 更新

Expert-level materials informatics covering materials databases, machine learning for property prediction, high-throughput computation, and data-driven materials discovery.

中文简介正在准备中。当前显示原文说明。

luokai0/ai-agent-skills-by-luo-kai132026年5月6日 更新

Serve LLMs com alta throughput usando PagedAttention do vLLM e continuous batching. Use ao fazer deploy de APIs LLM em produção, otimizar latência/throughput de inferência, ou servir modelos com memória GPU limitada. Suporta endpoints compatíveis com OpenAI, quantização (GPTQ/AWQ/FP8) e tensor parallelism.

中文简介正在准备中。当前显示原文说明。

artubss/SKILLS-CLAUDE-CODE112026年5月17日 更新

serving-llms-vllm

免费有简介AI 评分 70分

协助配置vLLM,将大语言模型作为API提供服务或批量生成文本,涵盖部署、性能监控、量化和多GPU分工,也用于排查显存不足与响应缓慢。

  • 提供兼容OpenAI的API
  • 批量处理大量提示词
  • 在有限显存下运行模型
NousResearch/hermes-agent25.5万2026年10月19日 更新

Configure LLM inference and serving on NVIDIA GPUs with TensorRT-LLM. Covers quantization, which reduces numerical precision, batching requests during generation, and distributing models across GPUs to improve processing capacity and response times.

中文简介正在准备中。当前显示英语简介。

  • Setting up an LLM server on NVIDIA GPUs
  • Configuring FP8 or INT4 quantization
  • Distributing large models across multiple GPUs
davila7/claude-code-templates3.3万2026年10月18日 更新

Configure LLM inference and serving on NVIDIA GPUs with TensorRT-LLM. Covers quantization, which reduces numerical precision, batching requests during generation, and distributing models across GPUs to improve processing capacity and response times.

中文简介正在准备中。当前显示英语简介。

  • Setting up an LLM server on NVIDIA GPUs
  • Configuring FP8 or INT4 quantization
  • Distributing large models across multiple GPUs
Orchestra-Research/AI-Research-SKILLs1.4万2026年10月11日 更新

The sva package contains functions for removing batch effects and other unwanted variation in high-throughput experiment. Specifically, the sva package contains functions for the identifying and building surrogate variables for high-dimensi

中文简介正在准备中。当前显示原文说明。

bioMate-AI/biomate-bioconductor-kb7972026年6月21日 更新

Systematically find and fix performance problems in applications, frontend and backend, by measuring first. Use this skill whenever the user reports slow endpoints, high latency, poor throughput, memory leaks, large bundles, or slow page loads; wants to profile with cProfile, py-spy, Chrome DevTools, Node --cpu-prof, or perf; run load tests with locust or k6; set performance budgets or SLOs; optimize database queries (EXPLAIN, indexes, N+1); add caching (Redis); improve frontend performance (code splitting, lazy loading, image optimization, memoization, virtualization); or tune the network (CDNs, gzip/br, HTTP/2/3). Also trigger for p50/p95/p99 latency, throughput, error rate, connection pooling, async vs threads, GIL, and memory leak investigations.

中文简介正在准备中。当前显示原文说明。

svngoku/coding-agents-skills122026年10月18日 更新

Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.

中文简介正在准备中。当前显示原文说明。

huang-sh/DeepScience42026年7月15日 更新

Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.

中文简介正在准备中。当前显示原文说明。

ibragimov-oasis/vibe-coder32026年6月24日 更新

Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.

中文简介正在准备中。当前显示原文说明。

Lord1Egypt/awesome-skill-forge22026年6月10日 更新

tensorrt-llm

免费有简介AI 评分 90分

帮助在NVIDIA GPU上加速大语言模型的响应生成,并通过API提供服务。支持量化、批量处理和多GPU分布运行,以调整显存占用与服务性能。

  • 通过聊天API提供语言模型服务
  • 批量处理大量提示词
  • 通过量化减少显存占用
NousResearch/hermes-agent25.5万2026年10月19日 更新

Deploy Suricata to detect suspicious network traffic or block it inline. Configure protocol inspection, detection rules, and structured EVE JSON logs, then connect logs to analysis platforms and check packet drops and alert quality during operation.

中文简介正在准备中。当前显示英语简介。

  • Deploying network intrusion monitoring
  • Configuring inline blocking of malicious traffic
  • Adding custom detection rules and reducing noisy alerts
mukul975/Anthropic-Cybersecurity-Skills3.5万2026年8月31日 更新

Assess Google Cloud workloads for environmental sustainability using the Well-Architected Framework. Get recommendations on lower-carbon regions, efficient computing and storage, AI energy use, and ongoing emissions measurement with Carbon Footprint.

中文简介正在准备中。当前显示英语简介。

  • Reviewing cloud architecture for environmental impact
  • Comparing deployment regions by carbon-free energy use
  • Reducing energy waste in AI and computing workloads
google/skills2.1万2026年10月17日 更新

Use this skill when the user is measuring the host or DPU-CPU control-plane rate of a DOCA Flow pipeline with doca_flow_perf — picking a JSON policy from configs/, choosing the DPDK or DOCA backend, running the single-iteration smoke then the iterative eval loop, interpreting per-iteration CPU cycles and num_pushed / num_failed, or capturing the four-tuple (DOCA version, BlueField/firmware, JSON policy, worker/queue/burst config) that makes a Kops/sec number defensible. Trigger even when the user does not explicitly mention "doca-flow-perf" — typical implicit phrasings include "how many rules per second can my BlueField insert", "5-tuple hairpin rule rate", "Kops/sec for steering", "flow-perf number does not match release notes", "DPDK vs DOCA benchmark", or "rule-install variance too high". Refuse and route elsewhere for optimizing a live Flow app (doca-flow-tune), the DPA-offloaded path (doca-flow-dpa-perf), dataplane throughput or latency, or library-internal pipe semantics — those belong to other skills.

中文简介正在准备中。当前显示原文说明。

NVIDIA/skills36472026年10月18日 更新

ulw-work

免费

[omh] Accepted plan awaiting implementation: split it into disjoint parallel lanes with per-lane acceptance criteria, verification commands, and owners; prevents two lanes editing the same file. Aliases: ulw. Use when the user says: ultrawork, parallel work, parallel implementation, parallel then integrate, high throughput, coding team, coordinated workers, finish until done.

中文简介正在准备中。当前显示原文说明。

rlaope/oh-my-hermes34332026年10月19日 更新

Build event streaming applications using Azure Event Hubs SDK for JavaScript (@azure/event-hubs). Use when implementing high-throughput event ingestion, real-time analytics, IoT telemetry, or event-driven architectures with partitioned consumers.

中文简介正在准备中。当前显示原文说明。

microsoft/skills31342026年10月18日 更新

Azure Event Hubs SDK for Python streaming. Use for high-throughput event ingestion, producers, consumers, and checkpointing. Triggers: "event hubs", "EventHubProducerClient", "EventHubConsumerClient", "streaming", "partitions".

中文简介正在准备中。当前显示原文说明。

microsoft/skills31342026年10月18日 更新

Build real-time streaming applications with Azure Event Hubs SDK for Java. Use when implementing event streaming, high-throughput data ingestion, or building event-driven architectures.

中文简介正在准备中。当前显示原文说明。

microsoft/skills31342026年10月18日 更新

Azure Event Hubs SDK for .NET. Use for high-throughput event streaming: sending events (EventHubProducerClient, EventHubBufferedProducerClient), receiving events (EventProcessorClient with checkpointing), partition management, and real-time data ingestion. Triggers: "Event Hubs", "event streaming", "EventHubProducerClient", "EventProcessorClient", "send events", "receive events", "checkpointing", "partition".

中文简介正在准备中。当前显示原文说明。

microsoft/skills31342026年10月18日 更新