Configure LLM inference and serving on NVIDIA GPUs with TensorRT-LLM. Covers quantization, which reduces numerical precision, batching requests during generation, and distributing models across GPUs to improve processing capacity and response times.
- Setting up an LLM server on NVIDIA GPUs
- Configuring FP8 or INT4 quantization
- Distributing large models across multiple GPUs
davila7/claude-code-templates☆ 32.8KUpdated Oct 18, 2026
Configure LLM inference and serving on NVIDIA GPUs with TensorRT-LLM. Covers quantization, which reduces numerical precision, batching requests during generation, and distributing models across GPUs to improve processing capacity and response times.
- Setting up an LLM server on NVIDIA GPUs
- Configuring FP8 or INT4 quantization
- Distributing large models across multiple GPUs
Orchestra-Research/AI-Research-SKILLs☆ 13.7KUpdated Oct 11, 2026
Collect weekly snack requests from Slack, combine duplicate items with standing staples, and prepare a vendor cart within budget. Share the draft for the office manager's written approval before placing the order.
- Batching office snack requests each week
- Combining duplicate requests and standing staples
- Adjusting a draft order to fit the weekly budget
kortix-ai/suna☆ 20.3KUpdated Oct 19, 2026
Patterns for managing MSBuild item groups: Include/Remove/Update semantics, item metadata, batching with %(Metadata), transforms, per-item filtering, and cross-product batching pitfalls. Only activate in MSBuild/.NET build context. USE FOR: diagnosing and fixing item group anti-patterns in .csproj files, reviewing item management for correctness, fixing CS2002 duplicate file warnings from SDK globbing, fixing targets that run more times than expected due to cross-product batching, fixing Include vs Update misuse on SDK-globbed items, fixing FileWrites registration for generated file clean support, moving generated files to IntermediateOutputPath. DO NOT USE FOR: target chain architecture (use target-authoring), property patterns (use property-patterns), incrementality (use incremental-build), general anti-patterns (use msbuild-antipatterns), non-MSBuild build systems.
The English summary is being prepared. Showing the original description.
bouclem/skills☆ 7Updated May 31, 2026
Improve GSAP animation performance by reviewing movement properties, batching page measurements and updates, and stopping unused animations. It guides changes for smoother motion, including efficient handling of long lists, pointer tracking, and scroll-driven effects.
- Reducing stutter in GSAP animations
- Improving animations across many list items
- Optimizing effects that follow the pointer
nexu-io/open-design☆ 102.5KUpdated Oct 19, 2026
Set up Phoenix tracing for LLM applications in Python or TypeScript. The skill guides automatic and custom recording of individual operations, conversation grouping, metadata, feedback, and production settings such as batching and personal data masking.
- Set up tracing for an LLM application
- Record document retrieval and tool calls
- Group conversation traces by session
github/awesome-copilot☆ 40.2KUpdated Oct 17, 2026
Deploy language models with vLLM through an OpenAI-compatible API or offline batch processing. Tune response speed, throughput, and GPU memory use with quantization, which reduces numerical precision, and execution across multiple GPUs.
- Deploy an OpenAI-compatible language model API
- Generate text from many prompts in a batch
- Serve quantized models with limited GPU memory
davila7/claude-code-templates☆ 32.8KUpdated Oct 18, 2026
Deploy language model APIs and run batch generation with vLLM. Configure GPU memory use, quantization—lower precision model storage—and distribution across GPUs, then test response times and monitor how many requests the server handles.
- Deploying an OpenAI-compatible language model API
- Generating responses for a large set of prompts
- Fitting a large model into limited GPU memory
Orchestra-Research/AI-Research-SKILLs☆ 13.7KUpdated Oct 11, 2026
Assess GraphQL APIs during penetration tests, from finding endpoints and mapping data structures to checking access controls, query limits, subscriptions, and uploads. Includes example queries, guidance for testing tools, and defensive controls for interpreting findings.
- Map GraphQL endpoints and data structures
- Check access controls across users and roles
- Review query limits and subscription security
SnailSploit/Claude-Red☆ 7.6KUpdated Oct 13, 2026
Compare batching, request scheduling, and memory management for a single model serving instance. Assess concurrent request capacity, response times, generation speed, and GPU time per result that meets the required quality and deadline.
- Comparing batching and request scheduling options
- Checking memory capacity for concurrent requests
- Assessing cache reuse and offloading tradeoffs
bojieli/ai-infra-book☆ 6.7KUpdated Oct 1, 2026
Own concrete MSBuild ItemGroup and item-expression questions. USE FOR: Include, Remove, Update, item identity and metadata, transforms, filtering, batching, duplicate or overlapping items, and reviews that verify whether those operations are correct. Generated items stay in scope when the central defect is item identity, metadata, batching, duplicate declarations, or glob/Remove/Update semantics. For a generated artifact missing from compilation or output, wrong target timing/path, or FileWrites clean tracking without a broader item-semantics defect, use including-generated-files. The item operation may be broken, suspected, or already correct. Exclude property-only issues, general incrementality with no item question, broad reviews with no concrete item concern, and non-MSBuild systems.
The English summary is being prepared. Showing the original description.
dotnet/skills☆ 5.7KUpdated Oct 18, 2026
Find and fix game performance problems methodically — measure with the engine profiler first, reason about the frame-time budget, locate the CPU-vs-GPU bottleneck, then apply the right fix: object pooling, draw-call batching, fewer allocations/GC spikes, and asset budgets. Engine- neutral method that pairs with each engine's profiler. Use when the user mentions performance, optimize, low/dropping FPS, frame drops, stutter, lag, profiler, frame budget, draw calls, batching, garbage collection/GC spikes, object pooling, or "the game runs slow".
The English summary is being prepared. Showing the original description.
gamedev-skills/awesome-gamedev-agent-skills☆ 1.7KUpdated Oct 9, 2026
Treat context switches as the budget line they are — the switch census (how fragmented the week really is), the batching moves that consolidate scattered same-kind work, the calendar defrag that turns Swiss cheese into slabs, and the switch-cost line for saying no. Use when asked my day is fragmented to death, count my context switches, batch my meetings and reviews, or defend against calendar Swiss cheese. Produces the fragmentation census, the batching plan, the defrag moves, and the protective phrases.
The English summary is being prepared. Showing the original description.
mohitagw15856/pm-claude-skills☆ 1.5KUpdated Oct 19, 2026
Own concrete MSBuild ItemGroup and item-expression questions. USE FOR: Include, Remove, Update, item identity and metadata, transforms, filtering, batching, duplicate or overlapping items, and reviews that verify whether those operations are correct. Generated items stay in scope when the central defect is item identity, metadata, batching, duplicate declarations, or glob/Remove/Update semantics. For a generated artifact missing from compilation or output, wrong target timing/path, or FileWrites clean tracking without a broader item-semantics defect, use including-generated-files. The item operation may be broken, suspected, or already correct. Exclude property-only issues, general incrementality with no item question, broad reviews with no concrete item concern, and non-MSBuild systems.
The English summary is being prepared. Showing the original description.
managedcode/dotnet-skills☆ 490Updated Oct 17, 2026
Expert guide for parallel tool execution, MCP batching (vibes_batch), asynchronous Promise.allSettled pipelines, subagent concurrent fan-out, and latency-optimized tool calling loops / Panduan ahli eksekusi tool paralel dan batching MCP.
The English summary is being prepared. Showing the original description.
roedyrustam/vibes-plug☆ 80Updated Oct 19, 2026
Turn a brand's positioning into a 30-day, multi-platform content batch — 3-7 pillars, subtopic matrix mapped to funnel stage and persona, pillar pieces plus derivative fan-out, proof elements in at least half the slots, all registered in the editorial calendar store and quality-gated. Use when "content batch", "batch my content", "30 days of content", "month of content", "content batching machine", "content pillars", "fill the content calendar", "plan a month of posts", or any request to produce a full month of multi-platform content in one run.
The English summary is being prepared. Showing the original description.
cgallic/kai-cmo-harness☆ 57Updated Oct 19, 2026
Identify and exploit GraphQL API vulnerabilities by leveraging Introspection queries to dump the entire database schema, performing query batching to bypass rate limits (brute forcing), and extracting deeply nested unauthorized data via graph relationship abuse.
The English summary is being prepared. Showing the original description.
ShulkwiSEC/bb-huge☆ 23Updated Jul 11, 2026
Exploit GraphQL API architectural features to execute highly efficient brute-force, Credential Stuffing, and Denial of Service (DoS) attacks. Utilize Query Batching and Alias injection to bypass rate limits by packing thousands of requests into a single HTTP POST request.
The English summary is being prepared. Showing the original description.
ShulkwiSEC/bb-huge☆ 23Updated Jul 11, 2026
Diagnose and eliminate the GraphQL N+1 resolver explosion using Facebook DataLoader's per-request batching, plus the second-order defenses (persisted queries, depth limits, cost analysis). Use when a GraphQL query that returns N items in a list triggers N+1 database round trips, when designing nested resolvers that load associations, when a list query times out under load, or when you need to budget query cost before resolvers run. NOT for REST-style endpoint design (use api-versioning-strategy), generic database query optimization (use database-query-optimizer), or schema design (use graphql-server-architect).
The English summary is being prepared. Showing the original description.
curiositech/windags-skills☆ 16Updated Oct 14, 2026
Otimiza inferência de LLM com NVIDIA TensorRT para máxima vazão e latência mínima. Use para implantação em produção em GPUs NVIDIA (A100/H100), quando você precisa de inferência 10-100x mais rápida que PyTorch, ou para servir modelos com quantização (FP8/INT4), batching em voo e escalabilidade multi-GPU.
The English summary is being prepared. Showing the original description.
artubss/SKILLS-CLAUDE-CODE☆ 11Updated May 17, 2026
Serve LLMs com alta throughput usando PagedAttention do vLLM e continuous batching. Use ao fazer deploy de APIs LLM em produção, otimizar latência/throughput de inferência, ou servir modelos com memória GPU limitada. Suporta endpoints compatíveis com OpenAI, quantização (GPTQ/AWQ/FP8) e tensor parallelism.
The English summary is being prepared. Showing the original description.
artubss/SKILLS-CLAUDE-CODE☆ 11Updated May 17, 2026
GraphQL saldırıları — introspection, aliased query batching, rate limit bypass
The English summary is being prepared. Showing the original description.
MustafaKemal0146/fetih☆ 5Updated Oct 11, 2026
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026