Compress large language models to 4-bit weights to reduce GPU memory use and accelerate inference. Covers loading compressed models, configuring quantization, and using Transformers or vLLM, with guidance on hardware requirements and backend choices.
- Running large models with limited GPU memory
- Compressing a model with domain-specific sample text
- Serving AWQ models with vLLM
davila7/claude-code-templates☆ 32.8KUpdated Oct 20, 2026
Run language models locally with llama.cpp on CPUs, Apple Silicon, or AMD and Intel GPUs. The skill guides model setup, memory-saving GGUF format choices, interactive chat, and serving models through an OpenAI-compatible API.
- Running a language model on a CPU-only computer
- Setting up local chat on an Apple Silicon Mac
- Choosing model quantization to fit available memory
davila7/claude-code-templates☆ 32.8KUpdated Oct 20, 2026
Build and train Mixture of Experts models, which activate selected specialist networks for each input. Use DeepSpeed or HuggingFace workflows to configure routing, balance workloads, distribute experts across GPUs, and optimize inference.
- Designing MoE models for a limited compute budget
- Implementing Mixtral-style expert routing
- Adjusting expert workloads and training stability
davila7/claude-code-templates☆ 32.8KUpdated Oct 20, 2026
Choose and run checks for Python SDK changes using nox, Makefile targets, Ruff, mypy, and pytest markers. It supports adding tests, diagnosing CI issues, and checking basic behavior, type inference, and builds.
- Adding tests for Python SDK changes
- Diagnosing Python CI issues
- Checking SDK and provider changes
ComposioHQ/composio☆ 30.6KUpdated Oct 19, 2026
Create, modify, test, or package Python provider adapters, the components used for framework connections. Work covers framework dependencies, public imports, type inference, and provider metadata within python/providers, with a referenced workflow to consult before changes.
- Create or modify a Python provider adapter
- Adjust framework-specific dependencies and public imports
- Work on type inference and provider metadata
ComposioHQ/composio☆ 30.6KUpdated Oct 19, 2026
Call Gemini and OpenMaaS models such as Llama, DeepSeek, and Qwen through Google Cloud Agent Platform. Prepare authentication and SDK code, run prompts, configure connection endpoints, and troubleshoot common request errors.
- Send a test prompt to Gemini
- Call Llama or DeepSeek with the OpenAI SDK
- Write code to call an existing custom endpoint
google/skills☆ 21.4KUpdated Oct 20, 2026
Train Mixture of Experts models, which activate selected specialist networks for each input. The skill guides architecture, input routing, workload balancing, and GPU distribution using DeepSpeed or HuggingFace, with examples for training configuration and inference optimization.
- Designing a model that activates only selected expert networks
- Balancing workloads across expert networks
- Distributing experts across multiple GPUs
Orchestra-Research/AI-Research-SKILLs☆ 13.7KUpdated Oct 11, 2026
Evaluate NVIDIA Cosmos Policy for robot manipulation in LIBERO and RoboCasa simulations. Follow GPU environment setup, configure rendering without a display, run small checks before larger benchmarks, inspect success rates, and profile inference latency.
- Running a small LIBERO evaluation
- Evaluating kitchen tasks in RoboCasa
- Setting up simulation on a GPU cluster without a display
Orchestra-Research/AI-Research-SKILLs☆ 13.7KUpdated Oct 11, 2026
Convert language models to GGUF and reduce their size through quantization, which stores model weights at lower precision. Guides cover compression choices, local inference on CPUs and Apple Silicon, and integration with tools such as Ollama.
- Running a language model on a CPU-only computer
- Choosing model compression for available memory
- Configuring Metal acceleration on Apple Silicon
Orchestra-Research/AI-Research-SKILLs☆ 13.7KUpdated Oct 11, 2026
Guides large language model reinforcement learning with miles, including MoE models that route work to specialized components. Covers low-precision training, matching training and inference behavior, and accelerating training response generation with draft models.
- Setting up reinforcement learning for large MoE models
- Configuring FP8 or INT4 training
- Checking consistency between training and inference
Orchestra-Research/AI-Research-SKILLs☆ 13.7KUpdated Oct 11, 2026
Compress large language model weights to four bits with AWQ, a method that uses model activation patterns to limit quality loss. Follow workflows for quantization, loading compressed models, and serving them with vLLM using less GPU memory.
- Running large language models with limited GPU memory
- Quantizing a model with domain-specific text
- Serving an AWQ model with vLLM
Orchestra-Research/AI-Research-SKILLs☆ 13.7KUpdated Oct 11, 2026
Guides you through setting up RWKV, generating text, processing long documents in chunks, and fine-tuning models. Explains how to carry context between steps and compare memory use with Transformer models.
- Build streaming text generation
- Process long documents in chunks
- Plan RWKV fine-tuning
Orchestra-Research/AI-Research-SKILLs☆ 13.7KUpdated Oct 11, 2026
Guides setup and operation of Lambda Labs GPU instances for machine learning training and inference. Covers SSH access, persistent storage, API automation, and multi-GPU or multi-node training, including how to retain checkpoints and terminate idle instances.
- Setting up a GPU instance for LLM fine-tuning
- Keeping datasets and checkpoints between sessions
- Automating instance launch and termination through the API
Orchestra-Research/AI-Research-SKILLs☆ 13.7KUpdated Oct 11, 2026
Set up NVIDIA infrastructure for synthetic data generation on MicroK8s or Azure AKS. Coordinate Kubernetes, inference services, and OSMO workflow execution, with prerequisite checks, deployment validation, capacity planning, and failure investigation before workloads are retried.
- Set up a synthetic data generation environment on MicroK8s
- Deploy an Azure AKS environment with OSMO and inference services
- Check GPU quotas and capacity before scaling
openai/plugins☆ 7.5KUpdated Oct 8, 2026
Compare ways to distribute AI inference across multiple instances, including replicas and separate input-processing and generation stages. Estimate capacity, throughput, delays, state-transfer costs, and recovery overhead to support routing and scaling decisions.
- Compare replicas with separate inference stages
- Plan routing around compute capacity and cached state
- Evaluate expert placement and load imbalance
bojieli/ai-infra-book☆ 6.8KUpdated Oct 1, 2026
Connect applications to NEAR AI Cloud for AI responses generated in protected computing environments. Use its OpenAI-compatible API and follow the verification flow for hardware proofs and response signatures to check which protected environment signed a response.
- Connecting a chat app to the OpenAI-compatible API
- Verifying GPU and CPU execution environment proofs
- Checking response signatures against verified signing addresses
internet-court/internet-court-skill☆ 6.8KUpdated Aug 20, 2026
Select technologies for AI and machine learning features in .NET 8+ applications. Get task-specific plans or implementation guidance for structured predictions, text generation, document retrieval, tool-using agents, and running pretrained models locally or in production.
- Choosing libraries for classification or prediction in .NET
- Adding text generation or summarization to an application
- Designing document retrieval with source-backed AI answers
dotnet/skills☆ 5.7KUpdated Oct 20, 2026
Production-grade Bayesian causal inference with PyMC, CausalPy, and DoWhy. Enforces DAG-first thinking, mandatory user checkpoints for assumptions, design-specific refutation, and defensible reporting with causal language guardrails. Trigger on: causal inference, causal effect estimation, treatment effects, counterfactuals, difference-in-differences (DiD), synthetic control, regression discontinuity (RDD), interrupted time series (ITS), instrumental variables (IV), propensity scores, DAGs, causal graphs, confounders, backdoor criterion, do-calculus, interventional distributions, pm.do(), pm.observe(), CausalPy, DoWhy, mediation analysis, refutation, sensitivity analysis, parallel trends, placebo tests, or any question of the form "does X cause Y" or "what is the effect of X on Y."
The English summary is being prepared. Showing the original description.
brycewang-stanford/Auto-Empirical-Research-Skills☆ 4.7KUpdated Oct 19, 2026
Build DeepStream GStreamer pipelines interactively. Use when the user asks about pipelines for video/image inference, detection, tracking, or streaming — including natural phrases like 'pipeline to infer on image', 'run inference on video', 'detect objects in stream', 'save inference output', 'deepstream pipeline', 'gst-launch pipeline', 'process video with detection', 'build a pipeline', or any request involving GStreamer/DeepStream elements (nvinfer, nvstreammux, nvtracker, etc.).
The English summary is being prepared. Showing the original description.
NVIDIA/skills☆ 3.7KUpdated Oct 20, 2026
[omh] Self-hosted LLM serving on GPUs: choose the serving engine and quantization from decision tables, prepare deployment as an idempotent runbook with observed-only verification, and measure the endpoint with the standard TTFT/TPOT/goodput protocol. Use when the user says: inference-serving, inference serving, serve this model, serve the model, model serving, serving endpoint, vllm, llama.cpp.
The English summary is being prepared. Showing the original description.
rlaope/oh-my-hermes☆ 3.4KUpdated Oct 19, 2026
Run inference on Fireworks AI — direct, through the Leanmcp AI Gateway proxy (aigateway.leanmcp.com) for observability, or via LiteLLM / the OpenAI SDK / raw HTTP. Covers the endpoint-and-key matrix for each route, serverless vs dedicated deployments and their cold starts, browsing and filtering the model catalogue, reasoning models that return content:null with the answer in reasoning_content, function calling, concurrency and load testing, and runner scripts where many models share one protocol with a --use-proxy toggle. Use this skill whenever the user mentions Fireworks, FIREWORKS_API_KEY, api.fireworks.ai, fireworks_ai/ model ids, accounts/fireworks/models/..., a Fireworks deployment id, the Leanmcp gateway or LEANMCP_API_KEY, app.leanmcp.com observability, or gpt-oss / kimi / glm / qwen / deepseek served on Fireworks; wants to route LLM calls through a proxy for logging or cost tracking; is debugging empty responses, 404s, scope errors, cold starts, or "the gateway isn't working"; wants to pick a Fireworks model with tool calling; or wants to sweep several models over one benchmark. Reach for it even on vague asks like "why is this model returning nothing" or "set up inference for these models" when Fireworks is in play.
The English summary is being prepared. Showing the original description.
Leanmcp/gateway-skills☆ 2.1KUpdated Oct 8, 2026
Train and run models on Tinker (Thinking Machines) — LoRA and full fine-tuning, SFT with correct loss masking, RL/RFT with group-relative advantages and importance sampling, agentic RL over multi-turn tool-using agents, inference via the SamplingClient or the OpenAI-compatible endpoint, checkpoint management and export, every hyperparameter, and cost estimation from the live price table. Use this skill whenever the user mentions Tinker, tinker://, TINKER_API_KEY, console.tinker.ai, or the tinker CLI; wants to fine-tune, SFT, RFT, or RL a model on Tinker; asks about Tinker models, context windows, LoRA rank, sampling params, loss functions (cross_entropy, importance_sampling, ppo, cispo, dro), Datum construction, forward_backward or optim_step; wants to sample from, download, resume, merge, or export a Tinker checkpoint; or asks what a Tinker run will cost. Whenever Tinker work is initialized in a project, this skill also creates a TINKER_PRICING.md there so prices sit next to the training code. Reach for it even on vague asks like "train a model on this data" or "get inference working" when Tinker is the platform in play.
The English summary is being prepared. Showing the original description.
Leanmcp/gateway-skills☆ 2.1KUpdated Oct 8, 2026
No Inference / Source-Locked Verification. Forces Claude to answer ONLY from user-provided materials and/or online sources actually accessed — no inference, no assumptions, no gap-filling. Every factual, legal, numerical, or procedural claim must be anchored to a cited source. Use whenever Claude reviews documents, summarises evidence, checks accuracy, drafts submissions, creates timelines, extracts facts, checks citations, analyses rules, prepares legal arguments, compares documents, verifies claims, produces chronologies, works from uploaded materials, performs legal research, checks case status, or does anything where evidential fidelity matters. Also trigger on: 'source-locked', 'no inference', 'only from the materials', 'don't assume', 'stick to the evidence', 'verify this', 'check this is right', 'work from the documents'. Overrides Claude's default tendency to fill gaps. If evidential accuracy matters, use this skill.
The English summary is being prepared. Showing the original description.
lawve-ai/awesome-legal-skills☆ 878Updated Oct 3, 2026
Guides technology selection and implementation of AI and ML features in .NET 8+ applications using ML.NET, Microsoft.Extensions.AI (MEAI), Microsoft Agent Framework (MAF), GitHub Copilot SDK, ONNX Runtime, and OllamaSharp. Covers the full spectrum from classic ML through modern LLM orchestration to local inference. Use when adding classification, regression, clustering, anomaly detection, recommendation, LLM integration (text generation, summarization, reasoning), RAG pipelines with vector search, agentic workflows with tool calling, Copilot extensions, or custom model inference via ONNX Runtime to a .NET project. DO NOT USE FOR projects targeting .NET Framework (requires .NET 8+), the task is pure data engineering or ETL with no ML/AI component, or the project needs a custom deep learning training loop (use Python with PyTorch/TensorFlow, then export to ONNX for .NET inference).
The English summary is being prepared. Showing the original description.
managedcode/dotnet-skills☆ 490Updated Oct 17, 2026