Skip to content
cccskills

Results for “llm ops”

360 skills · sorted by relevance

caveman-setup

FreeSummary

Connect an application's LLM calls through the Caveman Cloud gateway to measure usage and cost without changing request content. The skill updates connection settings and verifies the integration with one small, real provider request.

  • Start measuring an LLM application's usage and cost
  • Route existing LLM calls through the gateway
  • Verify a connection with a real request
JuliusBrussee/caveman113.6KUpdated Oct 18, 2026

Choose a serving container for models deployed on SageMaker. Match the model type to a compatible image, retrieve its address from the AWS catalog, and check regional availability, CPU or GPU variants, and required host settings.

  • Choose a container for an LLM deployment
  • Select images for embeddings and rerankers
  • Check regional image addresses and GPU compatibility
huggingface/skills11.2KUpdated Oct 9, 2026

Use LangSmith to record LLM application inputs, outputs, and timing, investigate failures, evaluate answers against test datasets, and monitor production usage. It also guides automated quality checks and analysis of token usage and costs.

  • Investigating failures in LLM applications
  • Evaluating answers against test datasets
  • Monitoring production latency and costs
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

llm-ops

FreeSummary

Build and operate LLM applications with guidance on RAG, which uses retrieved documents to inform answers. Covers document indexing, vector database selection, prompt improvement, response evaluation, caching, and estimates of model usage costs.

  • Building an assistant that answers from documents
  • Choosing a vector database for document search
  • Comparing answer quality after prompt changes
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

llm-app-patterns

FreeSummary

Design LLM applications using patterns for answers grounded in documents, agents that use tools, and prompt testing. Implementation examples also cover monitoring response quality, latency, costs, and failures during operation.

  • Building an assistant that answers from internal documents
  • Choosing an architecture for an agent that uses tools
  • Comparing and versioning prompts
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

Use LangSmith to record LLM application inputs, outputs, and timing, investigate failures, evaluate answers against test datasets, and monitor production usage. It also guides automated quality checks and analysis of token usage and costs.

  • Investigating failures in LLM applications
  • Evaluating answers against test datasets
  • Monitoring production latency and costs
Orchestra-Research/AI-Research-SKILLs13.7KUpdated Oct 11, 2026

Deploy language model APIs and run batch generation with vLLM. Configure GPU memory use, quantization—lower precision model storage—and distribution across GPUs, then test response times and monitor how many requests the server handles.

  • Deploying an OpenAI-compatible language model API
  • Generating responses for a large set of prompts
  • Fitting a large model into limited GPU memory
Orchestra-Research/AI-Research-SKILLs13.7KUpdated Oct 11, 2026

Prepare trained machine learning models for production with deployment, monitoring, and retraining workflows. Build RAG systems that retrieve documents for answers, and integrate language model APIs with retries, fallback providers, and cost tracking.

  • Deploying a trained model to production
  • Setting up model monitoring and retraining workflows
  • Building a RAG pipeline for document-based answers
alirezarezvani/claude-skills28.4KUpdated Aug 30, 2026

Launch a new OpenClaw, PicoClaw, or Ottie deployment through Cloud Claw using the local CLI. Configure the agent type, deployment name, model, and Telegram settings according to the supported launch options and requirements.

  • Launch a new OpenClaw deployment
  • Deploy PicoClaw or Ottie for Telegram
  • Choose an OpenClaw model before launch
internet-court/internet-court-skill6.8KUpdated Aug 20, 2026

llm-evaluation

FreeSummary

Evaluate LLM application quality using automated scores, human reviews, and another language model as a judge. Compare models or prompts, establish baseline results, and detect quality drops through repeatable tests and statistical comparisons.

  • Comparing models and prompts
  • Checking quality before deployment
  • Evaluating search quality in RAG applications
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

debug-inference

FreeSummary

Diagnose failed model requests from OpenShell sandboxes to hosted APIs or local servers such as Ollama and vLLM. Check provider attachment, access rules, credentials, network layout, and client settings to identify the narrowest configuration change needed.

  • Diagnose failed requests to hosted model APIs
  • Troubleshoot connections to Ollama or LM Studio
  • Investigate credential and endpoint mismatch errors
NVIDIA/OpenShell16.7KUpdated Oct 19, 2026

Manage AltLLM Portal API keys for external agents and applications through the local CLI. Covers creation, model access limits, disabling, and revocation, while documenting production failures that currently restrict working operations to listing and creating keys.

  • List active and disabled API keys
  • Create an API key for an external application
  • Specify which models a new key can access
internet-court/internet-court-skill6.8KUpdated Aug 20, 2026

Use Phoenix to record execution traces, detailed records of an AI application's operations, and investigate problems. Evaluate answers on datasets, compare prompts and models, and set up monitoring through a self-hosted server.

  • Investigate AI application problems using execution traces
  • Evaluate answer quality across a test dataset
  • Compare prompts and models through experiments
davila7/claude-code-templates32.8KUpdated Oct 18, 2026

Use Phoenix to record execution traces, detailed records of an AI application's operations, and investigate problems. Evaluate answers on datasets, compare prompts and models, and set up monitoring through a self-hosted server.

  • Investigate AI application problems using execution traces
  • Evaluate answer quality across a test dataset
  • Compare prompts and models through experiments
Orchestra-Research/AI-Research-SKILLs13.7KUpdated Oct 11, 2026

Expert in Langfuse - the open-source LLM observability platform. Covers tracing, prompt management, evaluation, datasets, and integration with LangChain, LlamaIndex, and OpenAI. Essential for debugging, monitoring, and improving LLM applications in production. Use when "langfuse, llm observability, llm tracing, prompt management, llm evaluation, monitor llm, debug llm, langfuse, observability, tracing, llm-monitoring, evaluation, prompt-management, debugging, analytics" mentioned.

The English summary is being prepared. Showing the original description.

omer-metin/skills-for-antigravity168Updated Jan 22, 2026

Erstellt oder überarbeitet einen Skill FÜR DIESES ÖKOSYSTEM: delegiert die generische Interview-/Entwurfs-/Eval-Schleife an das offizielle skill-creator-Plugin (Anthropic, Apache-2.0), setzt aber zusätzlich die ellmos-Anforderungen durch, die das offizielle Plugin nicht kennt — Haus-Frontmatter (9 Felder), Kategorie/Sichtbarkeits-Regeln, anbieter-/nutzer-/ellmos-neutrale aber ellmos-sensitive Erkennung via grounding-seed, mitgelieferte config.json (inkl. Lernvertrag) + connections.json, Anbieter-/Vendor-Bewusstsein (State-of-the-Art-Alternativen inkl. eigener ellmos-Komponenten vorschlagen), einen Selbstaktualisierungs-Abschnitt UND einen wiederverwendbaren Lern-/Abdeckungs-Dateisatz (user-usecases.json, usecase-gaps.json, known-providers-and-abilities.json, gap-closing-analysis.json — an skill-creators evals.json und A2A/AgentSkill angelehnt, kein Parallelstandard). IMMER nutzen, wenn ein NEUER Skill für dieses System entstehen oder ein bestehender auf ellmos-Konformität nachgerüstet werden soll — auch bei "erstelle einen Skill", "bau mir einen Skill für X", "skill-creator nutzen", "neuen Skill anlegen", "diesen Skill ellmos-konform machen", "Lernvertrag/Verhaltenscodex für einen Skill anlegen", "Usecase-Abdeckung eines Skills prüfen". Für reines Skill-FINDEN/ROUTEN stattdessen skill-finder, für Landschafts-Audit skill-explorer.

The English summary is being prepared. Showing the original description.

ellmos-ai/skills8Updated Oct 19, 2026

AI基础设施实战——从GPU集群调度到模型推理部署的全栈实操指南。覆盖:昇腾/GPU统一调度、PyTorch分布式训练、vLLM推理部署、模型量化实战、LLMOps、GPU故障诊断、HuggingFace生态、MLOps流水线。触发词:AI基础设施、GPU、昇腾、训练、推理、vLLM、PyTorch分布式、模型部署、LLMOps、MLOps、集群调度、HuggingFace

The English summary is being prepared. Showing the original description.

aAAaqwq/openclaw-team2Updated Jun 18, 2026

ai-ml

FreeSummary

Plan AI application development by selecting relevant phases and companion skills. The workflow covers language model integration, retrieval from documents, agents, machine learning pipelines, monitoring, and security, with prompts and quality checklists.

  • Plan AI features and language model integration
  • Organize RAG retrieval design and implementation
  • Map agent roles, tools, and memory
sickn33/agentic-awesome-skills48KUpdated Oct 19, 2026

agent-architecture-audit

FreeSummaryAI rating 80

Investigate unreliable AI agents across 12 layers, including instructions, memory, tool execution, and display. Use code and logs to trace failures, rank findings by severity, and produce an ordered repair plan that prioritizes code changes.

  • Investigating failures that appear only inside an agent application
  • Tracing old conversation content leaking into new sessions
  • Checking skipped or falsely claimed tool execution
affaan-m/ECC283.9KUpdated Oct 16, 2026

agentic-eval

FreeSummary

Design workflows that evaluate and refine AI outputs through self-review, separate generation and evaluation roles, tests, or weighted scoring criteria. Includes patterns for structured feedback, iteration limits, and stopping when quality stops improving.

  • Adding self-review and revision loops to AI outputs
  • Separating generation from evaluation
  • Refining generated code using test results
github/awesome-copilot40.2KUpdated Oct 17, 2026

Plan how to serve a model on Amazon SageMaker AI. The skill uses model type, traffic, response time, and cost constraints to recommend a deployment route, check instance quotas, and coordinate specialized setup and deployment skills.

  • Plan AWS hosting for a language model
  • Choose a serving route for an embedding model
  • Plan asynchronous inference for image generation
huggingface/skills11.2KUpdated Oct 9, 2026

LLM agent 基础设施 (LLM agent infra) Master OS — automated mastery of LLM agent infra: top builders' mental models, tool stack, current workflows, jargon, and where to keep up. Trigger this skill when the user works on LLM agent infra problems and wants industry-grade thinking, tool selection, or workflow guidance. 触发词:「agent framework」「LLM agent」「agent infra」「multi-agent orchestration」「agent runtime」

The English summary is being prepared. Showing the original description.

swaylq/master-skill162Updated Sep 6, 2026

vector-setup

FreeSummary

Set up ruvector@0.3.3 with supporting packages, register its MCP server for agent access, and verify installation with diagnostic commands and smoke tests. Helps prepare the dependencies needed for initial use of /vector subcommands.

  • Setting up ruvector for the first time
  • Resolving missing dependencies for Brain, SONA, or LLM commands
  • Registering the ruvector MCP server with Claude
ruvnet/ruflo77.1KUpdated Oct 19, 2026

Design scheduled AI workflows for document ingestion, batch processing, and model training using Prefect, Airflow, or Dagster. Compare orchestration tools and plan task dependencies, retries, caching, and monitoring through implementation fragments.

  • Schedule document ingestion and RAG index refreshes
  • Design batch workflows for LLM requests
  • Connect model training with quality evaluation
sickn33/agentic-awesome-skills48KUpdated Oct 19, 2026