4539 个 · 按相关度排序
Analyze LLM eval results — score breakdowns by category, regression detection vs baseline, failure clustering. Use when asked to "analyze our eval results", "did the model regress", or "cluster the eval failures".
中文简介正在准备中。当前显示原文说明。
Audit existing eval coverage — gaps, metric validity, benchmark leakage, dataset freshness. Use when asked "what eval coverage do we have", "audit our evals", or "check for benchmark leakage".
中文简介正在准备中。当前显示原文说明。
An AI analyst for buying B2B software. Investigates what vendors claim, checks the evidence, surfaces contradictions and unanswered questions, and produces a shareable Decision Brief with the questions to ask before you buy. Quick Eval by default; Deep Eval on request. Use when asked to evaluate, compare, vet, or research B2B software vendors.
中文简介正在准备中。当前显示原文说明。
Create and maintain AgentV YAML evaluation files for testing AI agent performance. Use this skill when creating new eval files, adding eval cases, or configuring custom evaluators (code validators or LLM judges) for agent testing workflows.
中文简介正在准备中。当前显示原文说明。
Use when testing, evaluating, or building regression suites for Agentforce agents: conversation testing in Agent Builder, topic (now subagent) coverage and utterance testing, Testing API and AiEvaluationDefinition metadata, Agentforce DX CLI test runs (sf agent generate test-spec, sf agent test create/run/resume/results/list), evaluation metrics (containment rate, escalation rate, CSAT, topic activation accuracy), and post-deploy analytics via Enhanced Event Logs. Triggers: 'how do I test my Agentforce agent', 'agent routes to wrong subagent', 'write utterance tests', 'regression test after topic change', 'measure agent quality', 'agent containment rate', 'run agent tests from the CLI'. NOT for agent creation, topic design, or action contract design — use agentforce/agentforce-agent-creation, agentforce/agent-topic-design, or agentforce/agent-actions respectively.
中文简介正在准备中。当前显示原文说明。
Avalia LLMs em mais de 60 benchmarks acadêmicos (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use quando benchmarking de qualidade de modelo, comparação de modelos, relatório de resultados acadêmicos ou rastreamento de progresso de treinamento. Padrão da indústria usado por EleutherAI, HuggingFace e laboratórios principais. Suporta HuggingFace, vLLM, APIs.
中文简介正在准备中。当前显示原文说明。
Use when designing evaluation suites for agentic systems, choosing agent benchmarks, measuring multi-agent performance, or critiquing single-score evaluation of agents. Based on arXiv:2605.26112v1. Trigger phrases: "evaluate my agent", "benchmark agent", "measure agent reliability", "pass^k evaluation", "agent metrics beyond success rate", "trajectory quality", "memory hygiene metric", "longitudinal agent eval", "why my agent scores well on benchmarks but fails in production".
中文简介正在准备中。当前显示原文说明。
NVIDIA RAG Blueprint evaluation guidance for measuring retrieval and answer quality with stable datasets, baselines, and reproducible scoring workflows.
中文简介正在准备中。当前显示原文说明。
Evaluate recommender system quality for the CSX4207 Vinyl Record Store. Use whenever you must compute or report recommender metrics (Precision@k, Recall@k, HitRate@k, MRR, MAP@k, NDCG@k, coverage, diversity, novelty, serendipity, personalization), design an evaluation protocol/split, run a baseline comparison, or write the evaluation section of a course deliverable. Covers formulas, JavaScript reference implementations, and the reporting checklist.
中文简介正在准备中。当前显示原文说明。
Expert en évaluation d'agents IA (benchmarking, human eval, latence, coût, précision, safety testing)
中文简介正在准备中。当前显示原文说明。
Guide for evaluation — inline evaluators, Inspect AI integration, and custom evaluators for measuring training progress. Use when the user asks about evaluation, metrics, benchmarks, or how to measure model quality during training.
中文简介正在准备中。当前显示原文说明。
Evaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding abilities, testing multi-language support, or measuring code generation quality. Industry standard from BigCode Project used by HuggingFace leaderboards.
中文简介正在准备中。当前显示原文说明。
Evaluate LLM outputs using frontier models as judges. Use for pairwise model comparison, quality scoring with custom rubrics, and automated evaluation pipelines. Covers position bias mitigation, statistical significance, and generating preference data for DPO/RLHF.
中文简介正在准备中。当前显示原文说明。
OpenAI API (developers.openai.com) の Evals / Fine-tuning リファレンス。 Evals API, Datasets, graders（string check / text similarity / model / python / multi）, agent evals, trace grading, external models, Promptfoo（移行先）, red teaming, SFT, DPO, RFT, vision fine-tuning, distillation, prompt optimizer, fine-tuning best practices。 Evals は 2026-11-30 停止予定、セルフサービス fine-tuning は段階的廃止中。
中文简介正在准备中。当前显示原文说明。
Set up eval-based QA for Python LLM applications: instrument the app, build golden datasets, write and run eval tests, and iterate on failures. ALWAYS USE THIS SKILL when the user asks to set up QA, add tests, add evals, evaluate, benchmark, fix wrong behaviors, improve quality, or do quality assurance for any Python project that calls an LLM model.
中文简介正在准备中。当前显示原文说明。
使用统一标准审阅论文和研究计划，检查研究方法、证据、引用及文章结构，并说明评分依据、修改优先级和下一步需要修改的内容。
将应用开发分配给规划、实现和评估代理，检查运行中的界面并按质量标准评分，把具体问题反馈给实现环节，反复修改直至达标或达到次数上限。
根据工厂、仓库和办公室的用量、费率及合同条件，评估电力与天然气采购方案，支持供应商报价比较、峰值需量费用管理、可再生能源合同评估及年度预算编制。
Design evaluation tasks that check whether agents actually complete work. Define requests, simulated user behavior, starting conditions, and verifiable success criteria, then plan difficulty levels, training-data leakage checks, and ongoing maintenance.
中文简介正在准备中。当前显示英语简介。
Build an evaluation process for AI agents using success, reliability, cost, and latency measures. Define scoring criteria, repeatable environments, failure analysis, and regression tests that check for recurring problems to support model selection and system improvements.
中文简介正在准备中。当前显示英语简介。
Build and evaluate single-agent reinforcement learning experiments, where an agent learns actions from rewards. Use Stable Baselines3 to choose algorithms, create environments, monitor training, and save models with the normalization data needed for consistent evaluation.
中文简介正在准备中。当前显示英语简介。
Build repeatable evaluations for AI agent responses, tool choices, and multi-step tasks. Use reference datasets and scoring criteria to compare changes, detect quality regressions, and set automated checks that must pass before deployment.
中文简介正在准备中。当前显示英语简介。
Design agent memory that preserves facts, preferences, and conversation history across sessions. Plan storage, retrieval, and retention separately for each organization or user, with checks for unauthorized access, outdated information, conflicting records, and retrieval quality.
中文简介正在准备中。当前显示英语简介。
Design criteria for using an LLM to judge AI responses through scoring or comparisons between two answers. Includes checks for order and length bias, plus validation against human judgments to assess evaluation reliability.
中文简介正在准备中。当前显示英语简介。