This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
bouclem/skills☆ 72026년 5월 31일 업데이트
Evaluate recommender system quality for the CSX4207 Vinyl Record Store. Use whenever you must compute or report recommender metrics (Precision@k, Recall@k, HitRate@k, MRR, MAP@k, NDCG@k, coverage, diversity, novelty, serendipity, personalization), design an evaluation protocol/split, run a baseline comparison, or write the evaluation section of a course deliverable. Covers formulas, JavaScript reference implementations, and the reporting checklist.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
bg-szy/TOP-SKILLS☆ 62026년 9월 8일 업데이트
This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
lucaspmarie-a11y/claude-skills-vault☆ 52026년 6월 7일 업데이트
Evaluate LLM outputs using frontier models as judges. Use for pairwise model comparison, quality scoring with custom rubrics, and automated evaluation pipelines. Covers position bias mitigation, statistical significance, and generating preference data for DPO/RLHF.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
huang-sh/DeepScience☆ 42026년 7월 15일 업데이트
This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
phoroth/AGENTIC☆ 32026년 8월 8일 업데이트
This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
nimoqup046-collab/agora☆ 32026년 3월 26일 업데이트
Rigorous benchmarking of multi-agent coordination systems: experiment design, statistical analysis, human evaluation protocols, and reproducible reporting. NOT FOR ML model evaluation (use llm-evaluation-harness), A/B testing for web products, survey design, or general data science.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
curiositech/port-daddy☆ 32026년 10월 19일 업데이트
This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
MMEHDI0606/ai-agent-foundation-template☆ 22026년 5월 21일 업데이트
유사 기업의 매출, 이익률, 가치평가 배수를 비교하는 Excel을 만듭니다. 수식, 중앙값, 사분위수와 데이터 출처를 정리해 투자나 인수 검토 자료를 준비합니다.
- 동종 기업과 기업가치 비교
- 인수 검토용 비교 자료 작성
- 업계 성장성과 수익성 비교
NousResearch/hermes-agent☆ 25.5만2026년 10월 19일 업데이트
Create and run automated tests that score LLM answers against expected outputs or judging criteria. Monitor progress, inspect individual results, compare models on the same tests, and use score thresholds in CI, an automated checking workflow.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Creating tests with expected answers
- Monitoring evaluation progress
- Inspecting failed samples and scores
diegosouzapw/OmniRoute☆ 7.9만2026년 10월 19일 업데이트
Design evaluation tasks that check whether agents actually complete work. Define requests, simulated user behavior, starting conditions, and verifiable success criteria, then plan difficulty levels, training-data leakage checks, and ongoing maintenance.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Creating evaluation tasks for real business workflows
- Reviewing success criteria and verification logic
- Designing checks for evaluation data leakage into training
bojieli/ai-agent-book☆ 5.5만2026년 10월 9일 업데이트
Plan and review PufferLib reinforcement learning workflows, where agents learn through rewards. Covers version-specific environment checks, parallel execution, training and evaluation plans, plus checkpoint inspection before loading saved models.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Choose APIs for a specific PufferLib version
- Check environment behavior before training
- Create training and evaluation plans with separate seeds
K-Dense-AI/scientific-agent-skills☆ 5.3만2026년 10월 19일 업데이트
Prepare and check research documents for clinical decision-support evaluation, including evidence profiles, cohort tables, survival plans, and model assessments. Work with aggregate or synthetic inputs, record sources and review status, and keep outputs outside patient care.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Preparing research model evaluation documents
- Checking evidence profiles and source links
- Reviewing survival analysis plans
K-Dense-AI/scientific-agent-skills☆ 5.3만2026년 10월 19일 업데이트
Implement .NET workflows for Azure AI Foundry projects, including agent creation, resource connections, dataset uploads, model deployment inspection, search index management, and evaluations. Examples also cover authentication, asynchronous operations, and resource cleanup.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Creating and running agents from a .NET application
- Inspecting resource connections and model deployments
- Uploading datasets and managing search indexes
sickn33/agentic-awesome-skills☆ 4.8만2026년 10월 19일 업데이트
Implement Java workflows for Azure AI Foundry projects using SDK examples for authentication, connected resources, datasets, search indexes, and model evaluations. The skill also covers client setup, paginated resource lists, and error handling.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- List connected Azure resources
- Create or update search indexes
- Implement access to model evaluations
sickn33/agentic-awesome-skills☆ 4.8만2026년 10월 19일 업데이트
Compare prompt revisions on a fixed set of test cases to identify regressions, meaning behavior that gets worse after a change. Record model settings, case-level evidence, missing results, costs, and evaluation limits for a reviewable decision.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Comparing original and revised prompts
- Checking required JSON fields after prompt changes
- Reviewing tool selection and task completion
sickn33/agentic-awesome-skills☆ 4.8만2026년 10월 19일 업데이트
Design criteria for using an LLM to judge AI responses through scoring or comparisons between two answers. Includes checks for order and length bias, plus validation against human judgments to assess evaluation reliability.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Build an automated evaluation pipeline for AI responses
- Compare responses after changing a prompt or model
- Define shared scoring criteria for reviewers
sickn33/agentic-awesome-skills☆ 4.8만2026년 10월 19일 업데이트
Turn graded execution traces and production logs into model training examples and preferred-versus-rejected response pairs. Select useful records, remove sensitive information, exclude evaluation examples, and preserve links to the original runs.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Convert high-scoring successful runs into training examples
- Use expert-corrected failures as training examples
- Pair passing and failing responses to the same task
wshobson/agents☆ 4.1만2026년 10월 20일 업데이트
Prepare an evaluation framework before fine-tuning a language model. Build labeled examples, checks for each failure type, and a base-model benchmark, while calibrating model-based judges against human labels to support comparisons after training.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Build an evaluation set from agent traces
- Create separate checks for each failure type
- Calibrate an LLM judge against human labels
wshobson/agents☆ 4.1만2026년 10월 20일 업데이트
Explains how PluginEval combines structural checks and experimental model assessments into quality scores. Helps interpret low scores, identify improvement areas, set marketplace thresholds, and explain what evaluation badges actually represent.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Investigating why a skill received a low score
- Improving descriptions that define when a skill should run
- Setting score thresholds for marketplace listings
wshobson/agents☆ 4.1만2026년 10월 20일 업데이트
Create a single PowerPoint slide summarizing recent funding activity in selected sectors or companies. Using S&P Global Capital IQ data, it highlights funding totals, company valuations, major investors, key trends, and links to individual deals.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Weekly funding recaps for selected sectors
- Tracking funding rounds at watched companies
- Briefing colleagues on major deals and valuation changes
anthropics/financial-services☆ 4만2026년 9월 22일 업데이트
Update financial models after earnings, new company guidance, or changes in assumptions. Revise forecasts, recalculate valuation and price targets, and summarize significant changes with their reasons and implications for the investment view.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Updating a financial model after quarterly earnings
- Revising forecasts after changes in company guidance
- Reflecting interest rate and currency changes in valuation
anthropics/financial-services☆ 4만2026년 9월 22일 업데이트
Prepare for one company's upcoming earnings announcement with a compact HTML report. It combines the latest earnings call, competitor comparisons, valuation measures, and recent news, with links to supporting sources and calculation details.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Preparing a company earnings preview
- Comparing valuation with listed competitors
- Reviewing management guidance and key risks
anthropics/financial-services☆ 4만2026년 9월 22일 업데이트
Prepare an initial equity research report through five separate tasks covering company research, financial forecasts, valuation, charts, and report assembly. Outputs include research notes, an Excel financial model, chart files, and a detailed Word report.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
- Researching a company’s business, competitors, and risks
- Building financial forecasts with three scenarios
- Estimating a price target using multiple valuation methods
anthropics/financial-services☆ 4만2026년 9월 22일 업데이트