Skip to content
cccskills
FreePublished on GitHub

ml-model-eval-benchmark

Compare model candidates using weighted metrics and deterministic ranking outputs. Use for benchmark leaderboards and model promotion decisions.

The English summary is being prepared. Showing the original description.

See how to install

Files included (4)

  • SKILL.md817 B
  • agents/openai.yaml214 B
  • references/benchmarking-guide.md475 B
  • scripts/benchmark_models.py3.7 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

ML Model Eval Benchmark

Overview

Produce consistent model ranking outputs from metric-weighted evaluation inputs.

Workflow

  1. Define metric weights and accepted metric ranges.
  2. Ingest model metrics for each candidate.
  3. Compute weighted score and ranking.
  4. Export leaderboard and promotion recommendation.

Use Bundled Resources

  • Run scripts/benchmark_models.py to generate benchmark outputs.
  • Read references/benchmarking-guide.md for weighting and tie-break guidance.

Guardrails

  • Keep metric names and scales consistent across candidates.
  • Record weighting assumptions in the output.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

Scaffold MCP server projects and baseline tool contract checks. Use for defining tool schemas, generating starter server layouts, and validating MCP-ready structure.

The English summary is being prepared. Showing the original description.

0x-Professor/Agent-Skills-Hub11Updated Feb 27, 2026

Generate reusable multi-step agent workflow blueprints. Use for trigger/action orchestration, deterministic workflow definitions, and automation handoff artifacts.

The English summary is being prepared. Showing the original description.

0x-Professor/Agent-Skills-Hub11Updated Feb 27, 2026

Build incident response timelines and report packs from event logs. Use for detection-to-recovery reporting, phase tracking, and stakeholder-ready incident summaries.

The English summary is being prepared. Showing the original description.

0x-Professor/Agent-Skills-Hub11Updated Feb 27, 2026

Prioritize vulnerability remediation using KEV-style exploitation context plus asset criticality. Use for CVE triage, patch order decisions, and remediation reporting.

The English summary is being prepared. Showing the original description.

0x-Professor/Agent-Skills-Hub11Updated Feb 27, 2026

Map application security findings to OWASP Top 10 categories and generate remediation checklists. Use for normalized AppSec review outputs and category-level prioritization.

The English summary is being prepared. Showing the original description.

0x-Professor/Agent-Skills-Hub11Updated Feb 27, 2026

Build transformer fine-tuning run plans with task settings, hyperparameters, and model-card outputs. Use for repeatable Hugging Face or PyTorch finetuning workflows.

The English summary is being prepared. Showing the original description.

0x-Professor/Agent-Skills-Hub11Updated Feb 27, 2026

See all skills by 0x-Professor

Report a problem with this skill