本文へ移動
cccskills
無料GitHub で公開

evaluating-machine-learning-models

Evaluate trained machine learning models with the right metrics and comparison logic. Use for benchmark review, threshold selection, calibration, validation, and model comparison; not for feature engineering or leakage auditing.

インストール方法を見る

含まれるファイル(8)

  • SKILL.md1.5 KB
  • assets/README.md359 B
  • assets/visualization_script.py5.5 KB
  • references/README.md397 B
  • scripts/data_loader.py2.8 KB
  • scripts/evaluate_model.py2.8 KB
  • scripts/metrics_calculator.py2.8 KB
  • scripts/README.md407 B

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

Model Evaluation Suite

Use this skill when the model exists and the question is whether it is good enough.

Overview

This skill focuses on choosing and interpreting the right evaluation metrics for the problem, then comparing candidate models or thresholds.

When to Use This Skill

  • Comparing candidate models with consistent metrics
  • Reviewing precision/recall/F1/AUC, regression error, calibration, or ranking quality
  • Stress-testing validation strategy before deployment or publication

Not For / Boundaries

  • Building the training pipeline itself: use scikit-learn for classical modeling or ml-pipeline-workflow for end-to-end workflow ownership
  • Engineering features: use preprocessing-data-with-automated-pipelines
  • Checking train/test contamination: use ml-data-leakage-guard

Typical Outputs

  • Metric suite recommendations
  • Model comparison tables
  • Notes on threshold tradeoffs, calibration, and validation weaknesses

Related Skills

  • scikit-learn for class-level error breakdowns and confusion matrices
  • scientific-reporting when the evaluation must become a deliverable

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

adaptyv

無料

Cloud laboratory platform for automated protein testing and validation. Use when designing proteins and needing experimental validation including binding assays, expression testing, thermostability measurements, enzyme activity assays, or protein sequence optimization. Also use for submitting experiments via API, tracking experiment status, downloading results, optimizing protein sequences for better expression using computational tools (NetSolP, SoluProt, SolubleMPNN, ESM), or managing protein design workflows with wet-lab validation.

日本語の概要は準備中です。原文の説明を表示しています。

foryourhealth111-pixel/Vibe-Skills3,6742026年8月31日 更新

aeon

無料

This skill should be used for time series machine learning tasks including classification, regression, clustering, forecasting, anomaly detection, segmentation, and similarity search. Use when working with temporal data, sequential patterns, or time-indexed observations requiring specialized algorithms beyond standard ML approaches. Particularly suited for univariate and multivariate time series analysis with scikit-learn compatible APIs.

日本語の概要は準備中です。原文の説明を表示しています。

foryourhealth111-pixel/Vibe-Skills3,6742026年8月31日 更新

Creating algorithmic art using p5.js with seeded randomness and interactive parameter exploration. Use this when users request creating art using code, generative art, algorithmic art, flow fields, or particle systems. Create original algorithmic art rather than copying existing artists' work to avoid copyright violations.

日本語の概要は準備中です。原文の説明を表示しています。

foryourhealth111-pixel/Vibe-Skills3,6742026年8月31日 更新

Access real-time and historical stock market data, forex rates, cryptocurrency prices, commodities, economic indicators, and 50+ technical indicators via the Alpha Vantage API. Use when fetching stock prices (OHLCV), company fundamentals (income statement, balance sheet, cash flow), earnings, options data, market news/sentiment, insider transactions, GDP, CPI, treasury yields, gold/silver/oil prices, Bitcoin/crypto prices, forex exchange rates, or calculating technical indicators (SMA, EMA, MACD, RSI, Bollinger Bands). Requires a free API key from alphavantage.co.

日本語の概要は準備中です。原文の説明を表示しています。

foryourhealth111-pixel/Vibe-Skills3,6742026年8月31日 更新

Implement proven backend architecture patterns including Clean Architecture, Hexagonal Architecture, and Domain-Driven Design. Use when architecting complex backend systems or refactoring existing applications for better maintainability.

日本語の概要は準備中です。原文の説明を表示しています。

foryourhealth111-pixel/Vibe-Skills3,6742026年8月31日 更新

astropy

無料

Comprehensive Python library for astronomy and astrophysics. This skill should be used when working with astronomical data including celestial coordinates, physical units, FITS files, cosmological calculations, time systems, tables, world coordinate systems (WCS), and astronomical data analysis. Use when tasks involve coordinate transformations, unit conversions, FITS file manipulation, cosmological distance calculations, time scale conversions, or astronomical data processing.

日本語の概要は準備中です。原文の説明を表示しています。

foryourhealth111-pixel/Vibe-Skills3,6742026年8月31日 更新

foryourhealth111-pixel のスキルをすべて見る

このスキルの問題を報告する