Skip to content
cccskills
FreePublished on GitHub

choose-covariance-estimator

Pick which precise covariance estimator to use for a given dataset. Use when you have data X and are unsure which estimator fits its dimension, conditioning, or tail behavior. Wraps precise.suggest() and covariance_features().

The English summary is being prepared. Showing the original description.

See how to install

Files included (1)

  • SKILL.md1.9 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Choose a covariance estimator for your data

No estimator wins everywhere, so precise recommends one from observable, truth-free features.

from precise import suggest, covariance_features

suggest(X, top=3)        # -> list of estimator CLASSES, best first
covariance_features(X)   # -> dict of the features behind the choice

X is 2-D (rows = observations, columns = variables). Then:

Est = suggest(X, top=1)[0]
est = Est()
est.fit(X)               # or stream rows with partial_fit
cov = est.covariance_

What it keys on

covariance_features(X) returns p, n, p_over_n, effective_rank, sphericity, condition_number, mean_abs_offdiag_corr, avg_excess_kurtosis — all computed from the sample, none requiring the unknown truth. Internally suggest uses a frozen, numpy-only decision tree; broadly it routes high p/n or ill-conditioned data to shrinkage/factor estimators and heavy-tailed data to robust ones.

Guardrail (important)

suggest is a heuristic trained on synthetic regimes. In leave-one-generative-family-out tests it does not reliably beat the single best fixed estimator on a wholly novel data-generating family — it generalizes across samples within familiar regimes, not to arbitrarily new structure. So:

  • Treat its output as a strong shortlist, not an oracle.
  • If the decision matters, verify the shortlist out-of-sample on your own data with the score-covariance-estimate skill, rather than trusting the recommendation blind.
  • A well-conditioned shrinkage estimator (LedoitWolfCovariance / OASCovariance) is a safe default when in doubt.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

Rigorously and honestly assess a NEW or proposed covariance / correlation / precision estimator, or a new covariance scoring rule, using precise. Use when someone proposes, asks to evaluate, or wants to compare a covariance methodology. Covers implementing it to the contract, conformance, benchmarking against the registry, out-of-sample validation, and statistically defensible inference.

The English summary is being prepared. Showing the original description.

microprediction/precise337Updated Oct 6, 2026

Estimate a covariance / correlation / precision matrix incrementally with precise. Use when data arrives as a stream and you want the matrix updated per observation, or when you want an online (partial_fit) drop-in for sklearn.covariance, which is batch-only.

The English summary is being prepared. Showing the original description.

microprediction/precise337Updated Oct 6, 2026

Maintain an online covariance over named series whose set changes over time (e.g. assets entering and leaving). Use when observations arrive as dicts keyed by name rather than fixed-length vectors. Wraps precise's keyed / FixedUniverse / DynamicUniverse adapters.

The English summary is being prepared. Showing the original description.

microprediction/precise337Updated Oct 6, 2026

Online (incremental) covariance, correlation, and precision estimation in Python — the streaming complement to sklearn.covariance. Use when code needs a covariance/correlation matrix updated per observation, recomputes np.cov/np.corrcoef in a rolling loop, must judge or compare covariance estimates, or proposes a new covariance methodology. Points to task-specific skills.

The English summary is being prepared. Showing the original description.

microprediction/precise337Updated Oct 6, 2026

Score and compare covariance estimates with precise's assessor panel. Use when you need to judge an estimate out-of-sample or rank competing estimators — and especially in high dimensions, where the plain held-out likelihood is misleading.

The English summary is being prepared. Showing the original description.

microprediction/precise337Updated Oct 6, 2026

See all skills by microprediction

Report a problem with this skill