Reads model uncertainty from token log-probabilities. Covers collecting logprobs and aggregating multi-token labels, confidence tiers and margins for triage, calibration assessment with ECE, Brier scores, and reliability diagrams against human labels, responsible downstream use of confidence, and reproducibility archives. Use when the user asks about classifier confidence by item, logprobs, top-k tokens, calibration, ECE, Brier, reliability diagrams, or routing low-confidence cases to human review. Codebook and validation design go to text-classification.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Designs and diagnoses list experiments (the item count technique), covering whether indirect measurement is warranted, control-list construction against floor and ceiling effects, design variants, estimators and assumption tests in the list package, and power planning for the precision penalty. Use when the user measures a sensitive attitude or behavior and asks about list experiments, item count, unmatched count, or veiled questioning, or has an implausible prevalence estimate. Deciding whether sensitivity bias exists at all goes to survey-design.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Advises on setting up and validating topic models for survey and experimental text. Covers the discovery-versus-measurement question, choosing STM, LDA, or BERTopic, preprocessing consequences, prevalence and content formulas, topic-count selection across coherence, exclusivity and FREX, held-out likelihood, and residuals, validation of topics against human judgment, robustness, and DA-RT-compliant reporting. Use when the user has open-ended responses or another corpus and asks what topics are present, how many topics to use, about STM, searchK, coherence, or FREX, or wants topic prevalence compared across treatment arms or countries. Fixed-codebook coding goes to text-classification.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Checks whether each claim in a manuscript is supported by the source it cites, reading the project's per-source Markdown knowledge base. Flags contradicted, unsupported, overclaimed, out-of-scope, and misattributed claims with verbatim source quotes. Runs citation-check first, and stops at a pre-flight gate when the knowledge base is missing, incomplete, or holds unconverted PDFs. Use to verify that a draft's claims match the sources it cites.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Provides a pre-submission manuscript audit covering argument, numerical consistency, references and DOIs, writing, figures, CONSORT flow, pre-registration, and the replication archive. Use before paper submission or when a draft needs an adversarial, quote-grounded review with a journal-readiness checklist. Add `--codex` to run the specification independently on Claude and Codex, GPT-6 Astra, and cross-check findings.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Builds or audits a literature review, producing an evidence map, the closest prior work, source clusters, a gap verdict, and a synthesis plan for the introduction. Use when the user asks whether a contribution is novel, who has studied a question, what the literature establishes, or how to organize a review, or wants a reading list, Zotero export, or pile of papers turned into one. For systematic reviews or meta-analyses it produces the protocol scaffold and routes registration (PROSPERO or OSF) and screening to dedicated tools.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Reads or converts documents in a research workflow, including PDF, Word, PowerPoint, Excel, OpenDocument, RTF, EPUB, and CSV. Chooses direct reading or conversion, selects a converter from document structure, and decides whether the Markdown is tracked or temporary. Use when a document must be read, quoted, summarized, searched, extracted, or added to a source library. Scanned documents go to vlm-ocr and bulk intake to research-repo.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Audits fielded survey-response data for registered elements, data quality, bot and AI-automation screening, and sample integrity, and produces an appendix-ready quality report. Use at soft launch before full field, after fielding before outcomes are analyzed, or when asked what a study did about bots and AI respondents.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Writes or reviews a pre-analysis plan before data collection — registry choice (OSF, AEA RCT Registry, AsPredicted, registered reports), PAP structure, models and decision rules locked in advance, analysis code run on simulated data, contingencies for attrition, failed manipulations, and exclusions, deviation records, and timeline. Operationalizes the pre-data-collection side of DA-RT. Use when the user asks to draft or audit a pre-registration or PAP, choose a registry, decide what to lock versus leave exploratory, or handle a later deviation. Hypotheses and estimands come from hypothesis-building, post-hoc reporting from methods-reporting.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Designs survey instruments, covering question wording, scale construction and index reliability, flow and treatment placement, pretesting and soft launches, respondent burden with attention and speeding rules, sensitive questions and social-desirability bias, and treatment delivery. Use when the user writes or revises survey questions, chooses a scale, orders blocks, plans a pilot, or worries respondents will not answer honestly. Indirect measurement goes to list-experiment, multi-country instruments to cross-national-design, and live-survey operations to qualtrics-ops.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Operates or audits a live Qualtrics survey through the v3 APIs without disrupting fielding. Covers publish gating, quotas, flow routing, embedded data, panel-vendor redirects, read-back verification, and a read-only pre-fielding audit. Use when publishing or patching a fielding instrument, when a quota counts without blocking, when configuring panel-vendor redirects or flow gates, or when auditing a survey before launch for consent gates, force-response completeness, quotas and redirects, anti-bot instrumentation, and language-arm symmetry.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Typesets a working paper or journal submission in house-style LaTeX from Markdown, Word (.docx), TeX, ODT, RTF, or HTML. Converts with pandoc, wraps the body in an EB Garamond template, builds the PDF with latexmk, and sets journal-specific spacing, page limits, anonymization, disclosures, and citation style. Use to format or convert a paper to LaTeX, make a working paper, or prepare a submission to a named journal.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Consults Fable as an independent, read-only reviewer at an effort the caller matches to the question. The calling session (usually Opus, or Haiku) holds the task and escalates one decision point. Use before committing to an interpretation or a substantial piece of writing or analysis, when stuck or not converging, when changing approach, or as a final check on a finished task. Fallback for when the native advisor tool is unavailable. Not for a session already running Fable.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Turns a raw Qualtrics conjoint export into an analysis-ready long-format dataset, covering export settings, identifying the implementation, package or manual wide-to-long reshaping, choice-profile alignment, ratings, reference categories, pilot exclusion, and subgroup merges. Use when the user has a conjoint CSV to clean, reshape, or debug, cannot align choices with profiles, or asks what the data must look like before AMCE estimation. Design goes to conjoint-design, validity review to conjoint-diagnostics.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Designs conjoint and factorial-vignette experiments, covering attribute architecture and randomization restrictions, effective-N power, treatment realism, the choice among AMCE, marginal-mean, and AMIE estimands, forced-choice versus rating designs, and PAP tiers. Use when the user is planning a conjoint, drafting or critiquing an attribute table, asking how many respondents or tasks are needed, whether to report AMCEs or marginal means, or how to test interactions. Reviewing an existing design goes to conjoint-diagnostics, cleaning the export to conjoint-cleaning.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Reviews a whole deliverable against its manifest without rewriting it — deterministic gate, per-section finders, a whole-work pass, and adjudicated findings.json and report.md with honest coverage. Use before shipping a deliverable or for the night shift.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Turns dictated captures in a deliverable's inbox/ into a proposed planning-wiki diff, classifying and tracing each statement; decisions need the author's assent. Use to intake notes or process the inbox.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Audit a manuscript's citations for fabricated sources, DOIs that resolve to the wrong work, in-text and reference-list mismatches, style, and claim support, verified against Crossref and OpenAlex. Use to check citations, references, a .bib file, or DOIs.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
House rules and craft for LaTeX Beamer decks (storyboarding, slide prose, frame budgets, layout, XeLaTeX and Korean fonts, color, figures, Overleaf hygiene, build QA). Use to write, edit, review, or build a Beamer deck.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Interviews a researcher in rounds (idea, design, or defend stage) until no decision in a research idea, design, or draft is left assumed, recommending an answer to each question and writing settled decisions to a file. Use for 'grill me', stress-testing a design, or an idea not yet a design; --plan for software or process plans.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Start-of-session report on where a repository stands. Reads the project's own handoff and log files, checks live git state, and reports objective, verified baseline, open tasks, blockers, and next actions. Use when resuming work. Twin of finished.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
End-stage QA for a finished figure and table set (callouts, numbering, cross-references, text-to-exhibit consistency, captions and notes, accessibility, SI and replication linkage). Use when preparing a submission.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Designs and diagnoses list experiments (the item count technique): whether indirect measurement is warranted, control-list construction, design variants, estimators and assumption tests in the list package, and power. Use when measuring a sensitive item or debugging an implausible prevalence estimate.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新
Advises on setting up and validating LLM text classification: codebook, learning regime and model choice, prompts, validation against human coding (kappa, F1), hybrid review, measurement error, and reporting, plus a short resumable batch pattern with a rule-based baseline. Use to classify, code, or label text at scale; category discovery goes to topic-modeling.
日本語の概要は準備中です。原文の説明を表示しています。
scdenney/open-science-skills☆ 662026年10月8日 更新