Skip to content
cccskills
FreePublished on GitHub

dedupe-rank

Use when a broad paper candidate pool needs deterministic deduplication and a stable core set.

The English summary is being prepared. Showing the original description.

Run score Not tested

See how to install

Files included (5)

  • SKILL.md1.9 KB
  • assets/domain_packs/embodied_ai.json1.3 KB
  • assets/domain_packs/llm_agents.json2.6 KB
  • references/domain_pack_overview.md1.0 KB
  • scripts/run.py16.4 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Dedupe + Rank

Triggers & routing

  • Trigger: dedupe, rank, core set, 去重, 排序, 精选论文, 核心集合.
  • Use when: 检索后需要把广覆盖集合收敛成可管理的 core set(用于 taxonomy/outline/mapping)。
  • Skip if: 已经有人手工整理了稳定的 papers/core_set.csv(无需再次 churn)。
  • Network: none.
  • Guardrail: 偏 deterministic;输出应可重复(稳定 paper_id、字段规范)。

Turns a raw candidate pool into a deduped pool and a stable core set.

Input

  • papers/papers_raw.jsonl

Outputs

  • papers/papers_dedup.jsonl
  • papers/core_set.csv

Script boundary

scripts/run.py should own only:

  • title/year deduplication
  • deterministic ranking
  • stable paper_id generation

Use shared domain packs or pipeline contract metadata for topic-specific or product-specific behavior.

Contract-driven behavior

The script should prefer pipeline contract metadata over profile-name branching.

Current important field:

  • quality_contract.candidate_pool_policy.keep_full_deduped_pool
  • quality_contract.candidate_pool_policy.include_domain_pins
  • quality_contract.candidate_pool_policy.minimum_domain_surveys
  • quality_contract.candidate_pool_policy.survey_title_bonus

If true, the script keeps the full deduped pool in papers/core_set.csv unless the user explicitly overrides core size. Focused briefing Workflows can disable unconditional domain pins, reserve a smaller survey floor, and remove the generic survey-title bonus without changing broad Survey defaults.

Acceptance

  • deduped JSONL exists
  • core-set CSV exists
  • reruns are stable for the same inputs

Non-goals

  • retrieval
  • screening
  • manual topic authoring inside the script

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

Internal template for creating or refactoring a skill into the repository's reference-first shape. **Trigger**: reference-first template, blueprint skill, create a reusable skill, refactor a script-heavy skill. **Use when**: you need a lean `SKILL.md`, explicit `references/`, machine-readable `assets/`, and a minimal deterministic `run.py`.

The English summary is being prepared. Showing the original description.

WILLOSCAR/research-units-pipeline-skills515Updated Oct 5, 2026

Download a small corpus of open-access arXiv survey/review PDFs about agentic systems and extract text for style learning.

The English summary is being prepared. Showing the original description.

WILLOSCAR/research-units-pipeline-skills515Updated Oct 5, 2026

Extract per-subsection “anchor facts” (NO PROSE) from evidence packs so the writer is forced to include concrete numbers/benchmarks/limitations instead of generic summaries.

The English summary is being prepared. Showing the original description.

WILLOSCAR/research-units-pipeline-skills515Updated Oct 5, 2026

Curate reader-facing survey tables for the Appendix (clean layout + high information density), using only in-scope evidence and existing citation keys.

The English summary is being prepared. Showing the original description.

WILLOSCAR/research-units-pipeline-skills515Updated Oct 5, 2026

Build a final, machine-readable argument snapshot from current H3 sections and refresh section fingerprints before merge.

The English summary is being prepared. Showing the original description.

WILLOSCAR/research-units-pipeline-skills515Updated Oct 5, 2026

Audit one research Workspace for declared Unit outputs and Pipeline target Artifacts, writing `output/CONTRACT_REPORT.md`; use for mid-Run coverage snapshots or final delivery completeness, not deep provenance integrity.

The English summary is being prepared. Showing the original description.

WILLOSCAR/research-units-pipeline-skills515Updated Oct 5, 2026

See all skills by WILLOSCAR

Report a problem with this skill