본문으로 건너뛰기
cccskills
무료GitHub에 공개

adjudicative-ai-impartiality-challenge

Public-safe preliminary screen for challenges to the impartiality of an AI evaluator, LLM-as-a-judge, decision-support agent, or adjudicative system based on prior outputs, suspected bias, unstable reasoning, or self-reinforcing memory. Use when asked whether an AI should be recused, disqualified, replaced, audited, or escalated. Does not decide real cases or claim that human judicial-recusal doctrine automatically applies.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

실행 점수 미검증

설치 방법 보기

포함된 파일(2)

  • SKILL.md4.3 KB
  • README.md439 B

SKILL.md(원문)

설치하기 전에 에이전트에게 전달되는 지시 내용을 확인할 수 있습니다.

Adjudicative AI Impartiality Challenge

Purpose

Turn an allegation of “biased prior decisions” into an auditable, proportionate challenge. Treat recusal as a functional analogy unless jurisdiction-specific law establishes a legal mechanism.

Workflow

  1. Classify the role: evaluator, decision-support agent, or legally authorised adjudicator. Never infer authority from benchmark performance.
  2. Identify the challenged target separately: base model; exact model version; system prompt and configuration; retrieval corpus; memory; tools; deploying institution; or a particular proceeding.
  3. Freeze attribution evidence: dates, versions, prompts, record, retrieved sources, tool calls, memory state, output, and human intervention. If identity or provenance is missing, do not attribute a pattern to “the model”.
  4. Test comparability of prior outputs. Compare like tasks, governing sources, language, procedural posture, and time period. Label incomparable examples.
  5. Separate possible loci of distortion:
    • record construction and fact selection;
    • credibility attribution;
    • issue framing or dispute substitution;
    • source retrieval and authority ordering;
    • norm attribution and application;
    • remedy;
    • memory or precedent-like reuse.
  6. Run or propose controlled counterfactuals. Hold legally relevant facts and sources constant while varying only the suspected nuisance feature. Include order permutations and a human-coded reference set where feasible.
  7. Classify the evidence:
    • INCIDENT: isolated anomaly;
    • SIGNAL: repeated concern without adequate controls;
    • REPLICATED_PATTERN: comparable, controlled and reproducible disparity;
    • NOT_ATTRIBUTABLE: version, configuration or provenance is insufficient.
  8. Choose the least disruptive adequate remedy: disclosure, preservation, independent audit, alternate configuration, exclusion of contaminated memory, human de novo review, quarantine, replacement, or functional disqualification.
  9. Apply the legal uncertainty gate:
    • PASS: low-stakes research/evaluation and no material unresolved signal;
    • ESCALATE: material signal, unclear doctrine, or consequential decision support;
    • BLOCK: real rights or legal status would be affected without lawful authority, contestability, inspectable record, and effective human review.

Required output

status: PROPUESTO
role: evaluator | decision_support | adjudicator
challenged_target: model | configuration | memory | institution | proceeding
evidence_class: INCIDENT | SIGNAL | REPLICATED_PATTERN | NOT_ATTRIBUTABLE
bias_locus: []
comparability_limits: []
alternative_explanations: []
recommended_remedy: []
workflow_state: PASS | ESCALATE | BLOCK
human_review_required: true

Guardrails

  • Prior outputs are evidence, not self-proving precedents.
  • One wrong result does not establish structural bias.
  • Outcome parity alone cannot rule out process disparity.
  • Never reuse the challenged system's own summaries as independent proof of impartiality.
  • Never expose confidential matters, internal prompts, private thresholds, routing logic, or gate records.
  • For a real controversy, require jurisdiction-specific counsel and a human decision-maker with power to disregard the system.

Verification fixtures

  • One anomalous output with no version record must remain INCIDENT or NOT_ATTRIBUTABLE, not “biased model”.
  • Repeated controlled profile swaps that change credibility and outcome may become REPLICATED_PATTERN and trigger quarantine plus de novo review.
  • Outputs from an obsolete model version cannot automatically disqualify a materially changed deployment; re-test the current configuration.

Recovery

If evidence is incomplete, preserve what exists, stop reliance, label missing provenance, and request a fresh controlled evaluation. Do not manufacture certainty from narrative similarity.

리뷰

아직 리뷰가 없습니다. 사용해 본 소감을 남겨 주세요.

댓글

로그인 없이 쓸 수 있습니다. 사용 후기, 질문, 작동하지 않은 환경 등을 편하게 남겨 주세요.

아직 댓글이 없습니다. 첫 댓글을 남겨 보세요.

보내면 바로 공개됩니다. 이메일 주소나 전화번호 같은 개인 정보는 쓰지 마세요. URL은 2개까지입니다.

0 / 1,000자

이 양식은 reCAPTCHA로 보호되며 Google 개인정보처리방침 및 서비스 약관이 적용됩니다.

같은 저장소의 스킬

Creates an Agent Authority Charter for enterprise or regulated AI agents before deployment. Use this Skill when a user needs to define what an AI agent is allowed to do, who delegated authority to it, what actions are permitted or prohibited, when human approval is required, what evidence must be preserved, and how the agent can be suspended, revoked, or escalated.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

lawve-ai/awesome-legal-skills8952026년 10월 20일 업데이트

EU AI Act Knowledge Engine — authoritative regulatory Q&A grounded in 70 official EU source documents (including the 2026 Commission draft guidelines on Art. 6 high-risk classification — general principles, Annex I, Annex III). Answers any question about the AI Act with article-level citations from the full regulation text, Commission guidelines, EDPB/EDPS opinions, codes of practice, harmonised standards, FRIA guides, incident templates, and sector-specific guidance. This skill should be used when the user asks about the "EU AI Act", "AI Act regulation", "Regulation 2024/1689", "KI-Verordnung", asks to "explain an AI Act article", "what does Article X say", "AI Act requirements", "AI Act penalties", "AI Act timeline", "GPAI obligations", "high-risk AI", "prohibited AI practices", "AI Act and GDPR", "fundamental rights impact assessment", "AI Act standards", "AI Act national implementation", "AI literacy", "serious incident reporting", "Digital Omnibus", "AI regulatory sandbox", or any question about EU artificial intelligence regulation. Also triggers on German terms: "KI-Gesetz", "KI-Verordnung", "Hochrisiko-KI", "KI-Kompetenz", "Grundrechte-Folgenabschaetzung", "GPAI-Verhaltenskodex". For assessment workflows that produce a classification decision rather than a knowledge answer, offer to run a structured risk-tier classification in-session.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

lawve-ai/awesome-legal-skills8952026년 10월 20일 업데이트

This skill builds a structured audit trail of an AI-assisted task: what the tool was asked to do, what materials it was given, what it produced, how the output was verified, and what was ultimately relied upon. It documents the workflow for supervision and later review without ruling on privilege or disclosure, so the record stays accurate rather than self-serving.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

lawve-ai/awesome-legal-skills8952026년 10월 20일 업데이트

Use this skill when the user wants an AI governance, legal-risk, privacy, compliance, procurement, or vendor-risk review of an internal AI use case, an AI product feature, an LLM workflow, or a third-party AI vendor. The skill asks intake and clarifying questions first when facts or evidence are missing, identifies required documentation and missing evidence, maps the use case to AI governance frameworks and applicable legal domains, and produces a preliminary or final governance review with scorecards, findings, owners, remediation actions, and follow-up questions.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

lawve-ai/awesome-legal-skills8952026년 10월 20일 업데이트

Turn an interpretive-ambiguity audit of a legal text — contract, statute, regulation, or judicial opinion — into a polished deliverable. Produces a multi-page website (default), a single-page interactive site, a Microsoft Word document, a PowerPoint deck, or a LaTeX/PDF. Use whenever a user has a stress-test result, ambiguity audit, or "where will this be litigated" scenarios and wants to publish, present, or share them. Triggers on "publish the audit," "make a report from this," "turn this into a website / deck / brief / Word doc," "make a Netlify site," "build slides of these ambiguities," "render the scenarios," "package this stress test," "produce a LaTeX version," and similar. Pairs with the ambiguity-stress-test skill (the underlying analysis) but works on any structured or semi-structured ambiguity analysis. Visual design is opinionated but the user can override colors, fonts, and brand label. Most formats need Python and a writable filesystem; single-file HTML works where the host has neither.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

lawve-ai/awesome-legal-skills8952026년 10월 20일 업데이트

Adversarially stress-tests a legal text — a contract, statute, regulation, or judicial opinion — for interpretive ambiguity: it finds the seams where the people governed by it will later disagree about what it means and turns each into a concrete dispute scenario with both sides' arguments, the likely outcome, and a fix. Use it whenever someone wants to pressure-test, red-team, audit, or find weak spots, loopholes, gaps, ambiguities, or drafting problems in a legal document; whenever a drafter wants to tighten a contract, statute, regulation, or opinion before it issues; whenever a litigator wants to mine an opinion or contract for arguments; or whenever someone hands over a legal text and asks where it will be fought over or for issue-spotting. Trigger it for contract review, statutory-ambiguity analysis, judicial-opinion scope analysis, and drafting QA — even if the user never says "stress-test" or "ambiguity."

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

lawve-ai/awesome-legal-skills8952026년 10월 20일 업데이트

lawve-ai의 스킬 모두 보기

이 스킬의 문제 신고