Guide knowledge distillation, where a smaller language model learns from a larger teacher. Covers training from teacher responses or prediction scores, adjusting training settings, and comparing outputs to support model compression and specialized training.
- Compressing a large language model into a smaller model
- Training a specialized model from teacher-generated examples
- Comparing distillation methods and training settings
Orchestra-Research/AI-Research-SKILLs☆ 13.7KUpdated Oct 11, 2026
Train smaller language models using knowledge distillation, where a larger model supplies examples or prediction targets. This skill covers training losses, generated training data, parameter choices, and output comparisons to support model compression and specialized student models.
- Training a smaller model from a larger teacher
- Fine-tuning with teacher-generated responses
- Distilling domain knowledge into a specialized model
davila7/claude-code-templates☆ 32.7KUpdated Oct 18, 2026
Choose what kind of knowledge to transfer between teacher and student models: response, feature, or relational, and decide among offline, online, self, or cross-modal distillation schemes. Best for distillation strategy selection, capacity-gap diagnosis, and transfer planning. Activate on "knowledge distillation", "teacher-student", "soft labels", "feature distillation", "online distillation", or "cross-modal transfer". NOT for generic compression checklists or unrelated training work.
The English summary is being prepared. Showing the original description.
curiositech/windags-skills☆ 16Updated Oct 14, 2026
Compress large language models using knowledge distillation from teacher to student models. Use when deploying smaller models with retained performance, transferring GPT-4 capabilities to open-source models, or reducing inference costs. Covers temperature scaling, soft targets, reverse KLD, logit distillation, and MiniLLM training strategies.
The English summary is being prepared. Showing the original description.
huang-sh/DeepScience☆ 4Updated Jul 15, 2026
Synthesize OpenViking knowledge bases or document collections into topic-based Markdown pages that explain trends, changes, comparisons, and implications. Keep conclusions traceable to source evidence, distinguish facts from inferences, and preserve disagreements and uncertainty.
- Comparing changes across financial reports
- Finding shared trends across knowledge bases
- Organizing sourced conclusions by topic
volcengine/OpenViking☆ 40.3KUpdated Oct 19, 2026
Design deployment-focused distillation systems that balance model size, accuracy, calibration, and cascade escalation under real resource limits. Best for teacher-student compression, threshold design, and failure-aware deployment. Activate on "model compression", "teacher- student", "distillation score", "cascade model", "edge deployment", or "model calibration". NOT for generic deep-learning overviews, prompt optimization, or training work without a concrete distillation objective.
The English summary is being prepared. Showing the original description.
curiositech/windags-skills☆ 16Updated Oct 14, 2026
Deep analysis of knowledge distillation techniques for compressing large models into smaller efficient ones
The English summary is being prepared. Showing the original description.
curiositech/windags-skills☆ 16Updated Oct 14, 2026
Comprima modelos de linguagem grandes usando destilação de conhecimento de modelos professor para aluno. Use ao implantar modelos menores com desempenho retido, transferir capacidades do GPT-4 para modelos de código aberto ou reduzir custos de inferência. Aborda escalamento de temperatura, alvos suaves, KLD reversa, destilação de logits e estratégias de treinamento MiniLLM.
The English summary is being prepared. Showing the original description.
artubss/SKILLS-CLAUDE-CODE☆ 11Updated May 17, 2026
Set up and run knowledge distillation (on-policy, off-policy, or multi-teacher) from a teacher model to a student model using the Tinker API. Use when the user wants to distill knowledge, compress models, or train a student from a teacher.
The English summary is being prepared. Showing the original description.
uiuc-kang-lab/rlvr_generalization_bounds☆ 5Updated May 13, 2026
Conduct Critical Decision Method (CDM) interviews to elicit expert reasoning strategies (L3 knowledge) from practitioners about specific challenging past incidents. Use when capturing expertise for skill development, preserving knowledge before practitioner departure, building post-incident learning artifacts, or investigating decisions in complex sociotechnical systems. Outputs structured incident reconstructions with cues, decisions, alternatives considered, and counterfactual analysis suitable for distillation into skills or training material.
The English summary is being prepared. Showing the original description.
curiositech/port-daddy☆ 3Updated Oct 18, 2026
Plan further training for AI agent models by diagnosing gaps in knowledge, output consistency, or decision making. Compare continued pretraining, supervised fine-tuning, reinforcement learning, and distillation, then design training data, feedback environments, and evaluation checks.
- Choosing a training approach for an agent model
- Designing training examples and source data
- Planning reward checks and reinforcement learning environments
bojieli/ai-agent-book☆ 54.9KUpdated Oct 9, 2026
Build, deploy, evaluate, optimize, fine-tune, and manage Microsoft Foundry agents, models, and resources end to end. USE FOR: foundry, azd ai agent, azd provision/deploy, hosted agent scaffold/develop/run/deploy/troubleshoot, prompt agent create, managed harness agent create, GitHub Copilot harness agent, create agent, update agent, add tool to agent, invoke agent, agent insights, evaluate agent, batch eval, continuous eval, continuous monitoring, agent CI/CD, optimize prompt, improve prompt, optimize agent instructions, Agent Optimizer scaffold, dataset curation from traces, deploy model, model fine-tuning (SFT/DPO/RFT), Foundry project, RBAC, role assignment, permissions, quota, capacity, region, deployment failure, AI Services, create Foundry resource, knowledge index, customize deployment, onboard, availability, training-data, grader, distillation, large file upload. DO NOT USE FOR: Azure Functions, App Service, general Azure deploy (use azure-deploy), general Azure prep (use azure-prepare).
The English summary is being prepared. Showing the original description.
microsoft/skills☆ 3.1KUpdated Oct 18, 2026
Build, deploy, evaluate, optimize, fine-tune, and manage Microsoft Foundry agents, models, and resources end to end. USE FOR: foundry, azd ai agent, azd provision/deploy, hosted agent scaffold/develop/run/deploy/troubleshoot, prompt agent create, managed harness agent create, GitHub Copilot harness agent, create agent, update agent, add tool to agent, invoke agent, agent insights, evaluate agent, batch eval, continuous eval, continuous monitoring, agent CI/CD, optimize prompt, improve prompt, optimize agent instructions, Agent Optimizer scaffold, dataset curation from traces, deploy model, model fine-tuning (SFT/DPO/RFT), Foundry project, RBAC, role assignment, permissions, quota, capacity, region, deployment failure, AI Services, create Foundry resource, knowledge index, customize deployment, onboard, availability, training-data, grader, distillation, large file upload. DO NOT USE FOR: Azure Functions, App Service, general Azure deploy (use azure-deploy), general Azure prep (use azure-prepare).
The English summary is being prepared. Showing the original description.
microsoft/azure-skills☆ 1.6KUpdated Oct 17, 2026
Use when reducing model size, improving inference speed, or deploying to edge devices - covers quantization, pruning, knowledge distillation, ONNX export, and TensorRT optimizationUse when ", " mentioned.
The English summary is being prepared. Showing the original description.
omer-metin/skills-for-antigravity☆ 168Updated Jan 22, 2026
通用知识沉淀能力。用于从 devflow 或其他交付过程的需求、设计、实现、审查、测试产物中提炼可复用经验、技术决策、踩坑记录和流程改进。
The English summary is being prepared. Showing the original description.
Tencent/LoopForge☆ 56Updated Oct 16, 2026
通用知识沉淀能力 - 提供从项目交付过程中提炼可复用经验、教训和模式的标准化方法论,包括信息收集、精简提炼、结构化输出。不绑定任何特定工作流或存储方式。当用户说"帮我做知识沉淀"、"总结一下这次需求的经验"、"记录一下踩坑"、"沉淀一下这次的技术决策"、"做个复盘"时使用本技能。
The English summary is being prepared. Showing the original description.
Tencent/LoopForge☆ 56Updated Oct 16, 2026
Trial protocol for teaching AI Matrx an expert's knowledge until the platform breaks, fixing it. Use when asked to run an expertise trial, distil a person/creator/recent video into a Masterwork, or test the capture product. NOT for a known-missing feature (use build-sub-feature).
The English summary is being prepared. Showing the original description.
armanisadeghi/ai-matrx☆ 3Updated Oct 19, 2026