'knowledge-distillation' 검색 결과

Design deployment-focused distillation systems that balance model size, accuracy, calibration, and cascade escalation under real resource limits. Best for teacher-student compression, threshold design, and failure-aware deployment. Activate on "model compression", "teacher- student", "distillation score", "cascade model", "edge deployment", or "model calibration". NOT for generic deep-learning overviews, prompt optimization, or training work without a concrete distillation objective.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Deep analysis of knowledge distillation techniques for compressing large models into smaller efficient ones

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Choose what kind of knowledge to transfer between teacher and student models: response, feature, or relational, and decide among offline, online, self, or cross-modal distillation schemes. Best for distillation strategy selection, capacity-gap diagnosis, and transfer planning. Activate on "knowledge distillation", "teacher-student", "soft labels", "feature distillation", "online distillation", or "cross-modal transfer". NOT for generic compression checklists or unrelated training work.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Synthesize OpenViking knowledge bases or document collections into topic-based Markdown pages that explain trends, changes, comparisons, and implications. Keep conclusions traceable to source evidence, distinguish facts from inferences, and preserve disagreements and uncertainty.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Comparing changes across financial reports
• Finding shared trends across knowledge bases
• Organizing sourced conclusions by topic

Train smaller language models using knowledge distillation, where a larger model supplies examples or prediction targets. This skill covers training losses, generated training data, parameter choices, and output comparisons to support model compression and specialized student models.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Training a smaller model from a larger teacher
• Fine-tuning with teacher-generated responses
• Distilling domain knowledge into a specialized model

Guide knowledge distillation, where a smaller language model learns from a larger teacher. Covers training from teacher responses or prediction scores, adjusting training settings, and comparing outputs to support model compression and specialized training.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Compressing a large language model into a smaller model
• Training a specialized model from teacher-generated examples
• Comparing distillation methods and training settings

通用知识沉淀能力。用于从 devflow 或其他交付过程的需求、设计、实现、审查、测试产物中提炼可复用经验、技术决策、踩坑记录和流程改进。

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

通用知识沉淀能力 - 提供从项目交付过程中提炼可复用经验、教训和模式的标准化方法论，包括信息收集、精简提炼、结构化输出。不绑定任何特定工作流或存储方式。当用户说"帮我做知识沉淀"、"总结一下这次需求的经验"、"记录一下踩坑"、"沉淀一下这次的技术决策"、"做个复盘"时使用本技能。

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Comprima modelos de linguagem grandes usando destilação de conhecimento de modelos professor para aluno. Use ao implantar modelos menores com desempenho retido, transferir capacidades do GPT-4 para modelos de código aberto ou reduzir custos de inferência. Aborda escalamento de temperatura, alvos suaves, KLD reversa, destilação de logits e estratégias de treinamento MiniLLM.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Compress large language models using knowledge distillation from teacher to student models. Use when deploying smaller models with retained performance, transferring GPT-4 capabilities to open-source models, or reducing inference costs. Covers temperature scaling, soft targets, reverse KLD, logit distillation, and MiniLLM training strategies.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.