AI/ML
Knowledge Distillation
Também chamado de:Model Distillation
📖O que é
A technique for transferring capabilities from a large 'teacher' model to a smaller 'student' model, typically by having the teacher generate a synthetic dataset that the student is fine-tuned on. Distilled models can match or exceed teacher performance on specific tasks while being much cheaper to deploy. Common in 2024-2025 for creating efficient specialized models.
Sua exploração
0 termos visitados no totalTermos relacionados explorados0/3
Termos Relacionados
Synthetic Data (AI Training)AI/ML
Artificially generated training data produced by LLMs or other AI models, used to augment …
Ver termo →Fine-TuningAI/ML
The process of further training a pre-trained model on a specialized dataset to improve pe…
Ver termo →Quantization (AI)AI/ML
A model compression technique that reduces weight precision (e.g., from 16-bit to 4-bit) t…
Ver termo →