Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation

时间 2020-12-24

标签 Knowledge Distillation 繁體版

原文原文链接

Loss Source 1: Cross entropy loss，各个阶段的分类器都有 Loss Source 2: KL loss，深层的分类器作为浅层分类器的teacher Loss Source 3: L2 loss from hints，深层分类器的特征和浅层分类器的特征做L2 loss，bottleneck即feature adaptation，为了使student和teacher一样

>>阅读原文<<

1. Awesome Knowledge-Distillation
2. Bag of Tricks for Convolutional Neural Networks
3. Convolutional Neural Networks---Foundations of Convolutional Neural Networks
4. Convolutional Neural Networks: Application
5. The Unreasonable Effectiveness of Recurrent Neural Networks
6. Understanding Convolutional Neural Networks for NLP
7. [转] Understanding Convolutional Neural Networks for NLP
8. Using AJAX to Improve the Bandwidth Performance of Web Applications
9. [C6] Andrew Ng - Convolutional Neural Networks
10. Bag of Tricks for Image Classification with Convolutional Neural Networks
更多相关文章...
• XSLT 元素 - XSLT 教程
• XSLT 元素 - XSLT 教程
• 为了进字节跳动，我精选了29道Java经典算法题，带详细讲解
• Java 8 Stream 教程

最新文章

1. 如何将PPT某一页幻灯片导出为高清图片
2. Intellij IDEA中使用Debug调试
3. build项目打包
4. IDEA集成MAVEN项目极简化打包部署
5. eclipse如何导出java工程依赖的所有maven管理jar包(简单明了)
6. 新建的Spring项目无法添加class，依赖下载失败解决：Maven环境配置
7. 记在使用vue-cli中使用axios的心得
8. 分享提高自己作品UI设计形式感的几个小技巧！
9. 造成 nginx 403 forbidden 的几种原因
10. AOP概述(什么是AOP？)——Spring AOP（一）

本站公众号

欢迎关注本站公众号,获取更多信息

1. Awesome Knowledge-Distillation
2. Bag of Tricks for Convolutional Neural Networks
3. Convolutional Neural Networks---Foundations of Convolutional Neural Networks
4. Convolutional Neural Networks: Application
5. The Unreasonable Effectiveness of Recurrent Neural Networks
6. Understanding Convolutional Neural Networks for NLP
7. [转] Understanding Convolutional Neural Networks for NLP
8. Using AJAX to Improve the Bandwidth Performance of Web Applications
9. [C6] Andrew Ng - Convolutional Neural Networks
10. Bag of Tricks for Image Classification with Convolutional Neural Networks

>>更多相关文章<<