A Comprehensive Overhaul of Feature Distillation

时间 2020-12-24

标签 Knowledge Distillation 繁體版

原文原文链接

Motivation ClovaAI今年ICCV做了还几篇总结性的工作，该篇也类似，先总结当下做feature distillation的各个方向，总体的pipeline是选取student和teacher网络结构的某个位置然后对特征进行变换，最后拉进他们的距离 Teacher transform: 为了让teacher和student的feature map一样大(空间或者通道)，会对teach

>>阅读原文<<

1. Tutorial: Knowledge Distillation
2. 【数据挖掘】A Comprehensive Survey of Clustering Algorithms
3. A Comprehensive Survey of Graph Embedding:Problems, Techniques and Applications
4. A Comprehensive Analysis of Sequence Alignment Algorithms for LongRead Sequencing
5. Awesome Knowledge-Distillation
6. Circuit Overhaul For Expert
7. Software-Defined Networking: A Comprehensive Survey
8. Rapid Object Detection using a Boosted Cascade of Simple Feature
9. Paper Notes: A Comprehensive Survey on Graph Neural Networks
10. On the Efficacy of Knowledge Distillation
更多相关文章...
• XSLT 元素 - XSLT 教程
• XSLT 元素 - XSLT 教程
• JDK13 GA发布：5大特性解读
• Kotlin学习（二）基本类型

最新文章

1. 字节跳动21届秋招运营两轮面试经验分享
2. Java 3 年，25K 多吗？
3. mysql安装部署
4. web前端开发中父链和子链方式实现通信
5. 3.1.6 spark体系之分布式计算-scala编程-scala中trait特性
6. dataframe2
7. ThinkFree在线
8. 在线画图
9. devtools热部署
10. 编译和链接

本站公众号

欢迎关注本站公众号,获取更多信息

1. Tutorial: Knowledge Distillation
2. 【数据挖掘】A Comprehensive Survey of Clustering Algorithms
3. A Comprehensive Survey of Graph Embedding:Problems, Techniques and Applications
4. A Comprehensive Analysis of Sequence Alignment Algorithms for LongRead Sequencing
5. Awesome Knowledge-Distillation
6. Circuit Overhaul For Expert
7. Software-Defined Networking: A Comprehensive Survey
8. Rapid Object Detection using a Boosted Cascade of Simple Feature
9. Paper Notes: A Comprehensive Survey on Graph Neural Networks
10. On the Efficacy of Knowledge Distillation

>>更多相关文章<<