ERNIE 2.0: A Continual Pre-Training Framework for Language Understanding 论文翻译
文前总结： ERNIE2.0的亮点： 1.融合了持续学习（continual Learning）、多任务学习、知识引入等多种套路。 2.构造的任务可以分为三类：1) word-aware tasks用于教模型捕捉词汇信息（lexical information）；2) structure-aware task教模型捕捉句法信息（syntactic information）；3) semantic-
相关文章
- 1. 论文阅读笔记：《ERNIE 2.0: A Continual Pre-training Framework for Language Understanding》
- 2. ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language...论文翻译
- 3. BERT:Pre-training of Deep Bidirectional Transformers for Language Understanding 论文翻译
- 4. 论文翻译：BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- 5. 文献阅读笔记：XLNet: Generalized Autoregressive Pretraining for Language Understanding
- 6. Dex-Net 2.0 论文翻译
- 7. 论文阅读 Multi-Task Deep Neural Networks for Natural Language Understanding
- 8. 清华NLP | 28篇NLP预训练模型必读论文，可下载源码+论文
- 9. 【论文翻译】Visualizing and Understanding Convolutional Networks
- 10. 论文阅读：《Pretraining-Based Natural Language Generation for Text Summarization》
- 更多相关文章...
- • RSS
元素 - RSS 教程 - • Scala for循环 - Scala教程
- • Scala 中文乱码解决
- • Docker容器实战(七) - 容器眼光下的文件系统
相关标签/搜索
每日一句
-
每一个你不满意的现在，都有一个你没有努力的曾经。
欢迎关注本站公众号,获取更多信息
相关文章
- 1. 论文阅读笔记：《ERNIE 2.0: A Continual Pre-training Framework for Language Understanding》
- 2. ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language...论文翻译
- 3. BERT:Pre-training of Deep Bidirectional Transformers for Language Understanding 论文翻译
- 4. 论文翻译：BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- 5. 文献阅读笔记：XLNet: Generalized Autoregressive Pretraining for Language Understanding
- 6. Dex-Net 2.0 论文翻译
- 7. 论文阅读 Multi-Task Deep Neural Networks for Natural Language Understanding
- 8. 清华NLP | 28篇NLP预训练模型必读论文，可下载源码+论文
- 9. 【论文翻译】Visualizing and Understanding Convolutional Networks
- 10. 论文阅读：《Pretraining-Based Natural Language Generation for Text Summarization》