ALBERT

ALBERT 减少参数同时不减少performance 0 the most parameters from 方法1 方法2 design better self-supervised learning tasks simply reverse the sentence:真正让网络学习到句子之间的连续性 去掉dropout 增大数据容量

>>阅读原文<<