attention机制

attention的通用表达式QKV，这篇文章感受讲的挺详细get https://shikanon.com/2019/%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0/%E6%B3%A8%E6%84%8F%E5%8A%9B%E6%9C%BA%E5%88%B6%E5%8F%8A%E5%85%B6%E6%84%8F%E4%B9%89/io

>>阅读原文<<