transformer优点与缺点
时间: 2023-08-25 12:13:58 浏览: 49
回答:
Transformer的优点是它改进了RNN训练速度慢的问题,通过使用self-attention机制实现了快速的并行运算。它的结构包括自注意力机制、位置编码、Add&Normalize、全连接层Feed Forward等模块,这些模块相互协作,能够更好地处理序列数据和提取特征。此外,Transformer最早被用于翻译任务,取得了很好的效果。另外,Transformer的训练需要大量的数据和计算资源,对于小规模的任务可能不太适合。<em>1</em><em>2</em><em>3</em>
#### 引用[.reference_title]
- *1* *2* [Transformer笔记](https://blog.csdn.net/weixin_42475060/article/details/121101749)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v92^chatsearchT3_1"}} ] [.reference_item]
- *3* [Block Recurrent Transformer:结合了LSTM和Transformer优点的强大模型](https://blog.csdn.net/qq_33431368/article/details/125827181)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v92^chatsearchT3_1"}} ] [.reference_item]
[ .reference_list ]