文本分类模型 transformer

文本分类模型Transformer是一种使用自注意力机制的Seq2Seq模型。它包含一个encoder和一个decoder。在这个模型中，encoder将输入序列编码为一组上下文向量，而decoder将这些上下文向量解码为输出序列。该模型的结构如下图所示：<span class="em">1</span><span class="em">2</span><span class="em">3</span>
#### 引用[.reference_title]
- *1* *3* [【自然语言处理】文本分类模型_Transformer_TensorFlow实现](https://blog.csdn.net/bqw18744018044/article/details/89501595)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v92^chatsearchT0_1"}}] [.reference_item style="max-width: 50%"]
- *2* [【python transformer】使用Transformer模型进行文本分类](https://blog.csdn.net/u013421629/article/details/120785623)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v92^chatsearchT0_1"}}] [.reference_item style="max-width: 50%"]
[ .reference_list ]