MSG-Transformer
时间: 2023-10-25 13:29:42 浏览: 55
MSG-Transformer是一种基于Transformer的多尺度体系结构,旨在解决在处理高分辨率视觉数据时,Transformer所面临的计算开销大的问题。MSG-Transformer通过引入专门的令牌作为每个区域的信使(MSG),实现了灵活地跨区域交换视觉信息,并降低了计算复杂度。该方法在标准图像分类和目标检测任务中取得了较好的性能,并加快了GPU和CPU的推理速度。MSG-Transformer还可以通过对MSG Token进行Shuffle操作来交换跨窗口信息,这种方式高效简单。总体而言,MSG-Transformer是一种通过引入MSG令牌和跨区域交换视觉信息的方式来改进Transformer模型在处理高分辨率视觉数据时的效率和灵活性的方法。<span class="em">1</span><span class="em">2</span><span class="em">3</span>
#### 引用[.reference_title]
- *1* *2* [MSG-Transformer:通过操纵信使令牌来交换局部空间信息](https://blog.csdn.net/m0_63642362/article/details/131485684)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v93^chatsearchT3_1"}}] [.reference_item style="max-width: 50%"]
- *3* [2021.7](https://blog.csdn.net/junmoxizsq/article/details/118855607)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v93^chatsearchT3_1"}}] [.reference_item style="max-width: 50%"]
[ .reference_list ]