首页spatial transformer layer

spatial transformer layer

时间: 2023-04-19 11:02:35 浏览: 215

1506.02025_Spatial Transformer Networks

Convolutional Neural Networks define an exceptionally powerful class of models, but are still limited by the lack of ability to be spatially invariant to the input data in a computationally and parameter efficient manner. In this work we introduce a new learnable module, the Spatial Transformer, which explicitly allows the spatial manipulation of data within the network. This differentiable module can be inserted into existing convolutional architectures, giving neural networks the ability to actively spatially transform feature maps, conditional on the feature map itself, without any extra training supervision or modification to the optimisation process. We show that the use of spatial transformers results in models which learn invariance to translation, scale, rotation and more generic warping, resulting in state-of-the-art performance on several benchmarks, and for a number of classes of transformations.

空间变换层（Spatial Transformer Layer）是一种神经网络层，可以对输入数据进行空间变换，以增强网络的几何不变性和鲁棒性。它可以通过学习如何对输入进行旋转、缩放、平移等变换，使得网络可以更好地适应不同的输入数据。空间变换层可以应用于许多计算机视觉任务，如图像分类、目标检测和图像分割等。

阅读全文