首页the gated recurrent unit

the gated recurrent unit

时间: 2024-05-25 15:16:48 浏览: 116

GRU（Gated Recurrent）神经网络介绍及公式推导

5星 · 资源好评率100%

GRU（Gated Recurrent Unit）神经网络是LSTM 的一个变体，GRU 在保持了LSTM 的效果同时又使结构更加简单，是一种非常流行RNN 神经网络，它只有两个门了，分别为更新门t z 和重置门tr 。更新门控制前一时刻的状态信息被带入到当前状态中的程度，值越大前一时刻的状态信息带入越多。重置门控制忽略前一时刻的状态信息的程度，值越小说明忽略得越多。

The gated recurrent unit (GRU) is a type of recurrent neural network (RNN) that was introduced in 2014 by Cho et al. It is a variant of the traditional RNN that uses gating mechanisms to control the flow of information through the network. The GRU has gates that regulate the amount of information that is passed on from one time step to the next, allowing it to selectively remember or forget previous inputs. This gating mechanism helps to mitigate the vanishing gradient problem that is common in traditional RNNs, where the gradient signal becomes too small to effectively update the network weights over long sequences. The GRU has two gates: the reset gate and the update gate. The reset gate determines how much of the previous hidden state should be forgotten, while the update gate determines how much of the current input should be added to the current hidden state. These gates are controlled by trainable parameters that are updated during training. Compared to traditional RNNs, GRUs have been shown to have better performance on tasks such as speech recognition and machine translation. They are also more computationally efficient than other RNN variants such as the long short-term memory (LSTM) network.

阅读全文