leaky rectified linear unit
名词 n.
英文释义
名词 n.
- A variation of the rectified linear unit, defined as f(x)=x when x≥0 and f(x)=αx for some small α, e.g. 0.01, when x<0.
词源
Named after the rectified linear unit, where “leaky” denotes how the negative half of the function becomes slightly negative, being “leaky” in comparison to the default ReLU, which is zero.
1 次浏览
数据来源: Wiktionary