leaky rectified linear unit

名词 n.

英文释义

名词 n.
  1. A variation of the rectified linear unit, defined as f(x)=x when x≥0 and f(x)=αx for some small α, e.g. 0.01, when x<0.

词形变化

词源

Named after the rectified linear unit, where “leaky” denotes how the negative half of the function becomes slightly negative, being “leaky” in comparison to the default ReLU, which is zero.
1 次浏览 数据来源: Wiktionary