Rectifier (neural networks): Revision history

Filter revisionsshowhide

To date:

Tag filter:

Invert selection

External tools:

For any version listed below, click on its date to view it. For more help, see Help:Page history and Help:Edit summary. (cur) = difference from current version, (prev) = difference from preceding version, m = minor edit, → = section edit, ← = automatic edit summary

curprev 15:2315:23, 30 April 2024‎ 91.103.43.254 talk‎ 17,419 bytes +9‎ No edit summary undo

curprev 00:4500:45, 28 January 2024‎ Michael Hardy talk contribs‎ 17,193 bytes −4‎ →‎Piecewise-linear variants undo
curprev 00:4200:42, 28 January 2024‎ Michael Hardy talk contribs‎ 17,197 bytes −246‎ No edit summary undo

curprev 22:3222:32, 27 January 2024‎ Michael Hardy talk contribs‎ 17,443 bytes −30‎ →‎SiLU undo

curprev 17:4917:49, 5 January 2024‎ Caus7248 talk contribs‎ m 17,473 bytes +3‎ No edit summary undo Tag: Visual edit
curprev 17:4917:49, 5 January 2024‎ Caus7248 talk contribs‎ 17,470 bytes −4‎ No edit summary undo Tag: Visual edit
curprev 17:4017:40, 5 January 2024‎ Caus7248 talk contribs‎ m 17,474 bytes +205‎ I've added a linear transformation to a known approximation of the Softplus function, which highlights an interesting fact about it. undo Tags: nowiki added Visual edit

curprev 04:2004:20, 4 January 2024‎ 45.181.122.234 talk‎ 17,269 bytes +61‎ →‎Softplus: solving a domain issue in an approximation undo Tags: Mobile edit Mobile web edit

curprev 18:5618:56, 28 October 2023‎ 213.89.114.194 talk‎ 17,227 bytes −24‎ Undid revision 1182290571 by 213.89.114.194 (talk) undo Tag: Undo
curprev 11:0511:05, 28 October 2023‎ 213.89.114.194 talk‎ 17,251 bytes +24‎ This should be included in the definition. undo Tags: Reverted Visual edit

curprev 14:3414:34, 28 September 2023‎ Trappist the monk talk contribs‎ m 17,227 bytes +14‎ cite repair; undo Tag: AWB

curprev 20:0820:08, 3 July 2023‎ The Anome talk contribs‎ 17,213 bytes 0‎ →‎SiLU: fmt undo Tag: Visual edit
curprev 20:0720:07, 3 July 2023‎ The Anome talk contribs‎ 17,213 bytes +52‎ →‎Leaky ReLU: helping to mitigate the vanishing gradient problem. undo Tag: 2017 wikitext editor

curprev 19:4519:45, 4 June 2023‎ 2001:569:7f63:5900:4547:c620:fd4d:6847 talk‎ 17,161 bytes +19‎ →‎Squareplus undo
curprev 19:4419:44, 4 June 2023‎ 2001:569:7f63:5900:4547:c620:fd4d:6847 talk‎ 17,142 bytes +40‎ →‎Squareplus undo
curprev 19:4219:42, 4 June 2023‎ 2001:569:7f63:5900:4547:c620:fd4d:6847 talk‎ 17,102 bytes +1,060‎ →‎Variants: Add squareplus undo

curprev 14:4514:45, 22 May 2023‎ Alanisaweeb talk contribs‎ 16,042 bytes +18‎ Added an interesting equivalent expression for the ReLU function I found and checked using desmos https://www.desmos.com/calculator/e9i8s3n3k9, noteable because it is the average of x and |x undo

curprev 08:3108:31, 13 May 2023‎ 50.47.212.164 talk‎ 16,024 bytes −773‎ There is absolutely no justification, citation, or existing reference for the "metallic mean" function in the context of activation functions. It is very likely to be original research, because its use as an activation function is entirely unknown to the field of machine learning. undo Tag: section blanking

curprev 15:4215:42, 7 May 2023‎ Trappist the monk talk contribs‎ m 16,797 bytes +13‎ →‎top: cite repair; undo Tag: AWB

curprev 07:4607:46, 30 April 2023‎ 2a01:cb1c:e52:300:500e:360b:c6e4:385d talk‎ 16,784 bytes +40‎ →‎Gaussian-error linear unit (GELU) undo

curprev 18:2618:26, 10 April 2023‎ Sunsetsilk talk contribs‎ 16,744 bytes +201‎ The ReLU activation function was introduced by Kunihiko Fukushima in 1969 undo

curprev 15:1615:16, 11 January 2023‎ Ralf König talk contribs‎ 16,543 bytes +725‎ added derivatives for all functions in a neatly arranged manner, corrected one error in section on "Metallic mean" (limit to minus infinity) undo
curprev 13:5813:58, 11 January 2023‎ Ralf König talk contribs‎ 15,818 bytes +279‎ →‎Piecewise-linear variants: function and first derivative next to each other undo

curprev 23:2223:22, 16 December 2022‎ 2001:569:7d87:f00:b439:1960:1468:e2a7 talk‎ 15,539 bytes +69‎ →‎Metallic mean function: Added smoothness property undo
curprev 23:1323:13, 16 December 2022‎ 2001:569:7d87:f00:b439:1960:1468:e2a7 talk‎ 15,470 bytes +53‎ →‎Metallic mean function undo
curprev 23:0723:07, 16 December 2022‎ 2001:569:7d87:f00:b439:1960:1468:e2a7 talk‎ 15,417 bytes +595‎ →‎Other non-linear variants: Added metallic mean function undo

curprev 15:1415:14, 29 November 2022‎ Ohnoitsjamie talk contribs‎ m 14,822 bytes −1,339‎ Reverted edits by 117.246.30.205 (talk) to last version by 50.216.169.6 undo Tag: Rollback
curprev 13:5813:58, 29 November 2022‎ 117.246.30.205 talk‎ 16,161 bytes +1,339‎ Added new non-monotonic activation functions. undo Tags: Reverted Visual edit Possible vandalism

curprev 21:0821:08, 27 November 2022‎ 50.216.169.6 talk‎ 14,822 bytes −165‎ →‎Gaussian-error linear unit (GELU): remove tangent of an activation that has never been used in a state-of-the-art model undo Tag: Manual revert

curprev 20:5920:59, 19 September 2022‎ Uric1977 talk contribs‎ 14,987 bytes +165‎ →‎Gaussian-error linear unit (GELU) undo Tag: Reverted

curprev 17:0717:07, 15 September 2022‎ Mikhail Ryazanov talk contribs‎ m 14,822 bytes −159‎ →‎Variants: MOS:CAPS, punct., style, fmt. undo
curprev 16:5816:58, 15 September 2022‎ Mikhail Ryazanov talk contribs‎ m 14,981 bytes +5‎ →‎Potential problems: MOS:CAPS undo
curprev 16:5616:56, 15 September 2022‎ Mikhail Ryazanov talk contribs‎ m 14,976 bytes +14‎ →‎top: punct., MOS:CAPS undo

curprev 08:4108:41, 29 July 2022‎ Felix QW talk contribs‎ 14,962 bytes −45‎ Removing merge template after merging (easy-merge) undo

30 April 2024

9 April 2024

28 January 2024

27 January 2024

5 January 2024

4 January 2024

3 January 2024

28 October 2023

28 September 2023

3 July 2023

4 June 2023

22 May 2023

13 May 2023

7 May 2023

30 April 2023

10 April 2023

11 January 2023

16 December 2022

29 November 2022

27 November 2022

19 September 2022

15 September 2022

29 July 2022