Talk:Activation function

From Wikipedia, the free encyclopedia
Jump to: navigation, search
WikiProject Computer science (Rated Start-class, Mid-importance)
WikiProject icon This article is within the scope of WikiProject Computer science, a collaborative effort to improve the coverage of Computer science related articles on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.
Start-Class article Start  This article has been rated as Start-Class on the project's quality scale.
 Mid  This article has been rated as Mid-importance on the project's importance scale.
 
WikiProject Computing (Rated Start-class, Low-importance)
WikiProject icon This article is within the scope of WikiProject Computing, a collaborative effort to improve the coverage of computers, computing, and information technology on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.
Start-Class article Start  This article has been rated as Start-Class on the project's quality scale.
 Low  This article has been rated as Low-importance on the project's importance scale.
 

What does " when " mean?[edit]

What is the purpose of the column " when "? It's unclear what the expression means, as I wrote in the {{clarify}} template. What I don't understand are:

  • By substitution, is this equivalent to the expression when ?
  • If not, does when ?
  • Does have to pass through the origin?

These ambiguities apparently lead to some disagreement to what should actually be the truth value of that expression (yes or no?). I think we need to answer these questions, otherwise I don't know if it makes any sense to keep the column. —Kri (talk) 11:56, 5 May 2016 (UTC)

  • It's a vague approximation to , but is closer. For one thing, would imply rather than
  • We know little of the derivative because we're now stacking approximations on top of each other. In particular it can become risky to assume much about the range of x for where this assumption holds usefully true. Although, yes,
  • Yes
Andy Dingley (talk) 12:27, 5 May 2016 (UTC)
Okay, so if I understand you corectly, saying that when for an activation function is equivalent to saying that when and that passes through the origin, or more formally that and ; is that correct? —Kri (talk) 21:58, 7 May 2016 (UTC)