Talk:Autoencoder

From Wikipedia, the free encyclopedia
Jump to: navigation, search
WikiProject Robotics (Rated Stub-class, Mid-importance)
WikiProject icon Autoencoder is within the scope of WikiProject Robotics, which aims to build a comprehensive and detailed guide to Robotics on Wikipedia. If you would like to participate, you can choose to edit this article, or visit the project page (Talk), where you can join the project and see a list of open tasks.
Stub-Class article Stub  This article has been rated as Stub-Class on the project's quality scale.
 Mid  This article has been rated as Mid-importance on the project's importance scale.
 
WikiProject Computer science (Rated Stub-class)
WikiProject icon This article is within the scope of WikiProject Computer science, a collaborative effort to improve the coverage of Computer science related articles on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.
Stub-Class article Stub  This article has been rated as Stub-Class on the project's quality scale.
 ???  This article has not yet received a rating on the project's importance scale.
 

Training section[edit]

Much of the training section does not seem to be directly related to auto-encoders in particular but about neural networks in general. No? BrokenSegue 09:17, 29 August 2011 (UTC)

Clarification of "An output layer, where each neuron has the same meaning as in the input layer"[edit]

I don't understand what "has the same meaning as in the input layer" means in the output layer definition in the article. Can someone explain or clarify in the article, please. Many thanks, p.r.newman (talk) 09:53, 10 October 2012 (UTC)

==Answer: The outputs are the same as the inputs, i.e. y_i = x_i. The autoencoder tries to learn the identity function. Although it might seem that if the number of hidden units >= the number of input units (/output units) the resulting weights would be the trivial identity, in practice this does not turn out to be the case (probably due to the fact that the weights start so small). Sparse autoencoders, where a limited number of hidden units can be activated at once, avoid this problem even in theory. 216.169.216.1 (talk) 16:47, 17 September 2013 (UTC) Dave Rimshnick