Maximum entropy

From Wikipedia, the free encyclopedia
Jump to: navigation, search

Entropy is a concept that originated in thermodynamics, and later, via statistical mechanics, motivated entire branches of information theory, statistics, and machine learning.

Maximum entropy is the state of a physical system at greatest disorder or a statistical model of least encoded information, these being important theoretical analogs.

Maximum entropy may refer to:

Physics[edit]

Statistics[edit]

Machine learning[edit]

See also[edit]