We give a survey of the basic statistical ideas underlying the definition of entropy in information theory and their connections with the entropy in the theory of dynamical systems and in statistical mechanics.
No takes yet. Share an insight, caveat, or question.
Derek W. Robinson (2008) studied this question.