## Rough notes - Often described as the state of "disorder" of a system. That's doesn't lead to a very useful mental model - It's about number of potential configurations, not any given state. - State != just positions but everything about the system that could be used to predict the next state of the system - e.g. the velocities of the particles is part of determining the next state. A system where molecules have higher heat / energy (Q) there's a larger number of potential velocities for each of the molecules. --- - Links: [[Information Entropy|Shannon Entropy]] [[Cross-entropy]] [[Information Theory]] [[Information Gain]] [[Mutual Information]] - Created at: 2023-07-20