For Shannon's purposes, the entropy of a system is the number of possible states that the system has the capability to be in. Any one of those potential states can constitute a message. For example, a ...