First page Back Continue Last page Overview Graphics
Quantity of Information
High uncertainty == more information
The more uncertain an event is, the more information is conveyed when it occurs
Entropy is the total uncertainty over all variables
- Total uncertainty of the system