Information & Entropy. Shannon Information Axioms Small probability events should have more information than large probabilities. – “the nice person”