Topic: Information Theory & Coding
In a binary source, 0s occur three times as often as 1s. What is the information contained in the 1s?
- A. 0.415 bit
- B. 0.333 bit
- C. 3 bit
- D. 2 bit
Answer: D. 2 bit
Explanation: P(0) = 3 * P(1) and P(0) + P(1) = 1, which gives P(1) = 1/4. Information content contained in 1s is I = log_2(1 / P(1)) = log_2(4) = 2 bits.