Topic: Information Theory and Coding
Which of the following statements best describes the primary distinction between Shannon's Source Coding Theorem and Shannon's Channel Coding Theorem?
- A. Source coding is only for lossless compression, while channel coding is only for lossy compression
- B. Source coding applies only to discrete sources, whereas channel coding applies to continuous sources
- C. Source coding deals with compressing data, while channel coding deals with transmitting data reliably over a noisy channel
- D. Source coding aims to increase redundancy, while channel coding aims to remove redundancy
Answer: C. Source coding deals with compressing data, while channel coding deals with transmitting data reliably over a noisy channel
Explanation: Shannon's Source Coding Theorem establishes the theoretical limit for data compression (entropy), effectively aiming to remove redundancy. Shannon's Channel Coding Theorem establishes the theoretical limit for reliable communication over a noisy channel (channel capacity), which relies on adding controlled redundancy (error correction codes) to combat noise.