A computer uses 8 digit mantissa and 2 digit exponent. If a = 0.052 and b = 28 E + 11 then b + a - b will
- A. result in an overflow error
- B. result in an underflow error
- C. be 0
- D. be 5.28E + 11
Answer: C. be 0
Explanation: Due to limited precision, adding a very small number 'a' to a very large number 'b' results in 'b' (a is lost). Then subtracting 'b' gives 0. (b+a) = b. b-b = 0.