[Tutor] help: funny numbers

Erik Price erikprice@mac.com
Tue, 2 Apr 2002 22:38:51 -0500


On Tuesday, April 2, 2002, at 03:03  PM, Kirby Urner wrote:

> We're used to thinking of finite decimals as approximations
> of fractions, it's just that we forget 665/100 (i.e. 6.65)
> is, for the computer, a division problem in base 2, and so
> we keep being surprised by "floating point noise" in our
> calculations.

So is there a function, method, or technique that can "clean up" the 
noise, and approximate the value that we really want?  Or do we code it 
ourselves?


Erik