RE: [HACKERS] 123.45 - 123 = 0.45

From: "Jackson, DeJuan" <djackson(at)cpsgroup(dot)com>
To: Bruce Momjian <maillist(at)candle(dot)pha(dot)pa(dot)us>, daveh(at)insightdist(dot)com
Cc: sferac(at)bo(dot)nettuno(dot)it, pgsql-hackers(at)postgreSQL(dot)org
Subject: RE: [HACKERS] 123.45 - 123 = 0.45
Date: 1998-12-15 16:31:29
Message-ID: F10BB1FAF801D111829B0060971D839F576209@cpsmail
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

> Yes, someone pointed this out to me in private e-mail, and I wrote a C
> program to confirm it. I just had never seen such rounding on such
> small non-irrational numbers.
But, the problem is that it is irrational in base 2 (or at least so many
digits that it won't fit).
-DEJ

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 1998-12-15 16:43:08 Re: [HACKERS] 123.45 - 123 = 0.45
Previous Message Bruce Momjian 1998-12-15 16:20:15 Re: [HACKERS] 123.45 - 123 = 0.45