From: | Bruce Momjian <maillist(at)candle(dot)pha(dot)pa(dot)us> |
---|---|
To: | lockhart(at)alumni(dot)caltech(dot)edu (Thomas G(dot) Lockhart) |
Cc: | james(at)vrtx(dot)net, scrappy(at)hub(dot)org, darcy(at)druid(dot)net, pgsql-hackers(at)postgreSQL(dot)org |
Subject: | Re: [HACKERS] Warning!! |
Date: | 1998-11-04 14:02:54 |
Message-ID: | 199811041402.JAA09661@candle.pha.pa.us |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
> > I'm very new to this list, and I have to first say that 6.4beta5 fixes
> > every problem I had encountered with 6.3.2 (A small list..)
> > Just now I saw and posted this...
> > If the pence is 0-4 it rounds down... surely that's a rounding bug
> > because it should be looking at the next significant figure?
>
> tgl=> select cash_mul_flt8('$123.77', '1');
> cash_mul_flt8
> -------------
> $123.77
> (1 row)
>
> tgl=> select cash_mul_flt8('$1', '123.77');
> cash_mul_flt8
> -------------
> $123.76
> (1 row)
>
> That's annoying; it's non-symmetric too. The money type is stored as an
> integer, and the float type is an IEEE double; looks like we have an LSB
> rounding problem. Not sure what to do about it other than remove the
> function, which isn't desirable I'm sure...
This is really bad. I can't imagine a 5-digit double is loosing
rounding on a double. There must be some other problem, but I can't
reproduce it here on BSD/OS.
--
Bruce Momjian | http://www.op.net/~candle
maillist(at)candle(dot)pha(dot)pa(dot)us | (610) 853-3000
+ If your life is a hard drive, | 830 Blythe Avenue
+ Christ can be your backup. | Drexel Hill, Pennsylvania 19026
From | Date | Subject | |
---|---|---|---|
Next Message | Lyn K. Finman | 1998-11-04 14:03:50 | cache lookup failed |
Previous Message | Bruce Momjian | 1998-11-04 13:57:57 | Re: [HACKERS] Warning!! |