Re: Significant Digits in Floating Point Datatype

From: Lee Hachadoorian <lee(dot)hachadoorian(at)gmail(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>
Subject: Re: Significant Digits in Floating Point Datatype
Date: 2011-11-21 02:14:14
Message-ID: 4EC9B3F6.8070404@gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On 11/20/2011 02:06 PM, Tom Lane wrote:
> Lee Hachadoorian<lee(dot)hachadoorian(at)gmail(dot)com> writes:
>> And can I reliably retrieve the original integer by
>> casting to int (or bigint) if the number of digits in the original
>> integer is less than 15?
> On IEEE-floating-point machines, I'd expect float8 to store integers
> up to 2^52 (or maybe it's 2^53) exactly. With other floating-point
> formats the limit might be different, but it should still be exact for
> reasonable-size integers. This has nothing whatever to do with whether
> decimal fractions are reproduced exactly (in general, they aren't, no
> matter how many or few digits are involved). So integers are fine,
> bigints not so much.
>
> regards, tom lane

Thank you, that clarification is extremely useful. --Lee

--
Lee Hachadoorian
PhD, Earth& Environmental Sciences (Geography)
Research Associate, CUNY Center for Urban Research
http://freecity.commons.gc.cuny.edu

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Tomas Vondra 2011-11-21 02:16:23 Re: Installed. Now what?
Previous Message Ondrej Ivanič 2011-11-21 02:08:57 Re: Table Design question for gurus (without going to "NoSQL")...