Re: Fwd: [GENERAL] 4B row limit for CLOB tables

From: Jim Nasby <Jim(dot)Nasby(at)BlueTreble(dot)com>
To: Álvaro Hernández Tortosa <aht(at)8Kdata(dot)com>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, Stephen Frost <sfrost(at)snowman(dot)net>
Cc: Bruce Momjian <bruce(at)momjian(dot)us>, <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Fwd: [GENERAL] 4B row limit for CLOB tables
Date: 2015-04-25 04:39:04
Message-ID: 553B1A68.1000900@BlueTreble.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

On 4/24/15 7:11 PM, Álvaro Hernández Tortosa wrote:
> On 24/04/15 05:24, Tom Lane wrote:
...
>> TBH, I've got very little enthusiasm for fixing this given the number
>> of reports of trouble from the field, which so far as I recall is zero.
>> Álvaro's case came up through intentionally trying to create an
>> unreasonable number of tables, not from real usage. This thread likewise
>> appears to contain lots of speculation and no reports of anyone hitting
>> a problem in practice.
>
> It is certainly true that this was a very synthetic case. I
> envision, however, certain use cases where we may hit a very large
> number of tables:

The original case has NOTHING to do with the number of tables and
everything to do with the number of toasted values a table can have. If
you have to toast 4B attributes in a single relation it will fail. In
reality, if you get anywhere close to that things will fall apart due to
OID conflicts.

This case isn't nearly as insane as 4B tables. A table storing 10 text
fields each of which is 2K would hit this limit with only 400M rows. If
my math is right that's only 8TB; certainly not anything insane
space-wise or rowcount-wise.

Perhaps it's still not fixing, but I think it's definitely worth
documenting.
--
Jim Nasby, Data Architect, Blue Treble Consulting
Data in Trouble? Get it in Treble! http://BlueTreble.com

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Dorian Hoxha 2015-04-25 11:33:05 Re: Streaming-SQL Database PipelineDB (Based on PostgreSQL 9.4) - Available in Beta
Previous Message Álvaro Hernández Tortosa 2015-04-25 00:11:43 Re: Fwd: [GENERAL] 4B row limit for CLOB tables

Browse pgsql-hackers by date

  From Date Subject
Next Message Amit Kapila 2015-04-25 05:12:46 Re: Reducing tuple overhead
Previous Message Peter Geoghegan 2015-04-25 02:21:37 Re: INSERT ... ON CONFLICT IGNORE (and UPDATE) 3.0