Re: pg_bulkload slowing down

On Mon, Jul 28, 2025 at 9:23 AM Álvaro Herrera <alvherre(at)kurilemu(dot)de> wrote:

> On 2025-Jul-28, Sbob wrote:
>
> > All;
> >
> >
> > We are loading a series of files into a single table, each file has
> approx
> > 500million rows, the first file took ~ 1.25 hours, now on file number 8
> it
> > has been running for more than 10 hours, there is only a PK index on the
> > table.
>
> I bet it's trying to find unused OIDs for toast pointers -- there are
> only 2^32-1 of those available in any one toast table, and by the eighth
> file of 500 million rows, you'd run out.
>

That seems to imply you can only insert 4Bn rows into a table with attached
TOAST. Am I misunderstanding something?

--
Death to <Redacted>, and butter sauce.
Don't boil me, I'm still alive.
<Redacted> lobster!