Re: Should pg 11 use a lot more memory building an spgist index?

From: Bruno Wolff III <bruno(at)wolff(dot)to>
To: pgsql-general(at)lists(dot)postgresql(dot)org
Subject: Re: Should pg 11 use a lot more memory building an spgist index?
Date: 2018-10-25 12:10:29
Message-ID: 20181025121029.GA25010@wolff.to
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

It looks like it got past creating the exclude constraint based on the
ordering of commands in the dump file. However creating a more normal
spgist index is taking a very long time with a lot of disk wait time.
CPU usage seems pretty low for the amount of time it has been working
on building that index, but maybe that is normal for building indexes.
I used the almost the default postgresql.conf on my workstation. I bumped
up the limits in a few places on the server that could have allowed a lot
more memory to be used especially if the index creation was parallelized.
While the load is running I'll see if I can tell if there is a memory leak
with this index build. Once it finishes, I can dump a specific table
and test building the exclude spgist index with some different settings
to see if I can reproduce the out of memory error with a lot less data
then is in the whole database.

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Олег Самойлов 2018-10-25 13:05:33 Re: Compile and build portable postgresql for mac
Previous Message Andres Freund 2018-10-25 10:19:48 Re: rw_redis_fdw: SQL Errors when statement is within a function

Browse pgsql-hackers by date

  From Date Subject
Next Message Christian Ullrich 2018-10-25 12:32:26 Re: Problem with EDB 11.0 Windows x64 distributions
Previous Message Sandeep Thakkar 2018-10-25 11:53:02 Re: Problem with EDB 11.0 Windows x64 distributions