Re: ERROR: too many dynamic shared memory segments

From: Thomas Munro <thomas(dot)munro(at)gmail(dot)com>
To: Julian Backes <julianbackes(at)gmail(dot)com>
Cc: Nicola Contu <nicola(dot)contu(at)gmail(dot)com>, Pavel Stehule <pavel(dot)stehule(at)gmail(dot)com>, "pgsql-generallists(dot)postgresql(dot)org" <pgsql-general(at)lists(dot)postgresql(dot)org>, Alessandro Aste <Alessandro(dot)aste(at)gtt(dot)net>
Subject: Re: ERROR: too many dynamic shared memory segments
Date: 2020-01-29 11:26:00
Message-ID: CA+hUKG+zw87b70yJp+Ozz6LqS6s9QvdO4+hQuZc=DWLMi6Od6A@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Wed, Jan 29, 2020 at 11:24 PM Julian Backes <julianbackes(at)gmail(dot)com> wrote:
> we only had the "too many shared too many dynamic shared memory segments" error but no segmentation faults. The error started occurring after upgrading from postgres 10 to postgres 12 (server has 24 cores / 48 threads, i.e. many parallel workers). The error itself was not that much of a problem but /dev/shm started filling up with orphaned files which probably (?) had not been cleaned up by postgres after the parallel workers died. In consequence, after some time, /dev/shm was full and everything crashed.

Oh, thanks for the report. I think see what was happening there, and
it's a third independent problem. The code in dsm_create() does
DSM_OP_DESTROY (ie cleans up) in the DSM_CREATE_NULL_IF_MAXSEGMENTS
case, but in the case where you see "ERROR: too many dynamic shared
memory segments" it completely fails to clean up after itself. I can
reproduce that here. That's a terrible bug, and has been sitting in
the tree for 5 years.

> Unfortunately, the only "solution" we found so far was to increase max connections from 100 to 1000. After that (about 2 months ago I think), the error had gone.

I'll take that as a vote for increasing the number of slots.

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Achilleas Mantzios 2020-01-29 16:12:20 Exclude constraint on ranges : commutative containment : allow only complete containment
Previous Message Thomas Munro 2020-01-29 10:53:24 Re: ERROR: too many dynamic shared memory segments