Re: Increase in max_connections

From: Kevin Grittner <kgrittn(at)ymail(dot)com>
To: KarthikAnand Kumar <Karthik(dot)AnandKumar(at)classmates(dot)com>, John R Pierce <pierce(at)hogranch(dot)com>, "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org>
Subject: Re: Increase in max_connections
Date: 2014-04-08 05:34:18
Message-ID: 1396935258.38999.YahooMailBasic@web122304.mail.ne1.yahoo.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

"Anand Kumar, Karthik" <Karthik(dot)AnandKumar(at)classmates(dot)com> wrote:

> We finally made some headway on this - we noticed messages like
> the below

> in /var/log/messages whenever the issue happened:
>
> Mar 26 07:39:58 site-db01b kernel: postmaster: page allocation failure.

> Anyone have any idea why memory was so fragmented, and what
> causes memory to be defragged? Is it something postgres does? Are
> there any kernel specific settings that control it?

While I agree with other replies that you would benefit from
transaction-based connection pooling, there may be another issue at
play here. I can't be sure from evidence so far, but this might be
related to something I've been looking at related to NUMA memory
and how the OS buffers and PostgreSQL shared_buffers interact with
it. Most of the available benefit can be realized without any
change to the PostgreSQL code by using the cpuset features of the
OS. If you want to investigate this, the first thing would be to
get a look at the shape of things. Please post the output of this:

numactl --hardware

The above just reports on the hardware -- it doesn't change
anything.

--
Kevin Grittner
EDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Albe Laurenz 2014-04-08 07:30:56 Re: Initial queries of day slow
Previous Message Robert DiFalco 2014-04-08 04:09:22 Re: Server Timezone