Re: Connection Pooling

From: Brandon Phelps <bphelps(at)gls(dot)com>
To: Adam Cornett <adam(dot)cornett(at)gmail(dot)com>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: Connection Pooling
Date: 2011-10-07 17:51:13
Message-ID: 4E8F3C11.1060801@gls.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

So we decided to go with pgpool-II. The documentation is a little lacking for pgpool-II so I have one question:

How are connections handled once the default levels are reached? Here are my pgpool settings:

num_init_children = 32
max_pool = 4

This creates 32 child processes when we start pgpool which I understand. Each time I browse to a page from our web app and do a netstat -an on the web server (running pgpool) I see an additional connection to the database server, which looks good. I assume that once 32 connections are opened at once then pgpool will start re-using them, based on the num_init_children * max_pool... But since 32 * 4 = 128, what will happen on the 129th connection? Will a new child get created, allowing for 4 more connections (1 * max_pool), or will that connection be denied?

Thanks in advance,
Brandon

On 10/06/2011 04:07 PM, Adam Cornett wrote:
>
> On Thu, Oct 6, 2011 at 3:57 PM, Brandon Phelps <bphelps(at)gls(dot)com <mailto:bphelps(at)gls(dot)com>> wrote:
>
> Can anyone recommend a good solution for connection pooling? Here is our setup:
>
> 2 PostgreSQL 9.1 servers (1 master, 1 hot standby).
> 1 Apache 2.2.17
>
> We have a pretty extensive web application running on the apache server that talks to both of the database servers. Updates and small tasks (simple selects, etc) are directed to the master DB server while large reports that can take a while to run are directed to the hot standby, as not to affect performance of the master.
>
> Each page of the web app generally make a single connection to the database with the exception being the complicated reports which first make a connection to the master, verify that the user is allowed to access the page in question, close that connection, then open another connection to the hot standby for the report itself.
>
> One connection per page is not all that bad however the end users who make use of the web app are quite familiar with it and often fly through the pages very fast. We would like to implement some type of connection pooling so that these database connections (from web server to the DB servers) do not have to get created and torn down constantly.
>
> I have checked out the pg_pool website however was not very impressed with the documentation provided. Is pg_pool going to be our best solution or is there something better? Any advice would be appreciated.
>
> Thanks,
> Brandon
>
> --
> Sent via pgsql-general mailing list (pgsql-general(at)postgresql(dot)org <mailto:pgsql-general(at)postgresql(dot)org>)
> To make changes to your subscription:
> http://www.postgresql.org/__mailpref/pgsql-general <http://www.postgresql.org/mailpref/pgsql-general>
>
>
>
> If you want to do load balancing between your database servers (split reads between the master and slave) or have auto failover then Pgpool-II is going to be your best bet. I just did a similar setup and the documentation isn't the best, but some googling turned up a few guides that I was able to jump between to get it setup and going.
>
> If you just want all of the DB traffic to go to the master (and deal with failover on your own) you can use pgbouncer, which is much simpler, but also less feature-rich.
>
> Adam

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Guillaume Lelarge 2011-10-07 18:05:38 Re: Connection Pooling
Previous Message Joe Conway 2011-10-07 17:21:09 Call For Talks: PGDay.SoCal @ SCALE 10X