Re: BUG #13493: pl/pgsql doesn't scale with cpus (PG9.3, 9.4)

From: Andres Freund <andres(at)anarazel(dot)de>
To: grb(at)skogoglandskap(dot)no,pgsql-bugs(at)postgresql(dot)org
Subject: Re: BUG #13493: pl/pgsql doesn't scale with cpus (PG9.3, 9.4)
Date: 2015-07-08 00:16:47
Message-ID: 982A22C7-1695-4115-9197-A4D0D94C0CF4@anarazel.de
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-bugs

On July 8, 2015 12:27:39 AM GMT+02:00, grb(at)skogoglandskap(dot)no wrote:
>The following bug has been logged on the website:
>
>Bug reference: 13493
>Logged by: Graeme Bell
>Email address: grb(at)skogoglandskap(dot)no
>PostgreSQL version: 9.3.9
>Operating system: Linux
>Description:
>
>Hi,
>
>pl/pgsql doesn't scale properly on postgres 9.3/9.4 with multiple
>processors
>beyond 2-3 processors for me, regardless of the machine I use or the
>benchmark/project.
>
>I discovered this painfully during a project here where we were running
>a
>small 'forest simulator' in pl/pgsql on different datasets
>simultaneously.
>
>To highlight the problem, I've provided a benchmark that demonstrates
>two
>problems (on my machines).
>
>1. The first problem is scaling when you have lots of pl/pgsql code
>running
>and doing real work.
>
>2. The second problem is scaling when you have a table column as an
>input
>parameter.
>
>The benchmark results & source code are here:
>
>https://github.com/gbb/ppppt
>
>Another set of benchmarks showing the same phenomena on PG9.3 and PG9.4
>can
>be found here, under 'BENCHMARKS.md'
>
>https://github.com/gbb/par_psql
>
>I would be grateful if others could run the benchmark and
>confirm/disconfirm
>the result.
>
>If confirmed, the result may be of special interest to e.g. the postgis
>&
>pgrouting communities.
>
>This result is from a 16-core machine with 128GB of memory and a lot of
>random I/O capacity (there's no writing involved though other than a
>bit of
>WAL, and not much data, so this shouldn't matter).

That sounds odd.. Could you provide perf profiles with this running? Also have you reproduced on 9.5?

Do you have transparent huge pages disabled?

---
Please excuse brevity and formatting - I am writing this on my mobile phone.

In response to

Responses

Browse pgsql-bugs by date

  From Date Subject
Next Message John R Pierce 2015-07-08 01:12:52 Re: BUG #12824: Error during uninstall‏
Previous Message Raul Cesar 2015-07-07 23:45:42 BUG #12824: Error during uninstall‏