Re: Parallel Select query performance and shared buffers

From: Claudio Freire <klaussfreire(at)gmail(dot)com>
To: Metin Doslu <metin(at)citusdata(dot)com>
Cc: postgres performance list <pgsql-performance(at)postgresql(dot)org>
Subject: Re: Parallel Select query performance and shared buffers
Date: 2013-12-03 15:56:11
Message-ID: CAGTBQpZtU0yo=eV7Xxw6gCvMoMkMZ-qFi+2BxgSisdzrn44c3Q@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-performance

On Tue, Dec 3, 2013 at 10:49 AM, Metin Doslu <metin(at)citusdata(dot)com> wrote:
> We have several independent tables on a multi-core machine serving Select
> queries. These tables fit into memory; and each Select queries goes over one
> table's pages sequentially. In this experiment, there are no indexes or
> table joins.
>
> When we send concurrent Select queries to these tables, query performance
> doesn't scale out with the number of CPU cores. We find that complex Select
> queries scale out better than simpler ones. We also find that increasing the
> block size from 8 KB to 32 KB, or increasing shared_buffers to include the
> working set mitigates the problem to some extent.
>
> For our experiments, we chose an 8-core machine with 68 GB of memory from
> Amazon's EC2 service. We installed PostgreSQL 9.3.1 on the instance, and set
> shared_buffers to 4 GB.

If you are certain your tables fit in RAM, you may want to disable
synchronized sequential scans, as they will create contention between
the threads.

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Bruce Momjian 2013-12-03 16:12:13 Re: pg_upgrade segfaults when given an invalid PGSERVICE value
Previous Message Antonin Houska 2013-12-03 15:48:31 Review: ECPG infrastructure changes part 1, was: Re: ECPG fixes

Browse pgsql-performance by date

  From Date Subject
Next Message Metin Doslu 2013-12-03 16:24:55 Re: Parallel Select query performance and shared buffers
Previous Message Alvaro Herrera 2013-12-03 13:53:23 Re: Parallel Select query performance and shared buffers