Re: Parallel Seq Scan vs kernel read ahead

From: Thomas Munro <thomas(dot)munro(at)gmail(dot)com>
To: Amit Kapila <amit(dot)kapila16(at)gmail(dot)com>
Cc: pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Parallel Seq Scan vs kernel read ahead
Date: 2020-05-20 03:08:24
Message-ID: CA+hUKGLD7FeyDkDbCU3=kkt30QdBuARv529PM=E5NsfGKr18Ug@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Wed, May 20, 2020 at 2:23 PM Amit Kapila <amit(dot)kapila16(at)gmail(dot)com> wrote:
> Good experiment. IIRC, we have discussed a similar idea during the
> development of this feature but we haven't seen any better results by
> allocating in ranges on the systems we have tried. So, we want with
> the current approach which is more granular and seems to allow better
> parallelism. I feel we need to ensure that we don't regress
> parallelism in existing cases, otherwise, the idea sounds promising to
> me.

Yeah, Linux seems to do pretty well at least with smallish numbers of
workers, and when you use large numbers you can probably tune your way
out of the problem. ZFS seems to do fine. I wonder how well the
other OSes cope.

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Justin Pryzby 2020-05-20 03:26:57 Re: Warn when parallel restoring a custom dump without data offsets
Previous Message Noah Misch 2020-05-20 03:05:00 Re: Problem with pg_atomic_compare_exchange_u64 at 32-bit platformwd