Re: Experimental patch for inter-page delay in VACUUM

From: "Zeugswetter Andreas SB SD" <ZeugswetterA(at)spardat(dot)at>
To: "Greg Stark" <gsstark(at)mit(dot)edu>, <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Experimental patch for inter-page delay in VACUUM
Date: 2003-11-05 15:47:31
Message-ID: 46C15C39FEB2C44BA555E356FBCD6FA4962059@m0114.s-mxs.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers


> > The only idea I have come up with is to move all buffer write operations
> > into a background writer process, which could easily keep track of
> > every file it's written into since the last checkpoint.
>
> I fear this approach. It seems to limit a lot of design flexibility later. But
> I can't come up with any concrete way it limits things so perhaps that
> instinct is just fud.

A lot of modern disk subsystems can only be saturated with more then one parallel
IO request. So it would at least need a tuneable number of parallel writer processes,
or one writer that uses AIO to dump all outstanding IO requests out at once.
(Optimal would be all, in reality it would need to be batched into groups of
n pages, since most systems have a max aio request queue size, e.g. 8192).

Andreas

Browse pgsql-hackers by date

  From Date Subject
Next Message scott.marlowe 2003-11-05 15:53:51 Re: Hacking PostgreSQL to work in Mac OS X 10.3 (Panther
Previous Message Tom Lane 2003-11-05 15:25:23 Re: \xDD patch for 7.5devel