From: | Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us> |
---|---|
To: | Hans-Jürgen Schönig <hs(at)cybertec(dot)at> |
Cc: | Martin Rusoff <mrusoff(at)columbus(dot)rr(dot)com>, pgsql-hackers(at)postgresql(dot)org, eg(at)cybertec(dot)at |
Subject: | Re: Parallel postgresql |
Date: | 2003-10-09 13:31:40 |
Message-ID: | 200310091331.h99DVeU20956@candle.pha.pa.us |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
Hans-Jrgen Schnig wrote:
> >>Stage 2) Parallel Postgres Servers, with the postmaster spawning off the
> >>server on a different node (possibly borrowing some code from GNU queue)
> >>and doing any buffer twiddling with RPC for that connection, The client
> >>connection would still be through the proxy on the postmaster node? (kind
> >>of like MOSIX)
> >
> >
> > One idea would be to throw parts of the executor (like a table sort) to
> > different machines or to different processors on the same machine,
> > perhaps via dblink. You could use threads to send several requests and
> > wait for their results.
> >
> > Threading the entire backend would be hard, but we could thread some
> > parts of it by having slave backends doing some of the work in parallel.
>
>
>
> This would be nice - especially for huge queries needed in warehouses.
> Maybe it could even make sense to do things in par. if there is just one
> machine (e.g. computing a function while a sort process is waiting for
> I/O or so).
>
> Which operations can run in par.? What do you think?
> I guess implementing something like that means 20 years more work on the
> planner ...
My guess is that we would have to have the user tell us which things
they want in parallel somehow. Of course, the child backend has to
parse/plan/execute the query, and pass the data up to the parent, so you
have to pick things where this overhead is acceptable.
--
Bruce Momjian | http://candle.pha.pa.us
pgman(at)candle(dot)pha(dot)pa(dot)us | (610) 359-1001
+ If your life is a hard drive, | 13 Roberts Road
+ Christ can be your backup. | Newtown Square, Pennsylvania 19073
From | Date | Subject | |
---|---|---|---|
Next Message | Bruce Momjian | 2003-10-09 13:35:45 | Re: pgsql-server/src/template bsdi freebsd netbsd ... |
Previous Message | Dave Cramer | 2003-10-09 12:32:10 | Re: Using JDBC and libpq in the same process |