Re: MySQL million tables

From: Robert Treat <xzilla(at)users(dot)sourceforge(dot)net>
To: pgsql-advocacy(at)postgresql(dot)org
Cc: Jim Nasby <jim(at)nasby(dot)net>, Christopher Browne <cbbrowne(at)acm(dot)org>
Subject: Re: MySQL million tables
Date: 2006-03-11 01:34:45
Message-ID: 200603102034.45797.xzilla@users.sourceforge.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-advocacy

I can't believe the mysql guys found this to be non-trivial.

http://bitbybit.dk/carsten/blog/?p=83
http://www.flamingspork.com/blog/2006/03/09/a-million-tables/

On Friday 10 March 2006 19:17, Jim Nasby wrote:
> I can't believe y'all are burning cycles on this. :P
>
> On Mar 9, 2006, at 8:04 AM, Christopher Browne wrote:
> > A long time ago, in a galaxy far, far away, greg(at)turnstep(dot)com
> >
> > ("Greg Sabino Mullane") wrote:
> >> I kicked this off last night before bed. It ran much quicker than
> >> I thought, due to that 27 hour estimate.
> >>
> >> Total time: 23 minutes 29 seconds :)
> >
> > I'm jealous. I've got the very same thing running on some Supposedly
> > Pretty Fast Hardware, and it's cruising towards 31 minutes plus a few
> > seconds.
> >
> > While it's running, the time estimate is...
> >
> > select (now() - '2006-03-09 13:47:49') * 1000000 / (select count(*)
> > from pg_class where relkind='r' and relname ~ 'foo');
> >
> > That pretty quickly converged to 31:0?...
> >
> >> Maybe I'll see just how far PG *can* go next. Time to make a
> >> PlanetPG post, at any rate.
> >
> > Another interesting approach to it would be to break this into several
> > streams.
> >
> > There ought to be some parallelism to be gained, on systems with
> > multiple disks and CPUs, by having 1..100000 go in parallel to 100001
> > to 200000, and so forth, for (oh, say) 10 streams. Perhaps it's
> > irrelevant parallelism; knowing that it helps/hurts would be nice...
> > --
> > (format nil "~S(at)~S" "cbbrowne" "cbbrowne.com")
> > http://linuxfinances.info/info/rdbms.html
> > Where do you want to Tell Microsoft To Go Today?
> >
> > ---------------------------(end of
> > broadcast)---------------------------
> > TIP 4: Have you searched our list archives?
> >
> > http://archives.postgresql.org
>
> --
> Jim C. Nasby, Database Architect decibel(at)decibel(dot)org
> Give your computer some brain candy! www.distributed.net Team #1828
>
> Windows: "Where do you want to go today?"
> Linux: "Where do you want to go tomorrow?"
> FreeBSD: "Are you guys coming, or what?"
>
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 3: Have you checked our extensive FAQ?
>
> http://www.postgresql.org/docs/faq

--
Robert Treat
Build A Brighter Lamp :: Linux Apache {middleware} PostgreSQL

In response to

Responses

Browse pgsql-advocacy by date

  From Date Subject
Next Message Josh Berkus 2006-03-11 18:54:52 Where to put the new donations page?
Previous Message Joshua D. Drake 2006-03-11 01:10:11 Re: MySQL million tables