Re: count(*) slow on large tables

From: Jean-Luc Lachance <jllachan(at)nsd(dot)ca>
To: Bruno Wolff III <bruno(at)wolff(dot)to>
Cc: Dror Matalon <dror(at)zapatec(dot)com>, "pgsql-performance(at)postgresql(dot)org" <pgsql-performance(at)postgresql(dot)org>
Subject: Re: count(*) slow on large tables
Date: 2003-10-02 21:29:28
Message-ID: 3F7C98B8.C892D0E5@nsd.ca
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-performance

That's one of the draw back of MVCC.
I once suggested that the transaction number and other house keeping
info be included in the index, but was told to forget it...
It would solve once and for all the issue of seq_scan vs index_scan.
It would simplify the aggregate problem.

Bruno Wolff III wrote:
>
> On Thu, Oct 02, 2003 at 12:15:47 -0700,
> Dror Matalon <dror(at)zapatec(dot)com> wrote:
> > Hi,
> >
> > I have a somewhat large table, 3 million rows, 1 Gig on disk, and growing. Doing a
> > count(*) takes around 40 seconds.
> >
> > Looks like the count(*) fetches the table from disk and goes through it.
> > Made me wonder, why the optimizer doesn't just choose the smallest index
> > which in my case is around 60 Megs and goes through it, which it could
> > do in a fraction of the time.
>
> Because it can't tell from the index if a tuple is visible to the current
> transaction and would still have to hit the table to check this. So that
> performance would be a lot worse instead of better.
>
> ---------------------------(end of broadcast)---------------------------
> TIP 5: Have you checked our extensive FAQ?
>
> http://www.postgresql.org/docs/faqs/FAQ.html

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Christopher Browne 2003-10-02 21:57:30 Re: count(*) slow on large tables
Previous Message Database 2003-10-02 21:10:42 US-CA DATABASE INTERNALS

Browse pgsql-performance by date

  From Date Subject
Next Message Christopher Browne 2003-10-02 21:57:30 Re: count(*) slow on large tables
Previous Message Vivek Khera 2003-10-02 20:16:58 Re: inferior SCSI performance