Re: [HACKERS] Performance while loading data and indexing

From: "Shridhar Daithankar" <shridhar_daithankar(at)persistent(dot)co(dot)in>
To: pgsql-hackers(at)postgresql(dot)org, pgsql-general(at)postgresql(dot)org
Subject: Re: [HACKERS] Performance while loading data and indexing
Date: 2002-09-26 08:54:02
Message-ID: 3D931882.31859.134B9E4C@localhost
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-performance

On 26 Sep 2002 at 14:05, Shridhar Daithankar wrote:
> Some time back I posted a query to build a site with 150GB of database. In last
> couple of weeks, lots of things were tested at my place and there are some
> results and again some concerns.

> 2) Creating index takes huge amount of time.
> Load time: 14581 sec/~8600 rows persec/~ an MB of data per sec.
> Create unique composite index on 2 char and a timestamp field: 25226 sec.
> Database size on disk: 26GB
> Select query: 1.5 sec. for approx. 150 rows.

> 2) Sort mem.=12K i.e. 94MB, sounds good enough to me. Does this need further
> addition to improve create index performance?

Just a thought. If I sort the table before making an index, would it be faster
than creating index on raw table? And/or if at all, how do I sort the table
without duplicating it?

Just a wild thought..

Bye
Shridhar

--
linux: the choice of a GNU generation(ksh(at)cis(dot)ufl(dot)edu put this on Tshirts in
'93)

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Martijn van Oosterhout 2002-09-26 09:05:19 Re: Performance while loading data and indexing
Previous Message Shridhar Daithankar 2002-09-26 08:35:44 Performance while loading data and indexing

Browse pgsql-hackers by date

  From Date Subject
Next Message Martijn van Oosterhout 2002-09-26 09:05:19 Re: Performance while loading data and indexing
Previous Message Hannu Krosing 2002-09-26 08:52:48 Re: unicode

Browse pgsql-performance by date

  From Date Subject
Next Message Martijn van Oosterhout 2002-09-26 09:05:19 Re: Performance while loading data and indexing
Previous Message Shridhar Daithankar 2002-09-26 08:35:44 Performance while loading data and indexing