Skip site navigation (1) Skip section navigation (2)

Re: [HACKERS] Performance while loading data and indexing

From: "Shridhar Daithankar" <shridhar_daithankar(at)persistent(dot)co(dot)in>
To: <pgsql-hackers(at)postgresql(dot)org>, <pgsql-general(at)postgresql(dot)org>
Subject: Re: [HACKERS] Performance while loading data and indexing
Date: 2002-09-26 09:31:35
Message-ID: 3D93214F.16112.136DFDBC@localhost (view raw or flat)
Thread:
Lists: pgsql-generalpgsql-hackers
On 26 Sep 2002 at 11:17, Mario Weilguni wrote:

> On 26 Sep 2002 at 14:05, Shridhar Daithankar wrote:
> > Some time back I posted a query to build a site with 150GB of database. In
> last 
> > couple of weeks, lots of things were tested at my place and there are some 
> > results and again some concerns. 
> 
> > 2) Creating index takes huge amount of time.
> > Load time: 14581 sec/~8600 rows persec/~ an MB of data per sec.
> > Create unique composite index on 2 char and a timestamp field:  25226 sec.
> > Database size on disk: 26GB
> > Select query: 1.5 sec. for approx. 150 rows.
> 
> I never tried 150GB of data, but 10GB of data, and this worked fine for me. 
> Maybe it will help if you post your table schema, including which indexes you
> use, and the average size of one tuple.

Well the test runs were for 10GB of data. Schema is attached. Read in fixed 
fonts..Last nullable fields are dummies but may be used in fututre and varchars 
are not acceptable(Not my requirement). Tuple size is around 100 bytes..

The index creation query was

CREATE INDEX index1 ON tablename (esn,min,datetime);

What if I put datetime ahead? It's likely the the datetime field will have high 
degree of locality being log data..

Bye
 Shridhar

--
brain, v: [as in "to brain"]	To rebuke bluntly, but not pointedly; to dispel a 
source	of error in an opponent.		-- Ambrose Bierce, "The Devil's Dictionary"


In response to

Responses

pgsql-hackers by date

Next:From: Shridhar DaithankarDate: 2002-09-26 09:35:40
Subject: Re: Performance while loading data and indexing
Previous:From: Mario WeilguniDate: 2002-09-26 09:17:50
Subject: Re: Performance while loading data and indexing

pgsql-general by date

Next:From: Shridhar DaithankarDate: 2002-09-26 09:35:40
Subject: Re: Performance while loading data and indexing
Previous:From: Mario WeilguniDate: 2002-09-26 09:17:50
Subject: Re: Performance while loading data and indexing

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group