Re: [HACKERS] Performance while loading data and indexing

From: Denis Perchine <dyp(at)perchine(dot)com>
To: shridhar_daithankar(at)persistent(dot)co(dot)in, pgsql-hackers(at)postgresql(dot)org, pgsql-general(at)postgresql(dot)org
Subject: Re: [HACKERS] Performance while loading data and indexing
Date: 2002-09-26 15:04:41
Message-ID: 200209262204.41638.dyp@perchine.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers pgsql-performance

On Thursday 26 September 2002 21:52, Shridhar Daithankar wrote:

> I might have found the bottleneck, although by accident. Mysql was running
> out of space while creating index. So my friend shut down mysql and tried
> to move things by hand to create links. He noticed that even things like cp
> were terribly slow and it hit us.. May be the culprit is the file system.
> Ext3 in this case.
>
> My friend argues for ext2 to eliminate journalling overhead but I favour
> reiserfs personally having used it in pgbench with 10M rows on paltry 20GB
> IDE disk for 25 tps..
>
> We will be attempting raiserfs and/or XFS if required. I know how much
> speed difference exists between resiserfs and ext2. Would not be surprised
> if everythng just starts screaming in one go..

As it was found by someone before any non-journaling FS is faster than
journaling one. This due to double work done by FS and database.

Try it on ext2 and compare.

--
Denis

In response to

Browse pgsql-general by date

  From Date Subject
Next Message Tom Lane 2002-09-26 15:07:58 Re: Unixtime (epoch) into timestamp?
Previous Message Shridhar Daithankar 2002-09-26 14:58:11 Re: [HACKERS] Performance while loading data and indexing

Browse pgsql-hackers by date

  From Date Subject
Next Message Justin Clift 2002-09-26 15:12:49 Re: Performance while loading data and indexing
Previous Message Shridhar Daithankar 2002-09-26 14:58:11 Re: [HACKERS] Performance while loading data and indexing

Browse pgsql-performance by date

  From Date Subject
Next Message Justin Clift 2002-09-26 15:12:49 Re: Performance while loading data and indexing
Previous Message Shridhar Daithankar 2002-09-26 14:58:11 Re: [HACKERS] Performance while loading data and indexing