Skip site navigation (1) Skip section navigation (2)

Re: Utilizing multiple disks

From: Steve <steve(at)hotmail(dot)com>
To: pgsql-admin(at)postgresql(dot)org
Subject: Re: Utilizing multiple disks
Date: 2004-07-26 01:46:22
Message-ID: ce1nt2$1q9f$1@news.hub.org (view raw or flat)
Thread:
Lists: pgsql-admin
Gaetano,

Thanks for your reply.

Gaetano Mendola wrote:

> Are you performing queries using the like operator? If yes did you define
> an index on it using the right operator class ?

Yes I do use the like operator to perform queries on a few 'varchar' and 
'text' fields. I have indexed almost every column in the table (because 
the client application allows complex searches on multiple columns and 
each column has an equal chance of being used in the 'WHERE' condition)

> Are you performing queries on a calculated field ? If yes then you need
> to construct a sort of materialized view.

Hmm not sure what you mean by a calculated field. Since I'm not sure 
what it means, I'm probably not using it. I'm definitely not running any 
functions on columns to get an accumulated result back etc.

> If you are on Linux did you mounted your data partition with the option
> noatime ?

Yes I'm on linux and am using the ext3 filesystem. I am just about to 
mount the data partition with the noatime option. Docos do say that the 
speed increases considerably. I'll give it a shot but I'm still very 
interested in utilizing the extra three SCSI disks I have at my disposal.

> Usualy split your tables on multiple disk is the last optimization step,
> are you sure did you already reach the bootleneck of your sistem ?

Actually IO is currently the only bottleneck for my system. I was using 
a single drive and had optimized it as much as I could (used indexes, 
partitioned tables horizontally on old dates etc) but I thought it would 
help me on the long run if I could store the actualy physical 'table 
files' on separate disks (as the rule says: more spindles == parallel 
IO). My current database basically has quite a few tables, out of which 
only four are the 'largest'. Each table is completely independant (I 
don't have a relational database setup because I didn't need it in this 
case) and is accessed simultaneously by around 10 users at one time. 
Each table also has almost all of its columns indexed. some of these 
columns are of type 'varchar', 'text' or 'double'. I am aware that the 
'text' fields are stored internally in a separate table. Does this 
complicate things? Is it as easy as moving the files (I don't know which 
ones though - please help me out here) to an independant drive and then 
creating symbolic links to it to the '/opt/postgresql/data/...' 
directory? How do I achieve this without losing any of the data.

Database integrity is of utmost importance and so is speed. I know there 
are tradeoffs but I really do think that moving the data to a separate 
disk will help. Can you please tell me how to set this up? Thanks a lot!

Steve


In response to

Responses

pgsql-admin by date

Next:From: Tom LaneDate: 2004-07-26 05:24:04
Subject: Re: could not fork new process for connection: Cannot allocate memory
Previous:From: Gaetano MendolaDate: 2004-07-25 23:47:45
Subject: Re: Can't increase max connections

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group