From: | Ron Johnson <ron(dot)l(dot)johnson(at)cox(dot)net> |
---|---|
To: | PgSQL Performance ML <pgsql-performance(at)postgresql(dot)org> |
Subject: | Re: EXTERNAL storage and substring on long strings |
Date: | 2003-07-31 21:21:38 |
Message-ID: | 1059686498.7505.558.camel@haggis |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-performance pgsql-sql |
On Thu, 2003-07-31 at 15:31, Joe Conway wrote:
> Scott Cain wrote:
> > Index Scan using feature_pkey on feature (cost=0.00..3.01 rows=1
> > width=153) (actual time=954.13..954.14 rows=1 loops=1)
> > Index Cond: (feature_id = 1)
> > Total runtime: 954.26 msec
> > (3 rows)
> >
> > Whoa! That's not what I expected, the time to do the query got more
> > that twice as long. So I think, maybe it was just an unlucky section,
> > and overall performance will be much better. So I write a perl script
> > to do substring queries over all of my chromosomes at various positions
> > and lengths (20,000 queries total). For comparison, I also ran the same
> > script, extracting the chromosomes via sql and doing the substring in
> > perl. Here's what happened:
>
> Hmmm, what happens if you compare with a shorter substring, e.g.:
>
> explain analyze select substring(residues from 1000000 for 2000)
> from feature where feature_id=1;
>
> I'm just guessing, but it might be that the extra I/O time to read 20K
> of uncompressed text versus the smaller compressed text is enough to
> swamp the time saved from not needing to uncompress.
Are you asking, "Can his CPU decompress faster than his disks can
read?"
--
+-----------------------------------------------------------------+
| Ron Johnson, Jr. Home: ron(dot)l(dot)johnson(at)cox(dot)net |
| Jefferson, LA USA |
| |
| "I'm not a vegetarian because I love animals, I'm a vegetarian |
| because I hate vegetables!" |
| unknown |
+-----------------------------------------------------------------+
From | Date | Subject | |
---|---|---|---|
Next Message | Manfred Koizar | 2003-07-31 21:32:04 | Re: Help on my database performance |
Previous Message | Scott Cain | 2003-07-31 21:11:15 | Re: EXTERNAL storage and substring on long strings |
From | Date | Subject | |
---|---|---|---|
Next Message | Alexander M. Pravking | 2003-07-31 22:32:33 | Problem with looping on a table function result |
Previous Message | Scott Cain | 2003-07-31 21:11:15 | Re: EXTERNAL storage and substring on long strings |