Re: Best COPY Performance

From: "Worky Workerson" <worky(dot)workerson(at)gmail(dot)com>
To: "Luke Lonergan" <llonergan(at)greenplum(dot)com>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: Best COPY Performance
Date: 2006-10-27 19:08:32
Message-ID: ce4072df0610271208y4621da42j380d2f92330af213@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

> The read speed on your /data volume is awful to the point where you should
> consider it broken and find a fix. A quick comparison: the same number on a
> 16 drive internal SATA array with 7200 RPM disks gets 950 MB/s read, about
> 25 times faster for about 1/4 the price.

I'm hoping that the poor performance is a result of Oracle doing
random reads while I try and do the sequential read. If not (I'll
test on Monday), I'll start looking other places. Any immediate
suggestions?

> Can you provide about 10 seconds worth of "vmstat 1" while running your COPY
> so we can get a global view of the I/O and CPU?

Here it is, taken from a spot about halfway through a 'cat file |
psql' load, with the "Oracle-is-installed-and-running" caveat:

r b swpd free buff cache si so bi bo in cs us sy id wa
1 0 345732 29328 770980 12947212 0 0 20 16552 1223 3677 12 2 85 1
1 0 345732 29840 770520 12946924 0 0 20 29244 1283 2955 11 2 85 1
1 0 345732 32144 770560 12944436 0 0 12 16436 1204 2936 11 2 86 1
1 0 345732 33744 770464 12942764 0 0 20 16460 1189 2005 10 2 86 1
2 0 345732 32656 770140 12943972 0 0 16 7068 1057 3434 13 2 85 0
1 0 345732 34832 770184 12941820 0 0 20 9368 1170 3120 11 2 86 1
1 0 345732 36528 770228 12939804 0 0 16 32668 1297 2109 11 2 85 1
1 0 345732 29304 770272 12946764 0 0 16 16428 1192 3105 12 2 85 1
1 0 345732 30840 770060 12945480 0 0 20 16456 1196 3151 12 2 84 1
1 0 345732 32760 769972 12943528 0 0 12 16460 1185 3103 11 2 86 1

In response to

Responses

Browse pgsql-performance by date

  From Date Subject
Next Message Gavin Hamill 2006-10-27 22:19:20 Re: VACUUMs take twice as long across all nodes
Previous Message Merlin Moncure 2006-10-27 19:01:51 Re: Best COPY Performance