Re: Performance of COPY for Archive operations

From: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
To: Simon Riggs <simon(at)2ndquadrant(dot)com>
Cc: pgsql-hackers-win32(at)postgresql(dot)org
Subject: Re: Performance of COPY for Archive operations
Date: 2004-09-15 13:55:10
Message-ID: 200409151355.i8FDtAX11579@candle.pha.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers-win32

Simon Riggs wrote:
>
> I've spent a while working with PITR functionality on the Win32 port.
>
> I noticed that *it works*, which is always great, but using a COPY command
> the archival operation was significantly slower than the writing of the
> xlogs themselves.
>
> At one point, I got to being more than 10 xlog files behind with the list
> growing steadily, and took a while to clear the logjam when my test
> workloads completed. Not much point having archiving thats actually slower
> than the writing of xlog....

Why was it slow? 'cp' was slower than the WAL writes? Seems strange to
me. Do we have some sleep loop in there that is causing us to read
that directory too slowly? I didn't think so.

> IIRC the COPY command isn't the best thing to use for bulk-copying on
> Windows, but I can't remember what is better. Anybody?

COPY is the fastest way to get data in and out of PostgreSQL.

--
Bruce Momjian | http://candle.pha.pa.us
pgman(at)candle(dot)pha(dot)pa(dot)us | (610) 359-1001
+ If your life is a hard drive, | 13 Roberts Road
+ Christ can be your backup. | Newtown Square, Pennsylvania 19073

In response to

Responses

Browse pgsql-hackers-win32 by date

  From Date Subject
Next Message Simon Riggs 2004-09-15 20:16:29 Re: Performance of COPY for Archive operations
Previous Message Simon Riggs 2004-09-14 23:54:04 Performance of COPY for Archive operations