Skip site navigation (1) Skip section navigation (2)

Re: Performance of COPY for Archive operations

From: Bruce Momjian <pgman(at)candle(dot)pha(dot)pa(dot)us>
To: Simon Riggs <simon(at)2ndquadrant(dot)com>
Cc: pgsql-hackers-win32(at)postgresql(dot)org
Subject: Re: Performance of COPY for Archive operations
Date: 2004-09-15 13:55:10
Message-ID: 200409151355.i8FDtAX11579@candle.pha.pa.us (view raw or flat)
Thread:
Lists: pgsql-hackers-win32
Simon Riggs wrote:
> 
> I've spent a while working with PITR functionality on the Win32 port.
> 
> I noticed that *it works*, which is always great, but using a COPY command
> the archival operation was significantly slower than the writing of the
> xlogs themselves.
> 
> At one point, I got to being more than 10 xlog files behind with the list
> growing steadily, and took a while to clear the logjam when my test
> workloads completed. Not much point having archiving thats actually slower
> than the writing of xlog....

Why was it slow?  'cp' was slower than the WAL writes?  Seems strange to
me.   Do we have some sleep loop in there that is causing us to read
that directory too slowly?  I didn't think so.

> IIRC the COPY command isn't the best thing to use for bulk-copying on
> Windows, but I can't remember what is better. Anybody?

COPY is the fastest way to get data in and out of PostgreSQL.

-- 
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman(at)candle(dot)pha(dot)pa(dot)us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073

In response to

Responses

pgsql-hackers-win32 by date

Next:From: Simon RiggsDate: 2004-09-15 20:16:29
Subject: Re: Performance of COPY for Archive operations
Previous:From: Simon RiggsDate: 2004-09-14 23:54:04
Subject: Performance of COPY for Archive operations

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group