Re: Questions for the COPY expert

Dawn,
I'm not that much of an expert :-)
I am forwarding your message to the "pgsql-general"
mailing list, where the real experts can be found.
I'm sure some of those can provide enlightenment.
I suspect that the limitations you observe have more
to do with the performance of networks and operating
systems than of COPY itself.
Regards

--- Dawn Vu <dvu(at)satx(dot)rr(dot)com> wrote:
> Hi Jeff,
>
> Read your usingcopy.php, it looks like you have a
> lot of
> experience with it. Wonder if you can answer the
> following
> questions for me:
>
> 1. COPY [tablename] TO '/../datafile' seems to have
> a
> limitation when datafile is bigger than 2G. Is
> this a
> postgresql limitation? I can get around it but
> want to
> know if there is a way to let the file grow as
> large as
> OS filesize limit. Any idea?
>
> 2. I use COPY to transfer data from one machine to
> another
> over the network using stdin and stdout without
> having
> to write data to intermediate file. Does COPY
> read and
> load all data into memory at one time or does it
> do a
> chunk at a time and then pipeline data over the
> network?
> The reason why I ask this question is because I
> was
> transferring 41M+ records and one hour into it,
> the process
> got a calloc error. What seems to be the
> limitation here?
> What memory aspects do I need to examine? More
> DB buffers? Configuration setting(s)?
>
> -DV
>

__________________________________________________
Do You Yahoo!?
Send FREE video emails in Yahoo! Mail!
http://promo.yahoo.com/videomail/