Skip site navigation (1) Skip section navigation (2)

Re: PostgreSQL under BSD/OS

From: Greg Black <gjb(at)acm(dot)org>
To: Bruce Momjian <maillist(at)candle(dot)pha(dot)pa(dot)us>
Cc: hackers(at)postgreSQL(dot)org (PostgreSQL-development)
Subject: Re: PostgreSQL under BSD/OS
Date: 1998-08-26 07:58:01
Message-ID: 19980826075802.13774.qmail@alice.gba.oz.au (view raw or flat)
Thread:
Lists: pgsql-hackers
> > (relatively minor) bug in psql -- it fails to close files it reads for a
> > COPY command, meaning it can keep a multi-megabyte file open for days.
> > The workaround is to do a new connect to the same database after the
> > COPY, at which point the data file gets closed.  Maybe you can get that
> > fixed in a future release.
> 
> This is the first I have heard of this.  The file commands/copy.c does
> use a file descriptor cache, but that is really just used for allowing
> more file opens that the OS permits.  Actual opens and closes are
> happending.
> 
> I assume the files you are talking about are the database table files. 
> Yes, they stay open because the backend may want to use them someday.

No, that's not what I meant.  Perhaps my attempt to be concise made my
explanation unclear.  Here's a more complete explanation of the problem.

I am planning to use PostgreSQL to manage some databases that have been
handled by completely different software up until now.  Therefore, there
is a lot of data to be extracted from the old databases and loaded into
PostgreSQL databases.

I do this with C programs which output two principal files: the first is
an input file for psql which contains various commands to create tables
and indexes, etc.; the second, much larger, file contains the actual
data in a suitable format.

The first file is input to psql by the \i command.  The last thing in
that first file is a SQL COPY command which copies the data from the big
data file into the appropriate table.  After an hour or so, the data
input completes and I can issue psql commands to play with the data to
see if it's the way I expect.  At this point, psql ought to close the
data file that it copied the data from so that I can delete it.  As
things stand, I have three copies of all the data -- the original
database (which I can't remove until this process is completed in a few
weeks); the temporary data file, used as input to psql (which I want to
delete since it can be recreated if needed); and the PostgreSQL database
which I have just created.

But if I remove the temporary file, I don't get any disk space back
because psql still has it open.  If I \connect to the same database,
then psql closes the input file, but my contention is that I should not
have to do that.  I hope this explanation is clear.

-- 
Greg Black <gjb(at)acm(dot)org>



In response to

Responses

pgsql-hackers by date

Next:From: Jan WieckDate: 1998-08-26 09:23:09
Subject: TODO (was: Re: [HACKERS] Problem with parser)
Previous:From: Andreas ZeugswetterDate: 1998-08-26 07:05:14
Subject: AW: [HACKERS] Massimo patches

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group