Re: PLPythonU & Out of Memory - Importing Query

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Jon Clements <jon(dot)clements(at)trgstrata(dot)co(dot)uk>
Cc: "pgsql-interfaces(at)postgresql(dot)org" <pgsql-interfaces(at)postgresql(dot)org>
Subject: Re: PLPythonU & Out of Memory - Importing Query
Date: 2005-11-09 16:52:35
Message-ID: 16566.1131555155@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-interfaces

Jon Clements <jon(dot)clements(at)trgstrata(dot)co(dot)uk> writes:
> I am currently experimenting using plpythonu with postgresql 8.0 for
> Win32. It's basically a quick script that imports data from CSV files,
> but does some quite complicated data lookups and selections. The area
> in which I'm somewhat confunded is memory usage. The process
> successfully runs, but keeps climbing in memory usage relentlessly,
> successfully importing about 200k records, before the memory usage of
> postgres soars to 2gb and of course, shortly after that, grinds to a
> halt with a "Out of Memory" error.

You may have stumbled across a memory leak in plpythonu, but there's
not enough info here for anyone to investigate. Can you put together
a self-contained test case for people to try?

regards, tom lane

In response to

Browse pgsql-interfaces by date

  From Date Subject
Next Message Michael Fuhr 2005-11-09 18:05:05 Re: PLPythonU & Out of Memory - Importing Query
Previous Message Jon Clements 2005-11-08 14:21:01 PLPythonU & Out of Memory - Importing Query