Re: Out of memory error in 8.1.0 Win32

From: Jim Nasby <jnasby(at)pervasive(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: "Relyea, Mike" <Mike(dot)Relyea(at)xerox(dot)com>, "Todd A(dot) Cook" <tcook(at)blackducksoftware(dot)com>, pgsql-general(at)postgresql(dot)org, "Qingqing Zhou" <zhouqq(at)cs(dot)toronto(dot)edu>
Subject: Re: Out of memory error in 8.1.0 Win32
Date: 2006-06-22 19:34:08
Message-ID: 59FFF499-C18A-4E18-8ABF-8A6B02213DDA@pervasive.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general pgsql-hackers

On Jun 22, 2006, at 2:23 PM, Tom Lane wrote:
> "Relyea, Mike" <Mike(dot)Relyea(at)xerox(dot)com> writes:
>> I've zipped the results of EXPLAIN INSERT INTO "tblSummary" SELECT *
>> FROM "qrySummary"; for my case. It's a zip file that I've renamed to
>> .txt in order to get around the attachment being blocked by
>> certain mail
>> servers.
>
> Egad, what a mess :-(. By my count you have 89 hash joins, 24 sorts,
> and 8 hash aggregations in there. In total these will feel authorized
> to use 121 times work_mem. Since you've got work_mem set to 256 meg,
> an out-of-memory condition doesn't seem that surprising. You need to
> make work_mem drastically smaller for this query. Or else break it
> down
> into multiple steps.

Except won't the sorts pull in all data from their underlying node
before proceeding, which should free the memory from those underlying
nodes? If so, it looks like it's not nearly as bad, only taking about
20x work_mem (which of course still isn't great...)
--
Jim C. Nasby, Sr. Engineering Consultant jnasby(at)pervasive(dot)com
Pervasive Software http://pervasive.com work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Jim Nasby 2006-06-22 19:44:32 Re: How to optimize PostgreSQL database size
Previous Message Tom Lane 2006-06-22 19:23:56 Re: Out of memory error in 8.1.0 Win32

Browse pgsql-hackers by date

  From Date Subject
Next Message Jonah H. Harris 2006-06-22 19:43:33 Re: xlog viewer proposal
Previous Message Tom Lane 2006-06-22 19:23:56 Re: Out of memory error in 8.1.0 Win32