| From: | Sergey Koposov <Sergey(dot)Koposov(at)ed(dot)ac(dot)uk> |
|---|---|
| To: | "lepihov(at)gmail(dot)com" <lepihov(at)gmail(dot)com>, "tgl(at)sss(dot)pgh(dot)pa(dot)us" <tgl(at)sss(dot)pgh(dot)pa(dot)us> |
| Cc: | "melanieplageman(at)gmail(dot)com" <melanieplageman(at)gmail(dot)com>, "tomas(at)vondra(dot)me" <tomas(at)vondra(dot)me>, "pgsql-bugs(at)lists(dot)postgresql(dot)org" <pgsql-bugs(at)lists(dot)postgresql(dot)org>, "a(dot)rybakina(at)postgrespro(dot)ru" <a(dot)rybakina(at)postgrespro(dot)ru> |
| Subject: | Re: BUG #18909: Query creates millions of temporary files and stalls |
| Date: | 2025-05-04 12:35:08 |
| Message-ID: | 59090d89e656fde93b539e95a23a740d532d4f88.camel@ed.ac.uk |
| Views: | Whole Thread | Raw Message | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-bugs |
Thanks,
I don't have a strong opinion on how this is fixed, but I personally think that
is a bug that needs addressing in back branches.
I think I remember hitting OOMs in similar situations with hashjoins in the past
and I just disabled them.
But I'd certainly argue the situation here is more severe with 12 million temp files (possibly more).
Even the cancelling of the query doesn't quite work well,
because the deletion of temp files is not fast enough in the cancellation.
Only the restarting of the server does delete tmp files fast enough (takes a few min still).
And apparently even ls can't quite deal with 12 millions files in a folder.
Sergey
The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. Is e buidheann carthannais a th’ ann an Oilthigh Dhùn Èideann, clàraichte an Alba, àireamh clàraidh SC005336.
| From | Date | Subject | |
|---|---|---|---|
| Next Message | PG Bug reporting form | 2025-05-05 08:00:12 | BUG #18910: DEREF_OF_NULL.RET Pointer, returned from function 'palloc0' at simplehash.h:1080, may be NULL |
| Previous Message | Andrei Lepikhov | 2025-05-04 12:13:08 | Re: BUG #18909: Query creates millions of temporary files and stalls |