| From: | Peter Gram <peter(dot)m(dot)gram(at)gmail(dot)com> |
|---|---|
| To: | Ramakrishna Reddy Nandyala <rkreddy(dot)n(at)gmail(dot)com> |
| Cc: | pgsql-admin(at)lists(dot)postgresql(dot)org |
| Subject: | Re: Clearing of temp files is very slow in pg16 |
| Date: | 2025-08-04 19:23:02 |
| Message-ID: | CAJ=80GX2s+Oiw+CzFMZg+3TitJQhFw=02pMvBZOmGFq+5iZKOw@mail.gmail.com |
| Views: | Whole Thread | Raw Message | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-admin |
Hi
Are you sure that postgres uses all the memory that you have set as Huge
Pages otherwise it is wasted and can not be used by anybody.
This could be 25 % of your memory that is wasted in your configuration.
From the documentation It is primary shared buffers that used Huge Page.
You should start by checking how much of the Huge page memory that is
allocated from Liunx by looking at /proc/meminfo for the values 1) to
verify that you are using the huge page memory
1)
HugePages_Total:
HugePages_Free:
HugePages_Rsvd:
HugePages_Surp:
Hugepagesize:
Med venlig hilsen
Peter Gram
Sæbyholmsvej 18
2500 Valby
Mobile: (+45) 5374 7107
Email: peter(dot)m(dot)gram(at)gmail(dot)com
On Mon, 4 Aug 2025 at 18:10, Ramakrishna Reddy Nandyala <rkreddy(dot)n(at)gmail(dot)com>
wrote:
> Hi Team
>
> System details
>
> We are using pg-16.8 on rhel 9.x
> RAM-96GB
> CPU-16
>
> We have configured 25% RAM as shared buffers,50% as effective cache.we
> have configured 50% RAM for Huge page settings
>
> Max connection set to 2000
> Work-mem -4 mb
> Maintenance work mem set to 1 GB
>
> Issue details
> 1) we have an application that selects the data and will process in
> application and try to insert the data into an other table
>
> During this process we are seeing so many temporary files been generated
> by the system,after some time we are seeing the application Connection is
> accumulating the memory at OS Level after reaching ~50%,we are getting Out
> Of Memory error and Kernel is killing the top memory consumer process ,here
> it is killing Postgres process that is doing the entire process.while
> automatic Postgres Service restart ,system status showing as activating and
> it is coming to Active state only after clearing of all the temporary files
> crated during the query running.The clearing of temp files are very slow
> such that it is causing unplanned outages to the system
>
> how to fasten the Temp files removal?
> How to get rid of this situation?
> Any suggestions on the configuration to avoid the temp file generation
>
> Thanks in advance
> Ramakrishna
>
>
>
| From | Date | Subject | |
|---|---|---|---|
| Next Message | DINESH NAIR | 2025-08-05 01:13:54 | Re: Clearing of temp files is very slow in pg16 |
| Previous Message | Ramakrishna Reddy Nandyala | 2025-08-04 16:09:58 | Clearing of temp files is very slow in pg16 |