From: | Kyotaro HORIGUCHI <horiguchi(dot)kyotaro(at)lab(dot)ntt(dot)co(dot)jp> |
---|---|
To: | tgl(at)sss(dot)pgh(dot)pa(dot)us |
Cc: | tsunakawa(dot)takay(at)jp(dot)fujitsu(dot)com, alvherre(at)alvh(dot)no-ip(dot)org, andres(at)anarazel(dot)de, robertmhaas(at)gmail(dot)com, michael(dot)paquier(at)gmail(dot)com, david(at)pgmasters(dot)net, Jim(dot)Nasby(at)bluetreble(dot)com, craig(at)2ndquadrant(dot)com, pgsql-hackers(at)postgresql(dot)org |
Subject: | Re: Protect syscache from bloating with negative cache entries |
Date: | 2018-03-12 08:34:08 |
Message-ID: | 20180312.173408.162882093.horiguchi.kyotaro@lab.ntt.co.jp |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Thread: | |
Lists: | pgsql-hackers |
At Fri, 09 Mar 2018 17:40:01 +0900 (Tokyo Standard Time), Kyotaro HORIGUCHI <horiguchi(dot)kyotaro(at)lab(dot)ntt(dot)co(dot)jp> wrote in <20180309(dot)174001(dot)202113825(dot)horiguchi(dot)kyotaro(at)lab(dot)ntt(dot)co(dot)jp>
> > In short, it's not really apparent to me that negative syscache entries
> > are the major problem of this kind. I'm afraid that you're drawing very
> > large conclusions from a specific workload. Maybe we could fix that
> > workload some other way.
>
> The current patch doesn't consider whether an entry is negative
> or positive(?). Just clean up all entries based on time.
>
> If relation has to have the same characterictics to syscaches, it
> might be better be on the catcache mechanism, instaed of adding
> the same pruning mechanism to dynahash..
For the moment, I added such feature to dynahash and let only
relcache use it in this patch. Hash element has different shape
in "prunable" hash and pruning is performed in a similar way
sharing the setting with syscache. This seems working fine.
It is bit uneasy that all syscaches and relcache shares the same
value of syscache_memory_target...
Something like the sttached test script causes relcache
"bloat". Server emits the following log entries in DEBUG1 message
level.
DEBUG: removed 11240/32769 entries from hash "Relcache by OID" at character 15
# The last few words are just garbage I mentioned in another thread.
The last two patches do that (as PoC).
regards,
--
Kyotaro Horiguchi
NTT Open Source Software Center
Attachment | Content-Type | Size |
---|---|---|
0001-Remove-entries-that-haven-t-been-used-for-a-certain-.patch | text/x-patch | 13.1 KB |
0002-introduce-dynhash-pruning.patch | text/x-patch | 13.1 KB |
0003-Apply-purning-to-relcache.patch | text/x-patch | 1.7 KB |
From | Date | Subject | |
---|---|---|---|
Next Message | Kyotaro HORIGUCHI | 2018-03-12 08:36:22 | Re: Protect syscache from bloating with negative cache entries |
Previous Message | Aleksander Alekseev | 2018-03-12 08:25:03 | Re: GSOC 2018 proposal |