Re: [PROPOSAL] VACUUM Progress Checker.

From: "Thakur, Sameer" <Sameer(dot)Thakur(at)nttdata(dot)com>
To: Jim Nasby <Jim(dot)Nasby(at)BlueTreble(dot)com>, Amit Langote <amitlangote09(at)gmail(dot)com>, Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>
Cc: Michael Paquier <michael(dot)paquier(at)gmail(dot)com>, PostgreSQL mailing lists <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: [PROPOSAL] VACUUM Progress Checker.
Date: 2015-07-23 09:44:17
Message-ID: FB70B48CE8A70B4C8D050211EC78690F7911C9BF@MAIL703.KDS.KEANE.COM
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hello,
>Yes. Any percent completion calculation will have to account for the case of needing multiple passes through all the indexes.

>Each dead tuple requires 6 bytes (IIRC) of maintenance work mem. So if you're deleting 5M rows with m_w_m=1MB you should be getting many passes through the indexes. >Studying the output of VACUUM VERBOSE will confirm that (or just throw a temporary WARNING in the path where we start the scan).

Yes I see the problem now. I get the message "WARNING: Overall index percentage completion 100.000000" logged > 25 times while vacuuming after 5 million records deleted.
Figuring out number of multiple index passes beforehand, accurately, is the problem to solve. Clearly need to study this some more.
Thank you,
Sameer Thakur | Senior Software Specialist | NTTDATA Global Delivery Services Private Ltd | w. +91.20.6641.7146 | VoIP: 8834.8146 | m. +91 989.016.6656 | sameer(dot)thakur(at)nttdata(dot)com | Follow us on Twitter(at)NTTDATAAmericas

______________________________________________________________________
Disclaimer: This email and any attachments are sent in strictest confidence
for the sole use of the addressee and may contain legally privileged,
confidential, and proprietary data. If you are not the intended recipient,
please advise the sender by replying promptly to this email and then delete
and destroy this email and any attachments without any further use, copying
or forwarding.

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Petr Jelinek 2015-07-23 09:53:28 Re: TABLESAMPLE patch is really in pretty sad shape
Previous Message Kouhei Kaigai 2015-07-23 09:38:39 Re: Asynchronous execution on FDW