RDS restore failed due to WAL log and disk space-- any tidy fixes?

From: Wells Oliver <wells(dot)oliver(at)gmail(dot)com>
To: pgsql-admin <pgsql-admin(at)postgresql(dot)org>
Subject: RDS restore failed due to WAL log and disk space-- any tidy fixes?
Date: 2024-11-17 00:33:10
Message-ID: CAOC+FBVyTiuOMF92pQG3QOrE9j8qFegvZLoi-3UmdhFNg94e2A@mail.gmail.com
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-admin

I provisioned an RDS instance with 2500GB space and began the restore of a
database I know to be about 1750 GB using 16 jobs.

Unfortunately, it died very near the end when it ran out of disk space due
to WAL log usage. Lots of:

2024-11-17 00:07:09 UTC::@:[19861]:PANIC: could not write to file
"pg_wal/xlogtemp.19861": No space left on device

And then kaboom.

I'm wondering what my course of action should be. Can I disable/reduce WAL
during a restore? wal_level is set to replica, can this temporarily be set
to minimal? Should I just eat the extra costs to add headroom for the WAL?
Would using fewer jobs during a restore reduce the amount of WAL created?

I appreciate it.

--
Wells Oliver
wells(dot)oliver(at)gmail(dot)com <wellsoliver(at)gmail(dot)com>

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Laurenz Albe 2024-11-17 15:41:38 Re: RDS restore failed due to WAL log and disk space-- any tidy fixes?
Previous Message Erik Serrano 2024-11-16 13:41:29 Re: PostgreSQL historical database