Re: BUG #19634: Hash partition with large MODULUS causes "invalid memory alloc request size"

From: Pierre Forstmann <pierre(dot)forstmann(at)gmail(dot)com>
To: pgsql-bugs(at)lists(dot)postgresql(dot)org
Cc: hackerzheng666(at)gmail(dot)com
Subject: Re: BUG #19634: Hash partition with large MODULUS causes "invalid memory alloc request size"
Date: 2026-08-21 12:04:09
Message-ID: 19d59133-7a9b-4d9f-a439-201d143bdb5f@gmail.com
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-bugs

Hello,

I propose following patch that adds the check to new_partition_bound
routine:

postgres=# CREATE TABLE t (id int) PARTITION BY HASH (id);
CREATE TABLE
postgres=# CREATE TABLE t_p0 PARTITION OF t FOR VALUES WITH (MODULUS
268435457,
REMAINDER 0);
ERROR:  hash partitions bounds are too large
DETAIL:  Creating hash partitions for modulus 268435457 would require
too much memory.
HINT:  Reduce the number of partitions.
postgres=#

Regards,

Pierre Forstmann

Le 21/08/2026 à 05:44, PG Bug reporting form a écrit :
> The following bug has been logged on the website:
>
> Bug reference: 19634
> Logged by: Zheng Hacker
> Email address: hackerzheng666(at)gmail(dot)com
> PostgreSQL version: 19beta3
> Operating system: Linux x86_64
> Description:
>
> Creating a hash partition with MODULUS >= 268435457 causes an internal error
> "invalid memory alloc request size" on any subsequent query against the
> partitioned table. The table becomes permanently unusable — SELECT,
> INSERT,
> and all other operations fail with the same error. Only DROP TABLE works.
>
> Minimal reproducer (tested on PG 20devel commit 609f969, 2026-08-21):
>
> CREATE TABLE t (id int) PARTITION BY HASH (id);
> CREATE TABLE t_p0 PARTITION OF t FOR VALUES WITH (MODULUS 268435457,
> REMAINDER 0);
> SELECT * FROM t; -- ERROR: invalid memory alloc request size 1073741828
>
> Root cause:
> In src/backend/partitioning/partbounds.c, create_hash_bounds() (line 390)
> allocates an array indexed by greatest_modulus:
>
> boundinfo->nindexes = greatest_modulus;
> boundinfo->indexes = palloc_array(int, greatest_modulus);
>
> When greatest_modulus >= 268435457, this requests 268435457 * 4 =
> 1073741828
> bytes, exceeding MaxAllocSize (1073741823 = 1GB - 1). No bounds check
> exists
> on the modulus value before this allocation.
>
> The validation in check_new_partition_bound() (line ~2927) runs AFTER
> create_hash_bounds() is called during partition descriptor loading, so it
> never gets a chance to reject the invalid modulus.
>
> Impact:
> - Affects all versions since hash partitioning was introduced (PG 11+)
> - The partition is created successfully (CREATE TABLE succeeds)
> - But any access to the parent table fails permanently
> - Only DROP TABLE recovers the table
> - Any unprivileged user with CREATE TABLE permission can trigger this
>
> Suggested fix:
> Add a bounds check in create_hash_bounds() before the allocation, or
> validate modulus against MaxAllocSize in check_new_partition_bound()
> before partition descriptor loading.
>
> PostgreSQL version: 20devel (commit 609f969)
> OS: Ubuntu 22.04 x86_64
>
>
>
>

Attachment Content-Type Size
0001-v1-0001-Fix-memory-allocation-check.patch text/x-patch 1.6 KB

In response to

Responses

Browse pgsql-bugs by date

  From Date Subject
Next Message Peter Eisentraut 2026-08-21 12:16:04 Re: BUG #19630: FOR PORTION OF crashes with XX000 when target range is NULL
Previous Message Andrey Rachitskiy 2026-08-21 12:00:17 Re: BUG #19635: Missing entry in information_schema.sequences when creating a Tale with auto increment