Re: BUG #11904: out of memory when scanning large number of partitions

From: Sergey Koposov <koposov(at)ast(dot)cam(dot)ac(dot)uk>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: pgsql-bugs(at)postgresql(dot)org
Subject: Re: BUG #11904: out of memory when scanning large number of partitions
Date: 2014-11-08 01:39:28
Message-ID: alpine.LRH.2.11.1411080127430.2920@calx115.ast.cam.ac.uk
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-bugs

On Fri, 7 Nov 2014, Tom Lane wrote:

> That's an utterly insane number of partitions.
> I'm unsurprised.
>
> The inheritance infrastructure is only designed to support maybe 100
> child tables. If we ever get around to implementing a hard-wired
> partitioning scheme, it's possible that multiple thousands of partitions
> could be practical, but it isn't today. Sorry.

Okay, thanks.

I knew that it is not designed for such number of partitions, and that's
why I'm not using any of the CHECK() infrastructure and rather use the
inheritance to ensure the schema consistency of all the partitions. I was
just hoping that occasional queries from from parent would work (without
much worries about performance). I know that it did work in my tests when
the dataset was smaller (but with still the same number of children
tables), and was suprised that it blows so impressively even if the
actual data retrieved is zero. But fair enough, I won't do those queries
anymore.

Regards,
Sergey

*****************************************************
Sergey E. Koposov, PhD, Senior Research Associate
Institute of Astronomy, University of Cambridge
Madingley road, CB3 0HA, Cambridge, UK
Tel: +44-1223-337-551 Web: http://www.ast.cam.ac.uk/~koposov/

In response to

Browse pgsql-bugs by date

  From Date Subject
Next Message Robert Haas 2014-11-08 02:47:30 Re: BUG #11867: Strange behaviour with composite types after resetting database tablespace
Previous Message Rémi Zara 2014-11-07 22:25:50 Build broken on mips