Re: Hardware recommendations to scale to silly load

From: Vivek Khera <khera(at)kcilink(dot)com>
To: pgsql-performance(at)postgresql(dot)org
Subject: Re: Hardware recommendations to scale to silly load
Date: 2003-09-02 16:01:16
Message-ID: x7he3vb2nn.fsf@yertle.int.kciLink.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-performance

>>>>> "AS" == Andrew Sullivan <andrew(at)libertyrms(dot)info> writes:

AS> On Fri, Aug 29, 2003 at 12:05:03AM -0700, William Yu wrote:
>> We should see a boost when we move to 64-bit Linux and hopefully another
>> one when NUMA for Linux is production-stable.

AS> According to the people who've worked with SGIs, NUMA actually seems
AS> to make things worse. It has something to do with how the shared
AS> memory is handled. You'll want to dig through the -general or
AS> -hackers archives from somewhere between 9 and 14 months ago, IIRC.

I knew my PhD research would one day be good for *something* ...

The basic premise of NUMA is that you can isolate which data belongs
to which processor and put that on memory pages that are local/closer
to it. In practice, this is harder than it sounds as it requires very
detailed knowledge of the application's data access patterns, and how
memory is allocated by the OS and standard libraries. Often you end
up with pages that have data that should be local to two different
processors, and that data keeps being migrated (if your NUMA OS
supports page migration) between the two processors or one of them
just gets slow access.

I can't imagine it benefiting postgres given its globally shared
buffers.

--
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Vivek Khera, Ph.D. Khera Communications, Inc.
Internet: khera(at)kciLink(dot)com Rockville, MD +1-240-453-8497
AIM: vivekkhera Y!: vivek_khera http://www.khera.org/~vivek/

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Vivek Khera 2003-09-02 16:08:15 Re: Hardware recommendations to scale to silly load
Previous Message Larry Rosenman 2003-09-02 15:37:45 Re: Unixware Patch (Was: Re: Beta2 Tag'd and Bundled ...)

Browse pgsql-performance by date

  From Date Subject
Next Message Vivek Khera 2003-09-02 16:08:15 Re: Hardware recommendations to scale to silly load
Previous Message Tom Lane 2003-09-01 21:03:17 Re: How to force Nested Loop plan?