From:
Bruce Momjian <bruce(at)momjian(dot)us>
To:
Daniel Farina <daniel(at)heroku(dot)com>
Cc:
Merlin Moncure <mmoncure(at)gmail(dot)com>,Andres Freund <andres(at)2ndquadrant(dot)com>,pgsql-hackers(at)postgresql(dot)org, Josh Berkus <josh(at)agliodbs(dot)com>
Subject:
Re: Posix Shared Mem patch
Date:
2012-07-03 02:51:41
Message-ID:
20120703025141.GC25966@momjian.us (view raw or flat )
Thread:
2012-06-26 19:49:59 from Josh Berkus <josh(at)agliodbs(dot)com>
2012-06-26 20:29:21 from Alvaro Herrera <alvherre(at)commandprompt(dot)com>
2012-06-26 21:13:36 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-26 21:18:38 from Josh Berkus <josh(at)agliodbs(dot)com>
2012-06-26 21:40:16 from Daniel Farina <daniel(at)heroku(dot)com>
2012-06-26 21:44:13 from Josh Berkus <josh(at)agliodbs(dot)com>
2012-06-26 21:53:26 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-26 22:20:49 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-26 22:25:40 from "Kevin Grittner" <Kevin(dot)Grittner(at)wicourts(dot)gov>
2012-06-27 00:44:46 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-26 22:15:48 from "A(dot)M(dot)" <agentm(at)themactionfaction(dot)com>
2012-06-26 22:20:06 from Josh Berkus <josh(at)agliodbs(dot)com>
2012-06-26 22:25:19 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-27 03:28:14 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-27 04:00:49 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-27 11:34:48 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-27 13:44:57 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-27 13:52:22 from Stephen Frost <sfrost(at)snowman(dot)net>
2012-06-27 14:27:48 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-27 14:20:02 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-28 05:00:07 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-28 11:05:42 from Magnus Hagander <magnus(at)hagander(dot)net>
2012-06-28 11:31:52 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-28 13:47:53 from Jon Nelson <jnelson+pgsql(at)jamponi(dot)net>
2012-06-28 13:57:00 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-28 14:06:08 from Jon Nelson <jnelson+pgsql(at)jamponi(dot)net>
2012-06-28 13:59:38 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-28 14:11:31 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-28 15:26:00 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-28 16:13:26 from Thom Brown <thom(at)linux(dot)com>
2012-06-28 17:15:54 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-28 17:19:46 from Magnus Hagander <magnus(at)hagander(dot)net>
2012-06-28 17:27:50 from Andres Freund <andres(at)2ndquadrant(dot)com>
2012-06-28 17:30:29 from Magnus Hagander <magnus(at)hagander(dot)net>
2012-06-28 17:43:16 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-28 17:46:30 from Andres Freund <andres(at)2ndquadrant(dot)com>
2012-06-28 18:00:06 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-28 18:06:18 from Andres Freund <andres(at)2ndquadrant(dot)com>
2012-06-28 18:11:18 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-28 18:47:58 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-28 18:51:20 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-28 19:46:50 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-29 17:08:09 from Josh Berkus <josh(at)agliodbs(dot)com>
2012-06-29 17:28:47 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-29 17:44:40 from Josh Berkus <josh(at)agliodbs(dot)com>
2012-06-29 17:48:53 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-29 17:58:00 from Josh Berkus <josh(at)agliodbs(dot)com>
2012-06-29 18:14:29 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-29 18:31:59 from Josh Berkus <josh(at)agliodbs(dot)com>
2012-07-03 02:52:21 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-28 16:46:22 from Jeff Janes <jeff(dot)janes(at)gmail(dot)com>
2012-07-03 13:57:07 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-07-03 17:46:46 from Josh Kupershmidt <schmiddy(at)gmail(dot)com>
2012-07-04 19:58:27 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-27 18:55:36 from "A(dot)M(dot)" <agentm(at)themactionfaction(dot)com>
2012-07-03 15:36:24 from Andres Freund <andres(at)2ndquadrant(dot)com>
2012-07-03 15:41:09 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-07-03 15:55:30 from Andres Freund <andres(at)2ndquadrant(dot)com>
2012-07-03 16:02:21 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-07-03 15:42:29 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-07-03 15:43:14 from Magnus Hagander <magnus(at)hagander(dot)net>
2012-06-26 22:58:45 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-26 23:15:26 from Alvaro Herrera <alvherre(at)commandprompt(dot)com>
2012-06-27 00:40:46 from "A(dot)M(dot)" <agentm(at)themactionfaction(dot)com>
2012-06-26 21:53:58 from Alvaro Herrera <alvherre(at)commandprompt(dot)com>
2012-06-26 22:12:41 from Daniel Farina <daniel(at)heroku(dot)com>
2012-06-26 22:21:18 from "A(dot)M(dot)" <agentm(at)themactionfaction(dot)com>
2012-06-26 23:30:09 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-27 00:37:17 from "A(dot)M(dot)" <agentm(at)themactionfaction(dot)com>
2012-06-27 01:50:45 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-27 02:40:54 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-27 11:41:55 from Magnus Hagander <magnus(at)hagander(dot)net>
2012-06-27 13:40:01 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-27 13:53:46 from Stephen Frost <sfrost(at)snowman(dot)net>
2012-06-27 14:06:56 from Magnus Hagander <magnus(at)hagander(dot)net>
2012-06-27 14:17:57 from Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
2012-06-26 21:41:44 from Robert Haas <robertmhaas(at)gmail(dot)com>
2012-06-29 19:52:39 from Andres Freund <andres(at)2ndquadrant(dot)com>
2012-06-29 20:00:01 from Merlin Moncure <mmoncure(at)gmail(dot)com>
2012-06-29 23:03:40 from Daniel Farina <daniel(at)heroku(dot)com>
2012-07-03 02:51:41 from Bruce Momjian <bruce(at)momjian(dot)us>
Lists:
pgsql-hackers
On Fri, Jun 29, 2012 at 04:03:40PM -0700, Daniel Farina wrote:
> On Fri, Jun 29, 2012 at 1:00 PM, Merlin Moncure <mmoncure(at)gmail(dot)com> wrote:
> > On Fri, Jun 29, 2012 at 2:52 PM, Andres Freund <andres(at)2ndquadrant(dot)com> wrote:
> >> Hi All,
> >>
> >> In a *very* quick patch I tested using huge pages/MAP_HUGETLB for the mmap'ed
> >> memory.
> >> That gives around 9.5% performance benefit in a read-only pgbench run (-n -S -
> >> j 64 -c 64 -T 10 -M prepared, scale 200, 6GB s_b, 8 cores, 24GB mem).
> >>
> >> It also saves a bunch of memory per process due to the smaller page table
> >> (shared_buffers 6GB):
> >> cat /proc/$pid_of_pg_backend/status |grep VmPTE
> >> VmPTE: 6252 kB
> >> vs
> >> VmPTE: 60 kB
> > ... those results are just spectacular (IMO). nice!
>
> That is super awesome. Smallish databases with a high number of
> connections actually spend a considerable fraction of their
> otherwise-available-for-buffer-cache space on page tables in common
> cases currently.
I thought newer Linux kernels did huge pages automatically? What Linux
kernel is this?
--
Bruce Momjian <bruce(at)momjian(dot)us> http://momjian.us
EnterpriseDB http://enterprisedb.com
+ It's impossible for everything to be true. +
In response to
pgsql-hackers by date
Next :From: Robert HaasDate: 2012-07-03 02:52:21
Subject : Re: Posix Shared Mem patch
Previous :From : Robert HaasDate : 2012-07-03 02:49:10
Subject : huge tlb support