Re: shared-memory based stats collector

From: Kyotaro Horiguchi <horikyota(dot)ntt(at)gmail(dot)com>
To: andres(at)anarazel(dot)de
Cc: magnus(at)hagander(dot)net, masao(dot)fujii(at)oss(dot)nttdata(dot)com, gkokolatos(at)protonmail(dot)com, pgsql-hackers(at)lists(dot)postgresql(dot)org
Subject: Re: shared-memory based stats collector
Date: 2021-03-16 08:17:08
Message-ID: 20210316.171708.459983199214982094.horikyota.ntt@gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

At Tue, 16 Mar 2021 16:44:38 +0900 (JST), Kyotaro Horiguchi <horikyota(dot)ntt(at)gmail(dot)com> wrote in
> At Mon, 15 Mar 2021 19:04:29 -0700, Andres Freund <andres(at)anarazel(dot)de> wrote in
> > Do you have some benchmarks that you used to verify performance?
>
> https://www.postgresql.org/message-id/20201008.160326.2246946707652981235.horikyota.ntt%40gmail.com
>
> It is using pgbench, with 800 clients with 20 threads.
>
> Graphs of performance gain/loss from the master for the following
> benchmarks are attached.
>
> > - Fetching 1 tuple from 1 of 100 tables from 100 to 800 clients.
> > - Fetching 1 tuple from 1 of 10 tables from 100 to 800 clients.
>
> v36 showed about 60% of degradation (TPS redued to 1/3 of master) at
> 600 clients, but it has been dissapeared as of v39. The graphs are of
> v39. I'm asking for the script that was used for the benchark and will
> send them later.

This is that.

create_tables.sh: creates tables for benchmarking.
simple_use_file_ac_1000.sql: randomly selects 1 tuple from a table.

$ createdb benchdb
$ ./create_tables.sh benchdb 100000 # the case of 100000 tables
$ pgbench benchdb -n -c100 -j20 -T300 -r P 10 -f simple_use_file_ac_1000.sql

regards.

--
Kyotaro Horiguchi
NTT Open Source Software Center

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Amit Kapila 2021-03-16 08:20:46 Re: pg_subscription - substream column?
Previous Message gkokolatos 2021-03-16 08:11:57 Re: Allow batched insert during cross-partition updates