Re: pg_rewind copy so much data

I use ver 9.5.3. I have just run again and get the debug log. It seems to
be that I cannot send such big file to postgresql mail so I copy some parts
here:

fetched file "global/pg_control", length 8192
fetched file "pg_xlog/0000000D.history", length 475
servers diverged at WAL position 2/D69820C8 on timeline 12
rewinding from last common checkpoint at 2/D6982058 on timeline 12
backup_label.old (COPY)
base/1/1247_fsm (COPY)
base/1/1247_vm (COPY)
base/1/1249_fsm (COPY)
base/1/1249_vm (COPY)
base/1/1255_fsm (COPY)
base/1/1255_vm (COPY)
base/1/1259_fsm (COPY)
base/1/1259_vm (COPY)
base/1/13125_fsm (COPY)
base/1/13125_vm (COPY)
base/1/13130_fsm (COPY)
base/1/13130_vm (COPY)
base/1/13135_fsm (COPY)
base/1/13135_vm (COPY)
base/1/13140_fsm (COPY)
base/1/13140_vm (COPY)
base/1/13145_fsm (COPY)
base/1/13145_vm (COPY)
base/1/13150_fsm (COPY)
base/1/13150_vm (COPY)
base/1/1417_vm (COPY)
base/1/1418_vm (COPY)
base/1/2328_vm (COPY)
base/1/2336_vm (COPY)
base/1/2600_fsm (COPY)

global/3592_vm (COPY)
global/4060_vm (COPY)
global/6000_vm (COPY)
global/pg_control (COPY)
global/pg_filenode.map (COPY)
global/pg_internal.init (COPY)
pg_clog/0000 (COPY)
pg_clog/0001 (COPY)
pg_clog/0002 (COPY)
pg_hba.conf (COPY)
pg_ident.conf (COPY)
pg_multixact/members/0000 (COPY)
pg_multixact/offsets/0000 (COPY)
pg_notify/0000 (COPY)
pg_stat_tmp/db_0.stat (COPY)
pg_stat_tmp/db_13294.stat (COPY)
pg_stat_tmp/global.stat (COPY)
pg_subtrans/0025 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/112 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/113 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1247 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1247_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1247_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1249 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1249_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1249_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1255 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1255_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1255_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1259 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1259_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1259_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13125 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13125_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13125_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13127 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13129 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13130 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13130_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13130_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13132 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13134 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13135 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13135_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13135_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13137 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13139 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13140 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13140_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13140_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13142 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13144 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13145 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13145_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13145_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13147 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13149 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13150 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13150_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13150_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13152 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13154 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13155 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13157 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13159 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1417 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1417_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1418 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1418_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/16401 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/16422 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/16440 (COPY)

received chunk for file "base/1/2603_fsm", offset 0, size 24576
received chunk for file "base/1/2603_vm", offset 0, size 8192
received chunk for file "base/1/2605_fsm", offset 0, size 24576
received chunk for file "base/1/2605_vm", offset 0, size 8192
received chunk for file "base/1/2606_fsm", offset 0, size 24576
received chunk for file "base/1/2606_vm", offset 0, size 8192
received chunk for file "base/1/2607_fsm", offset 0, size 24576
received chunk for file "base/1/2607_vm", offset 0, size 8192
received chunk for file "base/1/2608_fsm", offset 0, size 24576
received chunk for file "base/1/2608_vm", offset 0, size 8192
received chunk for file "base/1/2609_fsm", offset 0, size 24576
received chunk for file "base/1/2609_vm", offset 0, size 8192
received chunk for file "base/1/2610_fsm", offset 0, size 24576
received chunk for file "base/1/2610_vm", offset 0, size 8192
received chunk for file "base/1/2612_fsm", offset 0, size 24576
received chunk for file "base/1/2612_vm", offset 0, size 8192
received chunk for file "base/1/2615_fsm", offset 0, size 24576
received chunk for file "base/1/2615_vm", offset 0, size 8192
received chunk for file "base/1/2616_fsm", offset 0, size 24576
received chunk for file "base/1/2616_vm", offset 0, size 8192

received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16651",
offset 0, size 188416
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16653",
offset 0, size 188416
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16655",
offset 0, size 8192
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16661",
offset 0, size 8192
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16663",
offset 0, size 8192
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665",
offset 0, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665",
offset 1000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665",
offset 2000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665",
offset 3000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665",
offset 4000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665",
offset 5000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665",
offset 6000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665",
offset 7000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665",
offset 8000000

On Wed, Sep 13, 2017 at 5:57 PM, Michael Paquier <michael(dot)paquier(at)gmail(dot)com>
wrote:

> On Wed, Sep 13, 2017 at 2:21 PM, Hung Phan <hungphan227(at)gmail(dot)com> wrote:
> > If I run pg_rewind with debug option, it just show additional bunch of
> files
> > copied in directories like base or pg_tblspc. I claim that there is no
> data
> > inserted of modified from the first step. The only difference between two
> > server is caused by restarting old master.
>
> That's exactly this kind of data that would allow to conclude where
> the data comes from, and you are not showing it, so it is not possible
> to make a clear conclusion. Are known the file paths, the offset
> position in the file where a chunk of data is taken, and the chunk
> size. If you see for example a bunch of 8kB blocks being copied, this
> means that some extra load ran on the master before it was stopped,
> and before running the rewind. Are you sure that you don't have large
> log files for example?
>
> I would be curious to know what is the version of Postgres 9.5 you are
> using as well.
> --
> Michael
>