Re: Fast COPY FROM based on batch insert

From:	Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>
To:	"tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>
Cc:	Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>, Justin Pryzby <pryzby(at)telsasoft(dot)com>, Zhihong Yu <zyu(at)yugabyte(dot)com>, Amit Langote <amitlangote09(at)gmail(dot)com>, "tanghy(dot)fnst(at)fujitsu(dot)com" <tanghy(dot)fnst(at)fujitsu(dot)com>, Ashutosh Bapat <ashutosh(dot)bapat(dot)oss(at)gmail(dot)com>, Pg Hackers <pgsql-hackers(at)postgresql(dot)org>, Tomas Vondra <tomas(dot)vondra(at)enterprisedb(dot)com>, "houzj(dot)fnst(at)fujitsu(dot)com" <houzj(dot)fnst(at)fujitsu(dot)com>
Subject:	Re: Fast COPY FROM based on batch insert
Date:	2021-06-07 11:16:58
Message-ID:	046aac84-9499-6a97-0a80-dfd346cbcfda@postgrespro.ru
Views:	Raw Message | Whole Thread | Download mbox | Resend email
Thread:	2020-06-01 09:29:23 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎  2020-06-02 00:02:10 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>   2020-06-02 05:51:22 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎    2020-06-15 05:26:12 from Ashutosh Bapat <ashutosh(dot)bapat(dot)oss(at)gmail(dot)com> 📎     2020-06-17 06:24:48 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru> 📎      2020-06-22 12:11:05 from Ashutosh Bapat <ashutosh(dot)bapat(at)2ndquadrant(dot)com>       2020-07-03 05:15:46 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru>       2020-07-12 17:46:16 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎        2020-07-16 09:14:04 from Amit Langote <amitlangote09(at)gmail(dot)com> 📎         2020-07-22 09:09:51 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru>          2020-07-29 08:03:02 from Amit Langote <amitlangote09(at)gmail(dot)com>           2020-07-29 08:36:01 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru>            2020-08-03 11:38:57 from Amit Langote <amitlangote09(at)gmail(dot)com>             2020-08-07 09:14:41 from Amit Langote <amitlangote09(at)gmail(dot)com> 📎              2020-08-21 12:19:06 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎               2020-08-24 07:18:36 from Amit Langote <amitlangote09(at)gmail(dot)com> 📎                2020-08-24 09:19:28 from Amit Langote <amitlangote09(at)gmail(dot)com>                 2020-09-07 07:26:51 from Michael Paquier <michael(at)paquier(dot)xyz>                  2020-09-07 10:31:09 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                   2020-09-08 07:34:47 from Amit Langote <amitlangote09(at)gmail(dot)com>                    2020-09-08 09:29:14 from Alexey Kondratov <a(dot)kondratov(at)postgrespro(dot)ru>                     2020-09-08 14:00:12 from Amit Langote <amitlangote09(at)gmail(dot)com>                      2020-09-08 15:34:31 from Alexey Kondratov <a(dot)kondratov(at)postgrespro(dot)ru>                       2020-09-09 08:45:26 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                        2020-09-09 09:42:09 from Alexey Kondratov <a(dot)kondratov(at)postgrespro(dot)ru>                         2020-09-09 12:51:49 from Amit Langote <amitlangote09(at)gmail(dot)com>                          2020-09-10 09:57:43 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                           2020-09-16 09:10:36 from Amit Langote <amitlangote09(at)gmail(dot)com> 📎                            2020-09-20 09:12:08 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                            2020-09-21 11:20:16 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                             2020-10-19 04:12:25 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                              2020-10-19 14:58:34 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                               2020-10-20 02:30:57 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                                2020-11-10 18:17:53 from Tomas Vondra <tomas(dot)vondra(at)enterprisedb(dot)com> 📎                                 2020-11-23 02:49:59 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                                  2020-11-23 08:39:00 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                   2020-11-24 02:56:20 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                    2020-11-24 04:27:07 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                                     2020-11-24 06:04:27 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                2020-11-25 09:47:51 from Amit Langote <amitlangote09(at)gmail(dot)com>                                 2020-11-26 02:42:09 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                                  2020-11-30 14:06:47 from Amit Langote <amitlangote09(at)gmail(dot)com>                                   2020-12-01 05:39:59 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                                    2020-12-01 09:02:48 from Amit Langote <amitlangote09(at)gmail(dot)com>                                     2020-12-14 09:06:12 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                                      2020-12-22 07:04:34 from "Tang, Haiying" <tanghy(dot)fnst(at)cn(dot)fujitsu(dot)com>                                       2020-12-23 09:00:18 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                                        2020-12-29 11:20:47 from "Hou, Zhijie" <houzj(dot)fnst(at)cn(dot)fujitsu(dot)com>                                         2020-12-30 07:16:07 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                                          2021-01-11 11:59:13 from "Tang, Haiying" <tanghy(dot)fnst(at)cn(dot)fujitsu(dot)com> 📎                                           2021-01-12 03:45:19 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru>                                          2021-01-11 18:16:45 from Tomas Vondra <tomas(dot)vondra(at)enterprisedb(dot)com>                                           2021-01-12 04:13:05 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                                            2021-01-28 02:40:32 from "Tang, Haiying" <tanghy(dot)fnst(at)cn(dot)fujitsu(dot)com>                                             2021-02-02 06:57:04 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                                              2021-02-02 08:28:27 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                               2021-02-02 09:13:29 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                                                2021-02-09 04:35:03 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> 📎                                                 2021-02-09 05:57:44 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru>                                                  2021-02-09 07:47:05 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                                                   2021-02-09 08:22:33 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru>                                                    2021-02-09 08:30:37 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                                                    2021-02-12 07:43:00 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                                                 2021-02-14 21:03:38 from Justin Pryzby <pryzby(at)telsasoft(dot)com>                                                  2021-02-15 04:54:00 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> 📎                                                   2021-02-15 08:31:11 from Amit Langote <amitlangote09(at)gmail(dot)com>                                                    2021-02-16 05:39:57 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> 📎                                                     2021-03-03 20:27:03 from Justin Pryzby <pryzby(at)telsasoft(dot)com> 📎                                                      2021-03-04 02:24:24 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> 📎                                                       2021-03-04 02:51:39 from Zhihong Yu <zyu(at)yugabyte(dot)com>                                                        2021-03-04 07:39:55 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> 📎                                                         2021-03-04 11:02:26 from Ibrar Ahmed <ibrar(dot)ahmad(at)gmail(dot)com>                                                         2021-03-04 20:39:49 from Justin Pryzby <pryzby(at)telsasoft(dot)com>                                                          2021-03-05 16:54:17 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> 📎                                                           2021-03-12 05:54:29 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> 📎                                                           2021-03-22 18:33:23 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                            2021-03-23 02:01:56 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> 📎                                                             2021-03-23 03:18:56 from Zhihong Yu <zyu(at)yugabyte(dot)com>                                                              2021-03-23 03:23:22 from Justin Pryzby <pryzby(at)telsasoft(dot)com>                                                               2021-03-23 05:05:48 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com> 📎                                                                2021-04-09 00:49:56 from Justin Pryzby <pryzby(at)telsasoft(dot)com> 📎                                                                 2021-04-09 01:42:40 from Zhihong Yu <zyu(at)yugabyte(dot)com>                                                                 2021-04-09 03:50:28 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                 2021-04-09 03:53:55 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                  2021-06-04 08:26:29 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                                                                   2021-06-04 08:45:55 from "tsunakawa(dot)takay(at)fujitsu(dot)com" <tsunakawa(dot)takay(at)fujitsu(dot)com>                                                                    2021-06-07 06:36:18 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                                     2021-06-07 11:16:58 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                                                                      2022-03-21 23:58:01 from Andres Freund <andres(at)anarazel(dot)de>                                                                       2022-03-22 02:36:00 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                   2022-03-22 01:54:00 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                    2022-03-24 06:43:37 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                                                                     2022-07-07 03:14:44 from Ian Barwick <ian(dot)barwick(at)enterprisedb(dot)com>                                                                      2022-07-07 13:51:54 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                                       2022-07-08 02:12:28 from Ian Barwick <ian(dot)barwick(at)enterprisedb(dot)com> 📎                                                                        2022-07-08 15:09:35 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                                                                         2022-07-11 01:12:26 from Ian Barwick <ian(dot)barwick(at)enterprisedb(dot)com>                                                                          2022-07-11 03:54:08 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                                                                     2022-07-18 08:22:49 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com> 📎                                                                      2022-07-19 09:35:22 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                                       2022-07-20 08:10:43 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                        2022-07-22 06:39:23 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                                         2022-07-22 08:14:00 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                          2022-07-22 08:42:43 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                                           2022-07-26 10:19:43 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                            2022-08-09 11:44:59 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com> 📎                                                                             2022-08-09 16:13:02 from Zhihong Yu <zyu(at)yugabyte(dot)com>                                                                              2022-08-10 08:30:20 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                               2022-09-27 09:03:51 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com> 📎                                                                                2022-10-07 06:18:59 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com> 📎                                                                                 2022-10-11 06:06:57 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                                                  2022-10-12 02:56:17 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com> 📎                                                                                   2022-10-13 04:38:05 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                                                    2022-10-13 09:58:14 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                                     2022-10-28 10:12:52 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                                      2022-10-28 10:53:17 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                                                       2022-10-31 08:50:02 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                             2022-08-15 05:29:22 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                                              2022-08-22 08:44:27 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                               2022-08-23 05:58:22 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                                                2022-09-27 08:47:45 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                                          2022-07-27 05:42:28 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>                                                                           2022-08-01 04:00:13 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>                                                    2021-02-16 08:23:34 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru>                       2020-09-09 09:38:20 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru> 📎                    2020-09-08 10:21:33 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru>         2020-07-23 06:23:42 from "Andrey V(dot) Lepikhov" <a(dot)lepikhov(at)postgrespro(dot)ru> 📎          2020-07-27 16:34:46 from Alexey Kondratov <a(dot)kondratov(at)postgrespro(dot)ru> 📎           2020-07-28 00:33:19 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru>            2020-07-28 07:54:22 from Alexey Kondratov <a(dot)kondratov(at)postgrespro(dot)ru>    2020-06-19 14:58:02 from Etsuro Fujita <etsuro(dot)fujita(at)gmail(dot)com>     2020-06-22 06:13:30 from Andrey Lepikhov <a(dot)lepikhov(at)postgrespro(dot)ru> 📎
Lists:	pgsql-hackers

Attachment	Content-Type	Size
v2-0001-Implementation-of-a-Bulk-COPY-FROM.patch	text/plain	23.6 KB

In response to

• Re: Fast COPY FROM based on batch insert at 2021-06-07 06:36:18 from Andrey Lepikhov

Responses

• Re: Fast COPY FROM based on batch insert at 2022-03-21 23:58:01 from Andres Freund

Browse pgsql-hackers by date

	From	Date	Subject
Next Message	Japin Li	2021-06-07 11:18:34	Confused about extension and shared_preload_libraries
Previous Message	Abbas Butt	2021-06-07 10:26:05	Re: Logical replication keepalive flood