| From: | Niels Jespersen <NJN(at)dst(dot)dk> |
|---|---|
| To: | prachi surangalikar <surangalikarprachi100(at)gmail(dot)com>, "pgsql-general(at)postgresql(dot)org" <pgsql-general(at)postgresql(dot)org> |
| Subject: | SV: Insertion time is very high for inserting data in postgres |
| Date: | 2021-02-10 11:10:41 |
| Message-ID: | 280e6bd026024e389657ae15ba169e90@dst.dk |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Thread: | |
| Lists: | pgsql-general |
>Fra: prachi surangalikar <surangalikarprachi100(at)gmail(dot)com>
>
>Hello Team,
>Greetings!
>
>We are using Postgres 12.2.1 for fetching per minute data for about 25 machines but running parallely via a single thread in python.
>But suddenly the insertion time has increased to a very high level, about 30 second for one machine.
>We are in so much problem as the data fetching is becoming slow.
>
>if anyone could help us to solve this problem it would be of great help to us.
Get your data into a Text.IO memory structure and then use copy https://www.psycopg.org/docs/usage.html#using-copy-to-and-copy-from
This is THE way of high-performant inserts using Postgres.
Regards Niels Jespersen
| From | Date | Subject | |
|---|---|---|---|
| Next Message | Thorsten Schöning | 2021-02-10 11:35:37 | Re: Increased size of database dump even though LESS consumed storage |
| Previous Message | cen | 2021-02-10 09:42:02 | Re: Regarding Postgres - Insertion Time Getting Increased As Data Volume is getting increased |