Re: Settings for autovacuum for batch uploading of data?

From: "Carlos Oliva" <carlos(at)pbsinet(dot)com>
To: "'Matthew T(dot) O'Connor'" <matthew(at)zeut(dot)net>
Cc: <pgsql-general(at)postgresql(dot)org>
Subject: Re: Settings for autovacuum for batch uploading of data?
Date: 2004-05-20 14:12:53
Message-ID: 200405201412.KAA04353@pbsi.pbsinet.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Thank you for your reply Matthew. Do you know if I can stop auto-vacuum,
and re-start it with different parameters as the uploading continues? I do
not know if my killing the auto-vacuum process would terminate my
application also.

I want to start auto-vacuum with different parameters to tune the vacuuming
to my application. I would like to vacuum often as the data is being
uploaded (inserts mainly) because I want to maintain a high speed of upload

Thanks again.

-----Original Message-----
From: pgsql-general-owner(at)postgresql(dot)org
[mailto:pgsql-general-owner(at)postgresql(dot)org] On Behalf Of Matthew T. O'Connor
Sent: Thursday, May 20, 2004 12:54 AM
To: Carlos
Cc: 'pgsql-general(at)postgresql(dot)org'
Subject: Re: [GENERAL] Settings for autovacuum for batch uploading of data?

More important than sleep value is the vacuum threshold. If for example
you are expecting to import 5000 rows of data, you can tell
pg_autovacuum to vacuum after every 5000 changes with like

pg_autovacuum -v 5000 -V 0

Matthew

On Wed, 2004-05-19 at 17:09, Carlos wrote:
> Hello Forum,
>
> I would appreciate it if you could recommend settings to use
> auto-vacuum in my version 7.4 database. I am uploading several
> thousands records in the database at a rate of ~1 second per record
> (the data is uploading from a different server). I have noticed that
> the performance of the uploading is improved if I vacuum the database
> every so often so I decided to take advantage of auto-vacuuming to
> maintain the best performance. Since I am uploading several thousands
> records, I set autovacuum to 50 minutes with -s 3000 in the hope that
> a great deal of data would be committed before a regular vacuum would
> take place and that vacuuming would interfere the least possible with
> the uploading.
>
>
>
> Thanks in advance for your recommendations.
>
>

---------------------------(end of broadcast)---------------------------
TIP 1: subscribe and unsubscribe commands go to majordomo(at)postgresql(dot)org

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Tom Lane 2004-05-20 14:29:32 Re: psql -E option is not working in 7.4.2 like 7.3.4
Previous Message Durai raj 2004-05-20 10:49:46 psql -E option is not working in 7.4.2 like 7.3.4