Re: CPU causes 100% load in user space when ntp client runs and postgresql is under heavy load

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Dennis Brouwer <dennis(dot)brouwer(at)m4n(dot)nl>
Cc: pgsql-admin(at)postgresql(dot)org
Subject: Re: CPU causes 100% load in user space when ntp client runs and postgresql is under heavy load
Date: 2012-09-24 16:30:45
Message-ID: 16883.1348504245@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-admin

Dennis Brouwer <dennis(dot)brouwer(at)m4n(dot)nl> writes:
> Last week I was repeatedly able to run all these tests on the database
> without any issue but recently, all of a sudden at random, some of the
> queries performed a factor 100 less. It may take hours to complete the
> transaction. At the same moment we see a dramatic decrease in IO and the
> CPU is nearly 100% busy in user space.

> After days of testing I may have found the cause: the ntp client. If I stop
> the ntp client the problem vanishes.

> I have started reading on spinlocks and other related material but this all
> is rather complicated stuff and kindly ask in what direction I should
> search. The issue can be reproduced for both postgresql-9.1 and
> postgresql-9.2 and perhaps can be rephrased as: Very high CPU load in user
> space (at random) with ntp enabled and (long?) running transactions.

That's really bizarre. What "ntp client" are you using exactly? Is it
configured to adjust the system clock by slewing, or by stepping? Can
you identify what part of the code is eating CPU (try perf or oprofile)?

regards, tom lane

In response to

Responses

Browse pgsql-admin by date

  From Date Subject
Next Message Steve Crawford 2012-09-24 17:34:38 Re: changes to postgresql.conf
Previous Message Tom Lane 2012-09-24 15:44:36 Re: [ADMIN] pg_upgrade from 9.1.3 to 9.2 failed