Skip site navigation (1) Skip section navigation (2)

Re: Discovering the most searched values for a field

From: alexandre - aldeia digital <adaldeia(at)gmail(dot)com>
To: pgsql-performance(at)postgresql(dot)org
Subject: Re: Discovering the most searched values for a field
Date: 2012-01-23 17:26:47
Message-ID: 4F1D9857.90707@gmail.com (view raw or flat)
Thread:
Lists: pgsql-performance
Em 13-01-2012 17:08, Josh Berkus escreveu:
> On 1/13/12 10:08 AM, alexandre - aldeia digital wrote:
>> Hi,
>>
>> Is there a simple way (or a tool) to discover the most searched values
>> in a field from a table ?
>>
>> In the pg_stats, I can see the most common values generated by ANALYZE,
>> but I want to know how many queries are using this values. With this
>> information and the other statistics, I want to create partial indexes
>> or use table partitioning to create some benchmarks to speed up the
>> database access.
>
> No simple + fast way.
>
> The way to do this is:
>
> 1) log all queries
> 2) load query log into a database
> 3) filter to queries which only run against that table
> 4) analyze queries for values against that column.
>
> For (4), we've had the best luck with generating explain plans in XML
> and then digesting the XML to look for filter conditions.  Finding
> column matches by regex was a lot less successful.
>

Thanks Josh ! I will try this. The only problem is the size of the LOGs. 
One day with logs turned on generates 100 GB log file in the most of my 
customers...

In response to

pgsql-performance by date

Next:From: Tomas VondraDate: 2012-01-23 17:39:14
Subject: Re: spikes in pgbench read-only results
Previous:From: alexandre - aldeia digitalDate: 2012-01-23 17:22:51
Subject: Re: Partitioning by status?

Privacy Policy | About PostgreSQL
Copyright © 1996-2014 The PostgreSQL Global Development Group