Re: [BUGS] General Bug Report: Files greater than 1 GB are created while sorting

From: Bruce Momjian <maillist(at)candle(dot)pha(dot)pa(dot)us>
To: Doug Mitchell <doug(at)mitchcraft(dot)com>
Cc: pgsql-bugs(at)postgreSQL(dot)org
Subject: Re: [BUGS] General Bug Report: Files greater than 1 GB are created while sorting
Date: 1999-07-08 02:53:27
Message-ID: 199907080253.WAA23310@candle.pha.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-bugs

I haved added to the TODO list:

* Allow creation of sort tables > 1 Gig

> Problem Description:
> --------------------
>
> The backed is creating files bigger than 1 GB when sorting
> and it will break when the file gets to 2 GB.
>
> Here are the biggest files:
>
> 1049604 -rw------- 1 postgres postgres 1073741824 Jun 30 19:10 bigtable_pkey
> 1049604 -rw------- 1 postgres postgres 1073741824 Jun 30 19:36 pg_temp.2446.0
> 1049604 -rw------- 1 postgres postgres 1073741824 Jun 30 19:55 bigtable
> 1122136 -rw------- 1 postgres postgres 1147937412 Jun 30 21:39 pg_temp2769.3
> 1148484 -rw------- 1 postgres postgres 1174890288 Jun 30 21:26 pg_temp2769.4

I have renamed these sort temp tables to pg_sorttemp so they will not be
confused with actual temp tables. Because people installing 6.5.1 will
have stopped their postmasters, that will not cause any problems.

You are safe up to 2 gigs, and at that point, the OS will can cause a
problem. The new naming should make the cause clearer. Don't know if
we can get this done in 6.5.1 because the change to segment these
requires some work. Looks like the psort code goes right to fd/*,
bypassing the storage manager.

--
Bruce Momjian | http://www.op.net/~candle
maillist(at)candle(dot)pha(dot)pa(dot)us | (610) 853-3000
+ If your life is a hard drive, | 830 Blythe Avenue
+ Christ can be your backup. | Drexel Hill, Pennsylvania 19026

In response to

Browse pgsql-bugs by date

  From Date Subject
Next Message Bruce Momjian 1999-07-08 03:06:28 Re: [BUGS] General Bug Report: TEMP TABLES becomes permanent CATALOG TABLES
Previous Message Bruce Momjian 1999-07-07 18:10:03 Re: [BUGS] General Bug Report: GROUP BY with NULL not done properly(Oracle8 & DB/2 do this completely different)