Re: [Pgbuildfarm-members] [HACKERS] Reducing buildfarm disk usage: remove temp installs when done

From: Andrew Dunstan <andrew(at)dunslane(dot)net>
To: PGBuildFarm <pgbuildfarm-members(at)pgfoundry(dot)org>
Subject: Re: [Pgbuildfarm-members] [HACKERS] Reducing buildfarm disk usage: remove temp installs when done
Date: 2015-01-20 18:49:20
Message-ID: 54BEA330.6090308@dunslane.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: buildfarm-members pgsql-hackers


On 01/19/2015 09:53 AM, Tom Lane wrote:
> Andrew Dunstan <andrew(at)dunslane(dot)net> writes:
>> But I'm wondering if we should look at using the tricks git-new-workdir
>> uses, setting up symlinks instead of a full clone. Then we'd have one
>> clone with a bunch of different work dirs. That plus a but of explicitly
>> done garbage collection and possibly a periodic re-clone might do the trick.
> Yeah, I was wondering whether it'd be okay to depend on git-new-workdir.
> That would fix the problem pretty nicely. But in the installations I've
> seen, that's not in PATH but squirreled away in some hard-to-guess library
> directory ...
>
>

Following some discussion on -hackers, here's a trial patch that reduces
the amount of space taken by symlinking the git repos on all non-HEAD
branches to the HEAD branch repo.

There are more steps we can possibly take to reduce space consumption,
but this is a start. If anyone is feeling brave they can apply this and
see how it goes.

For now at least, it doesn't work on Windows, nor on machines using the
git_reference config setting.

cheers

amdrew

In response to

Responses

Browse buildfarm-members by date

  From Date Subject
Next Message Tom Lane 2015-01-21 03:44:52 Re: [Pgbuildfarm-members] [HACKERS] Reducing buildfarm disk usage: remove temp installs when done
Previous Message Andrew Dunstan 2015-01-20 18:42:53 Re: Reducing buildfarm disk usage: remove temp installs when done

Browse pgsql-hackers by date

  From Date Subject
Next Message Jeff Davis 2015-01-20 20:13:32 Re: PATCH: decreasing memory needlessly consumed by array_agg
Previous Message Andrew Dunstan 2015-01-20 18:42:53 Re: Reducing buildfarm disk usage: remove temp installs when done