[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [cross-project-issues-dev] Excessive disk usage of HIPPs

Hi Laurent,

Here is a more detailed list for emfcompare:

hipp8:/jobs/genie.emfcompare # du -shc *
50M     clean-nightly
1.3G    cli-master-gerrit
7.4G    cli-master-nightly
16K     collaborative.modeling-master-nightly
4.0G    collaborative.modeling.luna-master-nightly
3.8G    collaborative.modeling.mars-master-nightly
4.0G    collaborative.modeling.neon-master-nightly
2.4G    egit.logical-master-nightly
604K    egit.test.tmpdir
0       emfcompare-master-multi
651M    jgit.hooks-master-nighly
568K    maintenance-1.1
568K    maintenance-1.2
568K    maintenance-1.3
429M    maintenance-2.1
2.3G    maintenance-3.1
3.5G    maintenance-gerrit
9.9G    maintenance-nightly
13G     master-build-on-egit-logical-nighlty
5.2G    master-gerrit
9.7G    master-nightly
2.2G    master-performance
2.0G    master-performance-git
1.9G    master-performance-large
2.6G    master-performance-large-git
32K     master-q7-nightly
7.4G    master-quality
5.7G    master-rcptt-nightly
445M    publish-integration
74M     publish-nightly
21M     sandbox
168K    shell_tests
3.1G    sirius.compare-master-nightly
52M     test-releng
92G     total

Disk usage in master-nightly:

hipp8:/jobs/genie.emfcompare/master-nightly # du -shc *
376K    builds
2.6M    config-history
16K     config.xml
4.6G    configurations
0       lastStable
0       lastSuccessful
4.0K    nextBuildNumber
4.0K    scm-polling.log
5.1G    workspace
9.7G    total

So it's mostly the workspace and the build artifacts (not big by itself,
but there are quite a few builds kept with artifacts) in each configuration.

During the move, only EMFcompare's jobs dir was copied from one physical
machine to another and it used the same amount of disk space before the
move and after.

Regards,

Fred


On 08.02.2017 11:06, Laurent Goubet wrote:
> Hi Frederic,
> 
> I just went through all of our builds and three of them indeed didn't
> have the "discard old" option, for reasons unknown. Then again, what we
> have shouldn't take so much space at all. Is there any way to have more
> detailed information about what's taking so much space on emfcompare? Is
> it due to the move from hipp9 to hipp8?
> 
> Regards,
> 
> Laurent
> 
> 
> On 06/02/2017 19:26, Frederic Gurr wrote:
>> Hi,
>>
>> The following HIPP instances use a lot of disk space:
>>
>> * emfcompare	102 GB
>> * ice		403 GB
>> * packaging	485 GB
>> * kitalpha	191 GB
>> * papyrus	472 GB
>> * platform	206 GB
>>
>> Unfortunately I have to urge the corresponding projects to clean up
>> their HIPP instances and configure their jobs to use the "Discard Old
>> Builds" option.
>> There are two parameters that should be set to reasonable values:
>>
>> * Max # of builds to keep
>> * Max # of builds to keep with artifacts
>>
>> HIPP instances are not supposed to act as build artifact archive, so
>> keeping more than 5 or 10 builds with artifacts of a few hundred MBs or
>> even GBs is a bad practice.
>> If your console log is verbose, keeping a lot builds (even without
>> artifact) can also require a lot of disk space.
>>
>> A recommended default is to keep 10 builds, and (depending on the size
>> of artifacts) 5 builds with artifacts.
>>
>> Please note: when you change those settings, old builds will only be
>> deleted once the next build is running.
>>
>> Thanks for your cooperation.
>>
>> Regards,
>>
>> Fred
>> _______________________________________________
>> cross-project-issues-dev mailing list
>> cross-project-issues-dev@xxxxxxxxxxx
>> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
>> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
> 
> -- 
> 
> *Laurent Goubet*
> Consultant
> +33 2 51 13 51 42
> 
> <https://www.obeo.fr/>
> 
> 7 Boulevard Ampère - Carquefou - France
> *obeo.fr* <https://www.obeo.fr/> | *twitter*
> <https://twitter.com/obeo_corp> | *linkedin*
> <https://www.linkedin.com/company/obeo>
> 
> 
> 
> _______________________________________________
> cross-project-issues-dev mailing list
> cross-project-issues-dev@xxxxxxxxxxx
> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
>