Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [cross-project-issues-dev] Responsible usage of disk space on download.eclipse.org
  • From: Frederic Gurr <frederic.gurr@xxxxxxxxxxxxxxxxxxxxxx>
  • Date: Tue, 31 Aug 2021 11:01:37 +0200
  • Autocrypt: addr=frederic.gurr@xxxxxxxxxxxxxxxxxxxxxx; prefer-encrypt=mutual; keydata= xsFNBFeN7eABEADU1DWW0e6X3UBsKwwN8+EtviRWuEcUTJBCspUfyhS+LnfzB944GN3h32uT 5ClPPc8bUIuipCfW/2BlkP9EhK3hfiD/LwDv2tS9K5nFsi+SawjYLRvQG+7d21Pe3LVUWpv3 K6OXuEZvdf+e/ljkhtATt0OmwbvxN3i9vzJHAYiFUTNgTO27ui2sqOI9uDXXTP7L0OdMbjun lsBMKMzd8BZLvsqbBvUbWihXqDvCgnPLbJw6VWrLjlfvWXQ9qIQQemzyG8tlII49LpX3gwH0 /jS6HVgSh52L7xohIivkJa4JkpPhGi8srAfxptQ3Kl2udhQkM8wswXsbIT89gsbJflsbYfDt uZLfjA9U+9UyrlgF5mYwpgGIawvuyi+YcJy8OzJWLnGq7jayJRT85udCiyDkCTDXxu0jSSjk By+NKG2T/dO2R96RbR2PuSzERhyMSCMAZOxoqCYf3mD9oeiNB9flwnxJpHKxuGBkG8zaQE6x sw4f4ZS88OCh854t33JKrlHXB9UTlMRHO9jj4cVKzFrEFZlUdIuu2WuDxYnFsI4tZAabn8V1 mFOkwz8ir/3IpM7GQbbq3ierJ5rYd87rkYroeNAOmUZW/7cM/5u7bOEzb+xlpn9OqQ63nAmN M2vMZEUIfzU/HhkhM3ItjWf74Fr4I9jseIvkrF3CrMyU1wPcJwARAQABzSlGcmVkZXJpYyBH dXJyIDxmcmVkZXJpYy5ndXJyQGVjbGlwc2Uub3JnPsLBfQQTAQgAJwIbIwULCQgHAgYVCAkK CwIEFgIDAQIeAQIXgAUCYPWeigUJEs2yGAAKCRAQkKvn8mMZ4acJD/4wX7Xaupu3QASMl/Rj IAUPaBHPugAshr3tyK/t/ADO5Dk4KQz+xZEmev6sL8L+6ucGAxQSGa6/39q6gnC6/s9Lkwyd Chf9LGVMwdL/S1gXrB6jumTTSxkt1W5RtnYiwn7NTpMrK/pAmQlDAQCf3URv2hpOQWe4z5Kg HCgB0SWh1dDMOWZ+DW2Q7AsyclbUMdifWU3wHvc0MpnjK4mOCVnEYmENskDcrxvLSHvpxgd1 i93O4ZRWF7EwrLZ4dzYNlk2px1fPao//lLNyNfGDg53l+KWAyU3FN7a54IxHbSmw+XCPOaib D4ji/HYRBLQshw5qiIXPZBxEO6DnkIc4W8QWvVkX5nU+TeHxD8WromNRKQkBWOBN+LzZsbsX lNrc1pxQR4xPcCJtown0PgU+jbr0fIdOih35o7s5zY34P+OvhhN2LBoN/2VAbFZ/c1Q3lmy1 y1enkjZ5q8AOJdPwln5hjWSak+cjF5PQyx6hWqIT+/NTr4AYF961u0AMROaTC6+a/3ULkDBy aFf9/Wlcfb9+Uvs7o/4K2xQknqea0PJ/cpOl43FxOF5yB0exsubqexL5D0HSSk4NbIZiCWET qgoYHDIV44L97rJBrerbRgan815TXNQY9K5TwlrjpqB1hqpcpvfhCwCfxj5dr9u2//02V9SB lzPaUbJAVIrptMxLGc7BTQRXje3gARAAvb2GFa8JkqZvyexW0djORggvQu73l3e1UkNExJ6v fL/KY3u63fIGpFBZDMqsRG9Ot+eGkQySLMh2ZkiQioQHET688JK1V2EzExkv0wtla5NMfPBd Z1kJuYdnjS7yMm09CWHe9vD/+X0odtPE9gQoL4C/cN3tv8+bR9yB1uPdAVpucY4tnBgmqpHk MO4c8Ywl6f5NuBHGdRMx9MeJkx5j97O1gCkm+m8fPt/MCrK2DYaZMPOO0dzGWnZorTKrzifn pvCvuu1PjQ2nq4KEVC96EoDWMeu5pvcVwWC44kgMdXvsoc4y3wvls4ml6ghCxaXZXUeQ7NRX vgXnniu7+xIZg4vofxrodig1kW22nw8wHPBBuSH7n/+YODSNZBIiuPXNy8SM70/Xc7owTxb5 fVnux3fo6f62e2ErDhxKV63EVDLkhaUFH7E7Ken2MXhUEcv9/ITtWHurKT8H3EUyRIva3jCW wPm0eDJNi1rKpR7mcxzAOXIUu121Qp4HBHZbtb0zJcnGLim/sAIPb6xG23Fh23lH32cdvn8u PpS1MoFkSZhgGOTHVzkp99bS9DrvqxfpqDWQ6NxII0mexqiCjs6abQhaIQaiUP34ASASHwHy n+U4bxGfKTrxRgOtWE+jCR5lCuCW2U+pq3/GtrOMoUCo5TaPxaHU8uUskE0BZ7UfgwcAEQEA AcLBZQQYAQgADwIbDAUCYPWeigUJEs2yKgAKCRAQkKvn8mMZ4XqZD/427eCFi2TPp+ELbE2o gK3u+ry0xW9fzWgs4vy+tAwtH3nIJ4vSePBusB8qgV/byAt84Odb/YBnXbMkBQfKgWGWPdcs EwhTR/iwwfPb32JZW8WgYj9HWRkqdSmr4iHtuhsalfZ+ATRcWhmnVWpA2pF+7gKyje8vUsDJ im5LmnPEKkyPJMuipwrQSD1Mn1SoBaZlYFF+WMPMed9bFXI6kwJa2IMAKFJHeTgGKPJR+BZv 64FX/cQOhaRyS6wxDfafmOXC/HNI9zDFGlcJP3ogE4E4CR9ov9NNAgyPrxSE3OBgMMCFzSHc 89lLQ0sAlo+ud0U6qrBrmut4RKcfaYifuZRfDWBmHOBj7ZQL68bIfhCOqu3HWQ4fNKMoqODm 09Id9ka8nRMvPfpdfbiWxzO1ehseJlmta/xdH+aQyA9mJQcZnzy5y5e9e+pxQwRflHuJB2pY Gb5XKH+u1Fu4b3ejOyRyI1vgqOxYkj6AgR6x/WxDlUq+urLsBs/Zh4Vb0qhMJMuX8GufDpg2 sILYovyzoLWKcLOxdSfPrymNjaCucBR59QeeeY4O4hi+A7Rei6wam9/hdmpsx9Jdbr+VqJY8 Ui9Ulx0usLuLwbTv6c0aaILihNuH4fIqvBh1ADstmPQhUwoLNv8LQKvxMKmsMU2MNxBd54dg T2qUOgnAsJphWLmvvQ==
  • Delivered-to: cross-project-issues-dev@xxxxxxxxxxx
  • List-archive: <https://www.eclipse.org/mailman/private/cross-project-issues-dev/>
  • List-help: <mailto:cross-project-issues-dev-request@eclipse.org?subject=help>
  • List-subscribe: <https://www.eclipse.org/mailman/listinfo/cross-project-issues-dev>, <mailto:cross-project-issues-dev-request@eclipse.org?subject=subscribe>
  • List-unsubscribe: <https://www.eclipse.org/mailman/options/cross-project-issues-dev>, <mailto:cross-project-issues-dev-request@eclipse.org?subject=unsubscribe>
  • Organization: Eclipse Foundation
  • User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0

Hi Alexander,

Please take a look at other (sub-)directories, e.g.
passage/products/milestone/ as well. I assume it's not necessary to keep
all milestone builds/artifacts for an extended time.

Please note, that my clean-up reminder had two parts (that I might have
not stressed enough). It's a good start to remove the unnecessary stuff
once, but the actual goal is to fix the processes to avoid that a large
number of integration/milestones builds, etc is created again in the
future. For example, a (semi-)automated build job should remove old content.

Passage is just an example. This applies to all projects.

Regards,

Fred

On 31.08.21 10:38, Alexander Fedorov wrote:
> Hi Fred,
> 
> Thank you for clarification, I removed integration builds of runnable
> products from https://download.eclipse.org/passage/products/integration/
> 
> Regards,
> AF
> 
> 8/31/2021 11:05 AM, Frederic Gurr пишет:
>> Hi Alexander,
>>
>> Thanks for starting to clean up the passage downloads directory. You are
>> right, the number of 5200 was indeed a bit too high. A simple bash
>> syntax error led to that wrong number. I also referenced the wrong
>> sub-directory. passage/products/integration contains the high number of
>> builds.
>>
>> Here is the correct number and the correct directory:
>>
>> ls -1 /home/data/httpd/download.eclipse.org/passage/products/integration
>> | wc -l        => 760
>>
>> Passage is still in the lead. ;)
>>
>> Regards,
>>
>> Fred
>>
>> On 30.08.21 21:16, Alexander Fedorov wrote:
>>> Thank you for reminder, Fred
>>> I have the cleanup in the list of my planned actions and now it has got
>>> the priority boost.
>>>
>>> And thank you for promoting Eclipse Passage project.
>>> Just one small clarification to avoid undeserved kudos: we are working
>>> hard to make the license management scenarios available for community,
>>> but the total amount of our integration builds was 883.
>>> So I wonder how we managed to achieve the number of 5200 builds. In any
>>> case I removed integration builds from
>>> https://download.eclipse.org/passage/drops/integration/
>>>
>>> Regards,
>>> AF
>>>
>>>
>>> 8/30/2021 9:11 PM, Frederic Gurr пишет:
>>>> Hi,
>>>>
>>>> This is a friendly reminder to act responsible with shared
>>>> resources, in
>>>> this case: disk space on download.eclipse.org.
>>>>
>>>> The download server is the right place to store all your project's
>>>> deliverables like binaries, update sites, etc.
>>>> See also: https://wiki.eclipse.org/IT_Infrastructure_Doc#Downloads
>>>>
>>>> It's not the right place to store excessive amounts of build artifacts.
>>>> E.g.
>>>> * Eclipselink: last 325 nightly builds  => d.e.o/rt/eclipselink/nightly
>>>> * Webtools: last 700 CI builds          => d.e.o/webtools/CI
>>>> * Passage: last 5200 (!) builds         => d.e.o/passage/integration
>>>>
>>>> ALL PROJECTS (not just the ones mentioned above!) should make sure that
>>>> they keep their download directory tidy and move old stuff to
>>>> archive.eclipse.org, if required.
>>>>
>>>>
>>>> Regards,
>>>>
>>>> Fred
>>>>
>>> _______________________________________________
>>> cross-project-issues-dev mailing list
>>> cross-project-issues-dev@xxxxxxxxxxx
>>> To unsubscribe from this list, visit
>>> https://www.eclipse.org/mailman/listinfo/cross-project-issues-dev
> 
> _______________________________________________
> cross-project-issues-dev mailing list
> cross-project-issues-dev@xxxxxxxxxxx
> To unsubscribe from this list, visit
> https://www.eclipse.org/mailman/listinfo/cross-project-issues-dev

-- 
Frederic Gurr
Release Engineer | Eclipse Foundation Europe GmbH

Berliner Allee 47, D-64295 Darmstadt
Handelsregister: Darmstadt HRB 92821
Managing Directors: Gaël Blondelle, Mike Milinkovich


Back to the top