[rdo-list] logs.rdoproject.org pruning

[David Moreau Simard]

The idea is to maximize our usage of this 2TB without going over a
certain treshold.
We'll tweak retention to keep logs as long as possible while keeping
sufficient enough buffer in terms of space.

For now we're trying 60 days, if we can do it and stay within that
treshold, we'll keep 60 days!

David Moreau Simard
Senior Software Engineer | OpenStack RDO

dmsimard = [irc, github, twitter]


On Mon, Oct 16, 2017 at 10:05 PM, Wesley Hayutin <whayutin at redhat.com> wrote:
> Thanks David,
> I think 30 - 35 days is sufficient for your reference.
> The upstream requirement is 30 days :)
> Thanks for taking care of it!!
>
> On Mon, Oct 16, 2017 at 8:43 PM, David Moreau Simard <dms at redhat.com> wrote:
>>
>> Hi,
>>
>> We've hit 1.5TB out of 2TB on logs.rdoproject.org and it's time to
>> look at what kind of retention this gets us.
>> logs.rdoproject.org aggregates logs from ci.centos.org,
>> review.rdoproject.org as well as third party logs.
>>
>> We have about 90 days worth of data right now but we're also
>> increasing the pace at which we're uploading new data as we are
>> migrating new TripleO jobs to review.rdoproject.org.
>> I've set pruning to 60 days for the time being and we will monitor how
>> things are looking in the near future.
>>
>> David Moreau Simard
>> Senior Software Engineer | OpenStack RDO
>>
>> dmsimard = [irc, github, twitter]
>
>