[rdo-list] Outage: RDO Infrastructure

[Honza Pokorny]

I'm still experiencing issues:

When running (which I run regularly, and it usually works for me):

    $ bash devmode.sh --no-gate --ovb --delete-all-stacks

I get the following error:



TASK [ovb-manage-stack : Return stack state] ***********************************
task path: /home/hpokorny/.quickstart/usr/local/share/ansible/roles/ovb-manage-stack/tasks/ovb-create-stack.yml:68
Friday 08 September 2017  11:12:22 -0300 (0:00:10.345)       0:01:05.262 ******
changed: [localhost] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}

TASK [ovb-manage-stack : Show stack status] ************************************
task path: /home/hpokorny/.quickstart/usr/local/share/ansible/roles/ovb-manage-stack/tasks/ovb-create-stack.yml:92
Friday 08 September 2017  11:13:06 -0300 (0:00:43.858)       0:01:49.120 ******
ok: [localhost] => {
    "stack_status.stdout_lines": [
        "| stack_status          | CREATE_FAILED                                                                                                                                            |"
    ]
}

TASK [ovb-manage-stack : Fail if stack did not deploy successfully] ************
task path: /home/hpokorny/.quickstart/usr/local/share/ansible/roles/ovb-manage-stack/tasks/ovb-create-stack.yml:96
Friday 08 September 2017  11:13:06 -0300 (0:00:00.086)       0:01:49.207 ******
fatal: [localhost]: FAILED! => {"changed": false, "failed": true, "msg": "Stack oooq-923-hpokorny--stack did not deploy successfully. See the stack status message above."}

PLAY RECAP *********************************************************************
localhost                  : ok=15   changed=5    unreachable=0    failed=1






It's very repeatable.  Is that related to the outage?

Thanks

Honza Pokorny

On 2017-09-07 22:32, David Moreau Simard wrote:
> We confirm that everything is back online and appears to be in order.
> 
> Please let us know here or on #rdo on freenode if you notice anything unusual.
> 
> Thanks.
> 
> David Moreau Simard
> Senior Software Engineer | OpenStack RDO
> 
> dmsimard = [irc, github, twitter]
> 
> 
> On Thu, Sep 7, 2017 at 9:04 PM, David Moreau Simard <dms at redhat.com> wrote:
> > Things have started recovering progressively for the past hour or so.
> >
> > We're currently going through our servers to ensure everything is healthy.
> >
> > David Moreau Simard
> > Senior Software Engineer | OpenStack RDO
> >
> > dmsimard = [irc, github, twitter]
> >
> >
> > On Thu, Sep 7, 2017 at 4:05 PM, David Moreau Simard <dms at redhat.com> wrote:
> >> Hi,
> >>
> >> There is currently an infrastructure outage affecting parts of RDO's
> >> infrastructure, for example:
> >> - logs.rdoproject.org, thirdparty.logs.rdoproject.org &
> >> centos.logs.rdoproject.org
> >> - review.rdoproject.org
> >> - www.rdoproject.org
> >> - registry.rdoproject.org
> >> - images.rdoproject.org
> >> - Parts of third party CI against review.openstack.org
> >>
> >> Mirrors providing RDO packages such as trunk.rdoproject.org,
> >> buildlogs.centos.org and mirror.centos.org are unaffected.
> >> However, new trunk package builds are not currently being processed.
> >>
> >> Engineers are already working on resolving the situation and we'll
> >> provide an update ASAP.
> >>
> >> Thanks,
> >>
> >> David Moreau Simard
> >> Senior Software Engineer | OpenStack RDO
> >>
> >> dmsimard = [irc, github, twitter]
> 
> _______________________________________________
> rdo-list mailing list
> rdo-list at redhat.com
> https://www.redhat.com/mailman/listinfo/rdo-list
> 
> To unsubscribe: rdo-list-unsubscribe at redhat.com