[rdo-list] CentOS 7.3 /libvirt 2 / qemu-kvm-ev-2.6.0 tap device down after soft reboot
by Van Leeuwen, Robert
Hello,
We are seeing that a soft-reboot will keep the tap interface in a down state with the latest CentOS 7.3 / libvirt 2/ qemu-kvm-ev-2.6.0
(the interface always goes down but with the virsh start is should get back into an up state)
Doing a ip link up on the interface will make it work again.
Anyone else experiencing the same problem?
It could also be something that needs to be patched in the SDN software we use ( From libvirts perspective we use interface type='ethernet' )
With centos 7.2 the SDN worked fine though.
Would be great if we would know if this is a widespread problem or something in our specific setup.
For now we patched the nova code to work around it but it would be great to get it fixed properly.
Thx,
Robert van Leeuwen
7 years, 9 months
[rdo-list] Issues with Ceph 0.94.6 on Mitaka and updating to 0.94.9 (Trunk promotion)
by David Moreau Simard
Hi,
The Mitaka pipeline hasn't promoted in >70 days now [1]. That's a huge problem.
It looks like jobs are reliably passing recently except for one which
I could not figure out until now.
The issue is the following in puppet-openstack-integration scenario001:
Error: /Stage[main]/Openstack_integration::Provision/Glance_image[cirros]/ensure:
change from absent to present failed: Command: 'openstack ["image",
"create", "--format", "shell", ["cirros", "--public",
"--container-format=bare", "--disk-format=qcow2",
"--file=/tmp/openstack/tempest/cirros-0.3.4-x86_64-disk.img"]]' has
been running for more than 170 seconds
For some reasons still unknown, we are unable to reproduce this error
outside of the ci.centos.org Mitaka promotion pipeline.
Against seemingly the same packages, CentOS version, trunk
repositories and everything else, we don't encounter this issue in the
OpenStack gate.
When trying to reproduce the problem manually locally, either on
virtual machines or on a ci.centos.org duffy node, we usually run into
other issues (ceph key injection errors).
Anyway, I launched a Mitaka job manually and disabled node release --
it predictably failed with the same Cirros image error [2].
When trying to troubleshoot directly on the node, it's obvious that
the issue is Ceph that is inexplicably hanging. There are no obvious
errors in logs.
Even bypassing OpenStack completely, some Ceph commands have a hard
time finishing and doing a "rbd create" manually hangs.
I tried a variety of things before ending up tentatively updating Ceph
to 0.94.9 which I recently built in CBS and the issue instantly
disappeared.
I could create images manually with "rbd create", create images with
glance and so on.
I posted about needing a hand testing 0.94.9 on centos-devel [3].
I would appreciate a spot check ASAP as it looks like everything else
is green for Mitaka right now and we're long overdue for a release.
Thanks !
[1]: https://dashboards.rdoproject.org/rdo-dev
[2]: https://ci.centos.org/job/weirdo-mitaka-promote-puppet-openstack-scenario...
[3]: https://lists.centos.org/pipermail/centos-devel/2017-February/015655.html
David Moreau Simard
Senior Software Engineer | Openstack RDO
dmsimard = [irc, github, twitter]
7 years, 9 months
Re: [rdo-list] [Ci-users] CI Maintenance Window 01-Feb-2017 20:00 US-Eastern (02-Feb-2017 01:00 UTC)
by David Moreau Simard
Please note that we will also use this maintenance window as an
opportunity to upgrade the ci.centos.org OpenStack cloud to CentOS 7.3
and to the latest packages of the Newton release.
David Moreau Simard
Senior Software Engineer | Openstack RDO
dmsimard = [irc, github, twitter]
On Sat, Jan 28, 2017 at 2:58 AM, Brian Stinson <brian(a)bstinson.com> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
>
> Hi Folks,
>
> We will be issuing a 1hr maintenance window at 20:00 Eastern Time on
> 01-Feb-2017 for package/kernel upgrades on the Jenkins Slaves, and to
> update to the latest Jenkins LTS.
>
> If you have not commented on the Ansible thread yet, this is the last
> chance to ACK/NAK an upgrade to Ansible 2.2 on the slaves:
>
> https://lists.centos.org/pipermail/ci-users/2017-January/000479.html
>
> As usual we will start the quiet period 1 hour before the window begins
> in order to allow for jobs to finish.
>
> Cheers!
>
> - --
> Brian Stinson
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.0.22 (GNU/Linux)
>
> iQIcBAEBAgAGBQJYjE8wAAoJEIMGvNKzCweMe+oQAIpDFYR1LaQAitrxmvzBH+Ew
> D/eiOHJz/9Ver3Bh5HXU9FGNa3qR/r7IkOVpFjneYFXp14WPe8vbcZqORGDT3HO7
> 2ULjeHIOUZUoINrds48kyF0VjVvtg/Ix2BIn66iCey9I5ndP3Ycs9sdxhtF5Zv97
> Geq8UJPjJO8WDYq3vyAFWuA9JT8F+v9f6XZ+0+6joD/lJMAliWLiWDUvZCTkjL7q
> YUVB+8BSp/92xhnLSXpTkt/5T66tKbUxLBln2o/2GPcmrv7YqUe6hF65vTo4F1u4
> g/j+Egq1UFQnFpFq2H7tZ8oSzBc9vUeZ8xwI5W8qUAGXOIVZGUb2sx3LPAhbgTEB
> xqsqdSRA+YId/ZWkaSnSauEpevUQsLoTSLClegbf7t3xLTV30O+xa68lSkhCzID7
> sZAYErvxMIjYMIIJUWcuyfOJmTGfc0xzLycetK4lzdYerX1tBMZZmzPCoxWatYYt
> RomPqct6oYWh3sCWylwqOws3rwzZpoWknTheHOUwANvtjUmT9HCXc/4bYJqXyyG9
> RUcR1ym3XiWey3DS7k3zNQ4EGyU+FfuRo0gSGayec5ccr67NokBTSs9k+wWH7tCq
> US3s4CdnteCqwjoXruLox0F0p9gsBrGirmeQ0qM5y/M0Jo8bHNIASF2ta58TRlux
> 25torhV1nnNUHnHLXW6i
> =nDfw
> -----END PGP SIGNATURE-----
> _______________________________________________
> Ci-users mailing list
> Ci-users(a)centos.org
> https://lists.centos.org/mailman/listinfo/ci-users
7 years, 9 months
