November 2016 - dev - Rdo List Archives

[rdo-list] RDO-Infra Weekly Scrum Recap:

by Harry Rybacki

Greetings All, Links to the RDO-Infra team's scrum etherpad[1] and video recording[2] of the meeting are below. Highlights: - TripleO-Quickstart-extras has moved upstream[3] - Feature freeze on all roles on gerrithub, they have been -2'd, and work must be ported to reviews upstream - rlandy will break down the heat provisioning role and submit reviews against the new repo - A need still exists for baremetal/ovb core(s) - jpena discussed need for a gate for DLRN changes - Reviewed team Trello board[4] [1] - https://review.rdoproject.org/etherpad/p/rdo-infra-scrum [2] - https://bluejeans.com/s/cvDpM/ [3] - https://github.com/openstack/tripleo-quickstart-extras/ [4] - https://trello.com/b/HhXlqdiu/rdo /R Harry Rybacki

7 years, 11 months

1
0
0 / 0

[rdo-list] ask.openstack.org unanswered RDO questions

by Rich Bowen

30 unanswered questions: RDO newton release has support for RHEL 7.3 ? https://ask.openstack.org/en/question/99201/rdo-newton-release-has-suppor... Tags: rdo, rhel, openstack CPU Load on instance and Controller is very high and unresponsive https://ask.openstack.org/en/question/98927/cpu-load-on-instance-and-cont... Tags: mitaka-openstack [Error: No valid host was found.((Network br-ex error)) https://ask.openstack.org/en/question/98818/error-no-valid-host-was-found... Tags: br-ex Compute nodes are not visible after controller node rebooted https://ask.openstack.org/en/question/98654/compute-nodes-are-not-visible... Tags: rdo Live migration failing with qemu error "does not support drive-mirror" https://ask.openstack.org/en/question/98144/live-migration-failing-with-q... Tags: newton, nova, qemu, kvm, block-live-migration error while launching instance in openstack 'newton' using rdo packstack https://ask.openstack.org/en/question/98113/error-while-launching-instanc... Tags: rdo, newton, packstack How can I add a new region to an installed All-In-One RDO openstack? https://ask.openstack.org/en/question/98111/how-can-i-add-a-new-region-to... Tags: rdo, all-in-one, multi-region, region, add-region How to setup solr search engine for openstack swift https://ask.openstack.org/en/question/98093/how-to-setup-solr-search-engi... Tags: openstack, openstack-swift, newton, rdo Heat fails with 504 error. https://ask.openstack.org/en/question/98092/heat-fails-with-504-error/ Tags: rdo, tripleo, mitaka, heat Devstack and OpenvSwitch v2.3+ https://ask.openstack.org/en/question/98004/devstack-and-openvswitch-v23/ Tags: devstack, openvswitch How how does icmp packet travel across two compute nodes without br-int and br-tun running? https://ask.openstack.org/en/question/97905/how-how-does-icmp-packet-trav... Tags: neutron-ovs-pktflow "Parameter outiface failed on Firewall" during installation of openstack rdo on centos 7 https://ask.openstack.org/en/question/95657/parameter-outiface-failed-on-... Tags: rdo, devstack#mitaka multi nodes provider network ovs config https://ask.openstack.org/en/question/95423/multi-nodes-provider-network-... Tags: rdo, liberty-neutron Adding additional packages to an RDO installation https://ask.openstack.org/en/question/95380/adding-additional-packages-to... Tags: rdo, mistral RDO - is there any fedora package newer than puppet-4.2.1-3.fc24.noarch.rpm https://ask.openstack.org/en/question/94969/rdo-is-there-any-fedora-packa... Tags: rdo, puppet, install-openstack how to deploy haskell-distributed in RDO? https://ask.openstack.org/en/question/94785/how-to-deploy-haskell-distrib... Tags: rdo rdo tripleO liberty undercloud install failing https://ask.openstack.org/en/question/94023/rdo-tripleo-liberty-underclou... Tags: rdo, rdo-manager, liberty, undercloud, instack Liberty RDO: stack resource topology icons are pink https://ask.openstack.org/en/question/91347/liberty-rdo-stack-resource-to... Tags: resource, topology, dashboard, horizon, pink No handlers could be found for logger "oslo_config.cfg" while syncing the glance database https://ask.openstack.org/en/question/91169/no-handlers-could-be-found-fo... Tags: liberty, glance, install-openstack CentOS OpenStack - compute node can't talk https://ask.openstack.org/en/question/88989/centos-openstack-compute-node... Tags: rdo How to setup SWIFT_PROXY_NODE and SWIFT_STORAGE_NODEs separately on RDO Liberty ? https://ask.openstack.org/en/question/88897/how-to-setup-swift_proxy_node... Tags: rdo, liberty, swift, ha VM and container can't download anything from internet https://ask.openstack.org/en/question/88338/vm-and-container-cant-downloa... Tags: rdo, neutron, network, connectivity Fedora22, Liberty, horizon VNC console and keymap=sv with ; and/ https://ask.openstack.org/en/question/87451/fedora22-liberty-horizon-vnc-... Tags: keyboard, map, keymap, vncproxy, novnc OpenStack-Docker driver failed https://ask.openstack.org/en/question/87243/openstack-docker-driver-failed/ Tags: docker, openstack, liberty Routing between two tenants https://ask.openstack.org/en/question/84645/routing-between-two-tenants/ Tags: kilo, fuel, rdo, routing openstack baremetal introspection internal server error https://ask.openstack.org/en/question/82790/openstack-baremetal-introspec... Tags: rdo, ironic-inspector, tripleo Installing openstack using packstack (rdo) failed https://ask.openstack.org/en/question/82473/installing-openstack-using-pa... Tags: rdo, packstack, installation-error, keystone VMware Host Backend causes No valid host was found. Bug ??? https://ask.openstack.org/en/question/79738/vmware-host-backend-causes-no... Tags: vmware, rdo Mutlinode Devstack with two interfaces https://ask.openstack.org/en/question/78615/mutlinode-devstack-with-two-i... Tags: devstack, vlan, openstack Overcloud deployment on VM fails as IP address from DHCP is not assigned https://ask.openstack.org/en/question/66272/overcloud-deployment-on-vm-fa... Tags: overcloud_in_vm -- Rich Bowen - rbowen(a)redhat.com RDO Community Liaison http://rdoproject.org @RDOCommunity

7 years, 11 months

1
0
0 / 0

[rdo-list] os-collect-config, cnf endpoint and InternalAPI configuration

by Luca 'remix_tj' Lorenzetto

Hello rdo-list, i'm playing now with some stacks using OS::Heat::SoftwareDeployment (first time). I'm running Mitaka on this openstack setup. My stack is using the default signal_transport (CFN as far as i can understand). I've seen os-collect-config not working because after the startup configured in this way: /etc/os-collect-config.conf [DEFAULT] command = os-refresh-config collectors = ec2 collectors = cfn collectors = local [cfn] metadata_url = http://172.25.122.11:8000/v1/ stack_name = test_lab secret_access_key = 13c40f89a12142ca826e059788ad2258 access_key_id = 88111670b6fb41ef816696c871986d89 path = rundeck.Metadata I see that the metadata url is pointing to a right IP from the internal API pool. First question: should i find that url listed as endpoint with openstack endpoint list ? Second (and more important question): It's the right behavior connecting to the InternalAPI url for a VM? I set up my internal API network as a private network between openstack nodes, and it is not routed and not accessible with the rest of the world. Should i set this network as routed (and add default gateways to the hosts?) I tried to understand this from docs (i did the setup through TripleO) both from official, community and RH ones, but had no luck on clarifying this question. Thank you in advance for the explanations, Luca -- "E' assurdo impiegare gli uomini di intelligenza eccellente per fare calcoli che potrebbero essere affidati a chiunque se si usassero delle macchine" Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716) "Internet è la più grande biblioteca del mondo. Ma il problema è che i libri sono tutti sparsi sul pavimento" John Allen Paulos, Matematico (1945-vivente) Luca 'remix_tj' Lorenzetto, http://www.remixtj.net , <lorenzetto.luca(a)gmail.com>

7 years, 11 months

2
2
0 / 0

[rdo-list] CloudKitty failure to build in Liberty

by David Moreau Simard

Hi, With the EOL of Liberty, we'd like to do one last release of liberty before archiving it. However, CloudKitty has been failing to build for a good while now [1]. The listed maintainer [2] should be receiving an e-mail whenever there is a failure to build, it is important to react on those as fast as possible. Could you please address the issue ASAP ? We're available in #rdo on freenode if you need assistance. Thanks, [1]: https://trunk.rdoproject.org/centos7-liberty/report.html [2]: https://github.com/redhat-openstack/rdoinfo/blob/54bd0d750311a57a7d693bfd... David Moreau Simard Senior Software Engineer | Openstack RDO dmsimard = [irc, github, twitter]

7 years, 11 months

3
2
0 / 0

[rdo-list] ODL Integration with RDO Newton

by Dave Johnston

Hi, I'm attempting to integrate ODL with Newton. I'm hitting an issue when I start the neutron-server, it reports that it can't load the opendaylight driver. ERROR stevedore.extension [-] Could not load 'opendaylight': No module named opendaylight.driver I've installed the networking_odl package that contains the driver, is anyone aware of other changes that might be needed? -- Dave J

7 years, 11 months

2
1
0 / 0

[rdo-list] [Fedocal] Reminder meeting : RDO meeting

by hguemar＠fedoraproject.org

Dear all, You are kindly invited to the meeting: RDO meeting on 2016-11-23 from 15:00:00 to 16:00:00 UTC At rdo(a)irc.freenode.net The meeting will be about: RDO IRC meeting [Agenda at https://etherpad.openstack.org/p/RDO-Meeting ](https://etherpad.openstack.org/p/RDO-Meeting) Every Wednesday on #rdo on Freenode IRC Source: https://apps.fedoraproject.org/calendar/meeting/2017/

7 years, 11 months

1
0
0 / 0

[rdo-list] Strange API latency issue

by Christopher Brown

Hello, Wondering if anyone can shed any light on the following: I'm seeing a ~2 second delay in some API responses using Mitaka trunk. E.g. $ openstack endpoint list --timing <list of endpoints> +----------------------------------------------------------------------------+-----------+ | URL | Seconds | +----------------------------------------------------------------------------+-----------+ | GET http://PUBLIC_VIP:35357/v3 | 0.009938 | | POST http://PUBLIC_VIP:35357/v3/auth/tokens | 0.257309 | | POST http://PUBLIC_VIP:35357/v3/auth/tokens | 0.171096 | | GET http://PUBLIC_VIP:35357/ | 1.741362 | | GET http://PUBLIC_VIP:35357/v3/endpoints | 0.026326 | | GET http://PUBLIC_VIP:35357/v3/services/b28a9d7986684c52905ea2f45fd6dffe | 0.023991 | | GET http://PUBLIC_VIP:35357/v3/services/1fb856a569714d44b787868151f995b6 | 0.025029 | | GET http://PUBLIC_VIP:35357/v3/services/b28a9d7986684c52905ea2f45fd6dffe | 0.028141 | | GET http://PUBLIC_VIP:35357/v3/services/a857a42350e74106881534bcb19ebaf7 | 1.995946 | | GET http://PUBLIC_VIP:35357/v3/services/442c73aabbb141e6839002665c35579f | 0.022442 | | GET http://PUBLIC_VIP:35357/v3/services/d1a85a3b47de41aeb10a4ae087048a20 | 0.037483 | | GET http://PUBLIC_VIP:35357/v3/services/25c587016a16407fb682e36fe3f62532 | 1.939549 | | GET http://PUBLIC_VIP:35357/v3/services/1fb856a569714d44b787868151f995b6 | 0.031643 | | GET http://PUBLIC_VIP:35357/v3/services/8d072c313df44f639f9d30cdd6165621 | 0.032537 | | GET http://PUBLIC_VIP:35357/v3/services/442c73aabbb141e6839002665c35579f | 0.022227 | | GET http://PUBLIC_VIP:35357/v3/services/25c587016a16407fb682e36fe3f62532 | 1.974827 | | GET http://PUBLIC_VIP:35357/v3/services/734da843f77c4e4689b0772dbd6960f3 | 2.15859 | | GET http://PUBLIC_VIP:35357/v3/services/8d072c313df44f639f9d30cdd6165621 | 0.023067 | <snip> | Total | 11.086058 | +----------------------------------------------------------------------------+-----------+ 11 seconds is pretty good, can be anything up to 90 seconds. I have another installation which works fine, all response in milliseconds. I have deployed with network isolation and predictable IPs. The only situation where this does not seem to exhibit is if I disable the external network entirely using controll-no-external.yaml. -- Chris

7 years, 11 months

1
0
0 / 0

Re: [rdo-list] [TripleO] quickstart undercloud problems.

by Nate

Did you ever type up a lengthy email to a list, looking for help, and then the moment you hit send, a lightbulb goes on, and you fix your ow problem? Apparently when I built my test system, my build environment turned on iptables (like I've told it to) and it was too restrictive. I flushed iptables, and disabled puppet (so it wouldnt turn it back on again) rebooted the undercloud vm, and guess what? It's on the network now. Quickstart is now able to communicate with the undercloud vm. To anyone reading this, having a similar problem.... Check iptables. :headdesk: ----------- RHCSA, RHCE, RHCVA (#110-011-426) gpg public key: https://keybase.io/gangrif - or - MIT's public key server, pgp.mit.edu ----- Original Message ----- From: "war" <war(a)undrground.org> To: rdo-list(a)redhat.com Sent: Saturday, November 19, 2016 9:43:49 AM Subject: [rdo-list] [TripleO] quickstart undercloud problems. Good Morning rdo-list, im attempting to get a test openstack install up and running using RDO, and ooo quickstart on Centos 7. I'm following the brief instructions found here: https://www.rdoproject.org/tripleo/ I am running quickstart from the same system i'm targeting. So i'm setting $VIRTHOST to localhost, or the local IP of the box (192.168.3.10), I've tried it both ways, which doesn't seem to make a difference. I'm running quickstart as my local use, not the stack user. Initially things appear to run along nicely, the script downloads images and whatnot, it even starts up the undercloud vm as the stack user. [stack@fog ~]$ virsh list Id Name State ---------------------------------------------------- 2 undercloud running When quickstart gets to the point where it's attempting to determine the IP of the undercloud VM, it fails. I did a little digging on how exactly that works, and found that the script which it runs is not getting any results. >From the script: mac=$(virsh dumpxml $VMNAME | awk -F "'" '/mac address/ { print $2; exit }') # Look up the MAC address in the ARP table. ip=$(ip neigh | grep $mac | awk '{print $1;}') I've tried these manually, and sure enough the mac address is not in ip neigh. stack@fog .quickstart]$ virsh dumpxml undercloud | awk -F "'" '/mac address/ { print $2; exit }' 00:e4:b2:54:b5:fb [stack@fog .quickstart]$ ip neigh | grep '00:e4:b2:54:b5:fb' | awk '{print $1;}' [stack@fog .quickstart]$ ip neigh | grep -v FAILED 192.168.3.1 dev enp13s0 lladdr 52:54:00:ab:d2:15 REACHABLE 192.168.3.251 dev enp13s0 lladdr 52:54:00:f2:90:b7 REACHABLE [stack@fog .quickstart]$ I did a virsh console on the undercloud vm, and reset it, so I could watch it boot, and I see the following in the boot messages: [FAILED] Failed to start LSB: Bring up/down networking. See 'systemctl status network.service' for details. I cant login to the undercloud vm, as I don't have the local username/pass. or I'd troubleshoot that further. As far as I can tell the undercloud system uses standard linux bridges to setup network communication, They appear present, but as they're not configured in the same manner i've used in the past, I can't be certain if they're working properly. [stack@fog ~]$ brctl show bridge name bridge id STP enabled interfaces brext 8000.525400af4796 no brext-nic tap0 brovc 8000.525400180812 no brovc-nic tap1 virbr0 8000.525400a3f6b5 yes virbr0-nic [stack@fog ~]$ ifconfig brext-nic brext-nic: flags=4098<BROADCAST,MULTICAST> mtu 1500 ether 52:54:00:af:47:96 txqueuelen 500 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 [stack@fog ~]$ ifconfig brovc-nic brovc-nic: flags=4098<BROADCAST,MULTICAST> mtu 1500 ether 52:54:00:18:08:12 txqueuelen 500 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 I've tried some other basics, like setting selinux to permissinv and re-trying (which was a long shot) and it didn't help. Any suggestions on what to tr next would be helpful. Thanks! ----------- RHCSA, RHCE, RHCVA (#110-011-426) gpg public key: https://keybase.io/gangrif - or - MIT's public key server, pgp.mit.edu _______________________________________________ rdo-list mailing list rdo-list(a)redhat.com https://www.redhat.com/mailman/listinfo/rdo-list To unsubscribe: rdo-list-unsubscribe(a)redhat.com

7 years, 11 months

2
1
0 / 0

[rdo-list] [TripleO] quickstart undercloud problems.

by Nate

Good Morning rdo-list, im attempting to get a test openstack install up and running using RDO, and ooo quickstart on Centos 7. I'm following the brief instructions found here: https://www.rdoproject.org/tripleo/ I am running quickstart from the same system i'm targeting. So i'm setting $VIRTHOST to localhost, or the local IP of the box (192.168.3.10), I've tried it both ways, which doesn't seem to make a difference. I'm running quickstart as my local use, not the stack user. Initially things appear to run along nicely, the script downloads images and whatnot, it even starts up the undercloud vm as the stack user. [stack@fog ~]$ virsh list Id Name State ---------------------------------------------------- 2 undercloud running When quickstart gets to the point where it's attempting to determine the IP of the undercloud VM, it fails. I did a little digging on how exactly that works, and found that the script which it runs is not getting any results. >From the script: mac=$(virsh dumpxml $VMNAME | awk -F "'" '/mac address/ { print $2; exit }') # Look up the MAC address in the ARP table. ip=$(ip neigh | grep $mac | awk '{print $1;}') I've tried these manually, and sure enough the mac address is not in ip neigh. stack@fog .quickstart]$ virsh dumpxml undercloud | awk -F "'" '/mac address/ { print $2; exit }' 00:e4:b2:54:b5:fb [stack@fog .quickstart]$ ip neigh | grep '00:e4:b2:54:b5:fb' | awk '{print $1;}' [stack@fog .quickstart]$ ip neigh | grep -v FAILED 192.168.3.1 dev enp13s0 lladdr 52:54:00:ab:d2:15 REACHABLE 192.168.3.251 dev enp13s0 lladdr 52:54:00:f2:90:b7 REACHABLE [stack@fog .quickstart]$ I did a virsh console on the undercloud vm, and reset it, so I could watch it boot, and I see the following in the boot messages: [FAILED] Failed to start LSB: Bring up/down networking. See 'systemctl status network.service' for details. I cant login to the undercloud vm, as I don't have the local username/pass. or I'd troubleshoot that further. As far as I can tell the undercloud system uses standard linux bridges to setup network communication, They appear present, but as they're not configured in the same manner i've used in the past, I can't be certain if they're working properly. [stack@fog ~]$ brctl show bridge name bridge id STP enabled interfaces brext 8000.525400af4796 no brext-nic tap0 brovc 8000.525400180812 no brovc-nic tap1 virbr0 8000.525400a3f6b5 yes virbr0-nic [stack@fog ~]$ ifconfig brext-nic brext-nic: flags=4098<BROADCAST,MULTICAST> mtu 1500 ether 52:54:00:af:47:96 txqueuelen 500 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 [stack@fog ~]$ ifconfig brovc-nic brovc-nic: flags=4098<BROADCAST,MULTICAST> mtu 1500 ether 52:54:00:18:08:12 txqueuelen 500 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 I've tried some other basics, like setting selinux to permissinv and re-trying (which was a long shot) and it didn't help. Any suggestions on what to tr next would be helpful. Thanks! ----------- RHCSA, RHCE, RHCVA (#110-011-426) gpg public key: https://keybase.io/gangrif - or - MIT's public key server, pgp.mit.edu

7 years, 11 months

1
0
0 / 0

Re: [rdo-list] [TripleO] Newton large baremetal deployment issues

by Charles Short

Hi, So I have finally tried OSP9 and here are the results - 3 Controllers 40 compute - 1 hours 20 mins to deploy. This is much more the sort of deployment time I was expecting :) I then tried TripleO Newton Stable again with 3 Controllers 40 Compute - 4 hours and counting..... The two deployment scripts (for OSP9 and TripleO Newton) were pretty much identical (allowing for any changes between releases) During the OSP9 deployment I could use nova list to list the nodes. The Undercloud API access was in general very responsive. During the TripleO Newton deployment 'nova list' hangs - ERROR (ClientException): The server has either erred or is incapable of performing the requested operation. (HTTP 500) Undercloud API access was very sluggish. I noticed Keystone was stuck at 140% for most of the deployment (albeit multi threaded) which is not the case for OSP9. I know it is hard to compare two releases, but the difference is enormous. I will stick with OSP9 for now as this for me works properly out of the box for large deployments. Charles On 14/11/2016 09:01, Charles Short wrote: > Hi Graeme, > > Thanks for the reply. > > I used these images - > > http://buildlogs.centos.org/centos/7/cloud/x86_64/tripleo_images/newton/d... > > > I installed the stable repo following the documentation here - > > http://docs.openstack.org/developer/tripleo-docs/installation/installatio... > > > for example - > > sudo curl -L -o /etc/yum.repos.d/delorean-newton.repo > https://trunk.rdoproject.org/centos7-newton/current/delorean.repo > > sudo curl -L -o /etc/yum.repos.d/delorean-deps-newton.repo > http://trunk.rdoproject.org/centos7-newton/delorean-deps.repo > > > The difficulty I am having is that when I test with a small deployment > all works fine. So you would assume just adding more compute nodes > would not be an issue. > Testing this is painful due to the time it takes for a large > deployment to fail. It seems to be only scale that is the issue. > > I will try and get you some logs > > Regards > > Charles > > > >> So the symptoms you are showing me above almost definitely leads me to >> believe that neutron-server failed on the undercloud, which would >> explain why the deploy and nova failed to work. It could have failed >> before or during the deploy. We regularly see instances where >> neutron-server times out upon system boot (takes slightly longer to >> start than systemd expects), so we need to start it manually. >> >> To be clear, The undercloud has been installed using this repo >> >> http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-newton-tested/ >> >> >> Which overcloud images are you using? I'm not seeing any provided in >> that repo, and I just want to make sure the undercloud and overcloud >> packages match (as the tripleo-heat-templates package on the undercloud >> has to align with the openstack-puppet-modules package on the overcloud >> iamges). >> >> Also, is it possible to get a copy of all the neutron-server log from >> the undercloud? If we can understand why neutron-server failed, that is >> the first step towards getting a working deployment. >> >> It would be great if we could get a full sosreport with all the system >> logs, to check for other errors. I'm assuming there were no problems >> with the 'openstack undercloud install' process? >> >> Regards, >> >> Graeme >> > -- Charles Short Cloud Engineer Virtualization and Cloud Team European Bioinformatics Institute (EMBL-EBI) Tel: +44 (0)1223 494205

7 years, 11 months

4
6
0 / 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

dev November 2016