Re: [Rdo-list] TripleO quickstart problem by deploying the overcloud
by Arash Kaffamanesh
Deleted the ironic nodes and ran openstack baremetal configure boot:
stack@undercloud ~]$ ironic node-list
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| UUID | Name | Instance UUID | Power
State | Provisioning State | Maintenance |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| 496caaf1-aef6-43ab-b863-f0330ea94217 | control-0 | None | None
| available | False |
| 27d032c9-1b18-4147-a299-1ac7b733bdcd | compute-0 | None | None
| available | False |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
but I'm getting a timeout after 120 seconds:
[stack@undercloud ~]$ openstack baremetal configure boot
Node 496caaf1-aef6-43ab-b863-f0330ea94217 power state is in
transition. *Waiting
up to 120 seconds for it to complete.*
Timed out waiting for node 496caaf1-aef6-43ab-b863-f0330ea94217 power state.
and after running ironic node-list again, the nodes go to Maintenance set
to True:
[stack@undercloud ~]$ ironic node-list
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| UUID | Name | Instance UUID | Power
State | Provisioning State | Maintenance |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| 496caaf1-aef6-43ab-b863-f0330ea94217 | control-0 | None | None
| available | True |
| 27d032c9-1b18-4147-a299-1ac7b733bdcd | compute-0 | None | None
| available | True |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
Thx!
Mit freundlichen Grüßen,
Arash Kaffamanesh
Like <https://www.facebook.com/cloudssky> | Follow
<https://twitter.com/CLOUDSSKYONE>
*Arash Kaffamanesh (GF)*
*Clouds Sky GmbH**Im Mediapark 4C*
*50670 Köln*
Tel.: +49 221 204 726 76
Mobile: +49 177 880 77 34
www.cloudssky.com
On Fri, Mar 25, 2016 at 9:42 PM, Dan Sneddon <dsneddon(a)redhat.com> wrote:
> On 03/25/2016 01:15 PM, Arash Kaffamanesh wrote:
> > Dan, thx!
> >
> > After running:
> >
> > [stack@undercloud ~]$ openstack baremetal configure boot
> >
> > nothing is get shown (and I'm somehow sure and guess that this step
> > does not complete successfully, but my current knowledge ans a
> > ooo-newbie doesn't allow to investigate this further for now :-)).
> >
> > And the introspection finishes too fast for my taste :-)
> >
> > [stack@undercloud ~]$ openstack baremetal introspection bulk start
> >
> > Setting nodes for introspection to manageable...
> >
> > Waiting for introspection to finish...
> >
> > Setting manageable nodes to available...
> >
> > Introspection completed.
> >
> >
> > And yes, I've a baremetal machine with 32 GB RAM and 160 GB SSD disk.
> >
> > And if I run ironic node-show I get the last error which states: node
> > state None does not match expected state.
> >
> >
> > [stack@undercloud ~]$ ironic node-show
> a62116c4-1daf-45e9-aa2d-ef8a4effdc20
> >
> >
> +------------------------+--------------------------------------------------------------------------+
> >
> > | Property | Value
> > |
> >
> >
> +------------------------+--------------------------------------------------------------------------+
> >
> > | target_power_state | None
> > |
> >
> > | extra | {}
> > |
> >
> > | last_error | During sync_power_state, max retries
> > exceeded for node a62116c4-1daf- |
> >
> > | | 45e9-aa2d-ef8a4effdc20, node state None does
> > not match expected state |
> >
> > | | 'None'. Updating DB state to 'None'
> > Switching node to maintenance mode. |
> >
> >
> > I also deleted the undercloud node and re-ran a fresh install of the
> > undercloud and I'm going to do a fresh baremetal install of the
> > virthost now and document all steps one by for the quickstart.
> >
> > One question: does the upstream documentation for TripleO work for
> > anyone (without quickstart?). For the virt-install I got the instack
> > running, but that was a nightmare :-)
> >
> > Thx,
> > -Arash
> >
> >
> >
> > Mit freundlichen Grüßen,
> > Arash Kaffamanesh
> >
> > Like <https://www.facebook.com/cloudssky> | Follow
> > <https://twitter.com/CLOUDSSKYONE>
> >
> > *Arash Kaffamanesh (GF)**
> >
> > Clouds Sky GmbH
> > **Im Mediapark 4C*
> >
> > *50670 Köln*
> >
> > Tel.: +49 221 204 726 76
> > Mobile: +49 177 880 77 34
> > www.cloudssky.com <http://www.cloudssky.com/>
> >
> > **
> >
> >
> > On Fri, Mar 25, 2016 at 8:20 PM, Dan Sneddon <dsneddon(a)redhat.com
> > <mailto:dsneddon@redhat.com>> wrote:
> >
> > On 03/25/2016 11:52 AM, Arash Kaffamanesh wrote:
> > > Hi,
> > >
> > > I'm trying to deploy OpenStack via TripleO quickstart in AIO / virt
> > > mode and I'm getting by the last step deploying the overcloud the
> > > following "Heat Stack create failed" message (There are not enough
> > > hosts available, due to Configuration has 4 errors, fix them before
> > > proceeding ????).
> > > *
> > > *
> > >
> > > After running openstack overcloud deploy I'm getting
> > *Configuration has
> > > 4 errors, fix them before proceeding*: (and I guess the problem
> lies
> > > somehow here with the "incorrectly configured driver_info"):
> > >
> > > [stack@undercloud ~]$ openstack overcloud deploy --templates
> > >
> > > Node uuid=a62116c4-1daf-45e9-aa2d-ef8a4effdc20 has an incorrectly
> > > configured driver_info/deploy_ramdisk. Expected
> > > "482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
> > >
> > > Node uuid=a62116c4-1daf-45e9-aa2d-ef8a4effdc20 has an incorrectly
> > > configured driver_info/deploy_kernel. Expected
> > > "482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
> > >
> > > Node uuid=cfc60017-36e8-4808-842d-8c65ffb5e4b1 has an incorrectly
> > > configured driver_info/deploy_ramdisk. Expected
> > > "482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
> > >
> > > Node uuid=cfc60017-36e8-4808-842d-8c65ffb5e4b1 has an incorrectly
> > > configured driver_info/deploy_kernel. Expected
> > > "482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
> > >
> > > *Configuration has 4 errors, fix them before proceeding.* Ignoring
> > > these errors is likely to lead to a failed deploy.
> > >
> > > Deploying templates in the directory
> > > /usr/share/openstack-tripleo-heat-templates
> > >
> > > 2016-03-25 17:45:13 [overcloud]: CREATE_IN_PROGRESS Stack CREATE
> started
> > >
> > > 2016-03-25 17:45:13 [MysqlRootPassword]: CREATE_IN_PROGRESS state
> changed
> > >
> > > 2016-03-25 17:45:14 [Networks]: CREATE_IN_PROGRESS state changed
> > >
> > > .......
> > >
> > > 2016-03-25 17:47:15 [overcloud]: CREATE_FAILED Resource CREATE
> failed:
> > > resources.Compute: ResourceInError:
> resources[0].resources.NovaCompute:
> > > Went to status ERROR due to "Message: No valid host was found.
> *There
> > > are not enough hosts available*., Code: 500"
> > >
> > > *Stack overcloud CREATE_FAILED*
> > >
> > > *Heat Stack create failed.*
> > >
> > > [stack@undercloud ~]$ heat stack-list
> > >
> > >
> +--------------------------------------+------------+---------------+---------------------+--------------+
> > >
> > > | id | stack_name |
> stack_status |
> > > creation_time | updated_time |
> > >
> > >
> +--------------------------------------+------------+---------------+---------------------+--------------+
> > >
> > > | 27fd6b76-7413-4e9b-9b5e-c7afb941ee0e | overcloud |
> > *CREATE_FAILED* |
> > > 2016-03-25T17:45:12 | None |
> > >
> > >
> +--------------------------------------+------------+---------------+---------------------+--------------+
> > >
> > >
> > > By the way I tried to get the stable liberty and the latest mitaka
> > > working with TripleO, no either worked.
> > > And tried also Lars's tutorial here:
> > >
> > >
> http://blog.oddbit.com/2016/02/19/deploy-an-ha-openstack-development-envir/
> > >
> > > had not so much luck, but could learn a lot and would prefer to
> learn
> > > more by running the ansible playbooks by hand as described by Lars.
> > >
> > > Any help / advice is much appreciated.
> > >
> > > Thx,
> > > -Arash
> > >
> > >
> > >
> > >
> > > _______________________________________________
> > > Rdo-list mailing list
> > > Rdo-list(a)redhat.com <mailto:Rdo-list@redhat.com>
> > > https://www.redhat.com/mailman/listinfo/rdo-list
> > >
> > > To unsubscribe: rdo-list-unsubscribe(a)redhat.com
> > <mailto:rdo-list-unsubscribe@redhat.com>
> > >
> >
> > This sounds like the nodes either weren't introspected properly, have
> > incorrect boot settings, or do not meet the criteria for your
> flavors.
> >
> > In particular, did you possibly forget to run "openstack baremetal
> > configure boot"? This has to be run after you import the nodes from
> > instack_env.json, and it will assign the kernel and ramdisk to the
> > nodes.
> >
> > The instructions for this process begin here:
> >
> http://docs.openstack.org/developer/tripleo-docs/basic_deployment/basic_d...
> >
> > You want to make sure that when you run "openstack baremetal
> > introspection bulk start" that the introspection completes
> > successfully. You can then use "ironic node-list" and "ironic
> node-show
> > <UUID>" to see the basic info about the host. The default baremetal
> > flavor requires 4G of RAM and 40G of hard drive space. Do your nodes
> > meet that minimum criteria? That's another cause of the "not enough
> > hosts available", although I think the configure boot setting is a
> more
> > likely culprit.
> >
> > If you are trying to assign nodes to roles (Controller, Compute,
> etc.),
> > then you will want to review this section:
> >
> >
> http://docs.openstack.org/developer/tripleo-docs/advanced_deployment/prof...
> >
> > --
> > Dan Sneddon | Principal OpenStack Engineer
> > dsneddon(a)redhat.com <mailto:dsneddon@redhat.com> |
> > redhat.com/openstack <http://redhat.com/openstack>
> > 650.254.4025 | dsneddon:irc @dxs:twitter
> >
> > _______________________________________________
> > Rdo-list mailing list
> > Rdo-list(a)redhat.com <mailto:Rdo-list@redhat.com>
> > https://www.redhat.com/mailman/listinfo/rdo-list
> >
> > To unsubscribe: rdo-list-unsubscribe(a)redhat.com
> > <mailto:rdo-list-unsubscribe@redhat.com>
> >
> >
>
> That introspection doesn't look right. Are you sure that you imported
> the nodes?
>
> "openstack baremetal import --json instackenv.json"
>
> You should then see the nodes actually being introspected. Does
> anything show up now in an "ironic node-list"? Try deleting whatever
> shows up in that list with "ironic node-delete <UUID>", then run the
> import command above, followed by "openstack baremetal configure boot",
> followed by "openstack baremetal introspection bulk start".
>
> Start here, and make sure you follow all the steps:
>
>
> http://docs.openstack.org/developer/tripleo-docs/basic_deployment/basic_d...
>
> --
> Dan Sneddon | Principal OpenStack Engineer
> dsneddon(a)redhat.com | redhat.com/openstack
> 650.254.4025 | dsneddon:irc @dxs:twitter
>
10 years
[Rdo-list] TripleO quickstart problem by deploying the overcloud
by Arash Kaffamanesh
Hi,
I'm trying to deploy OpenStack via TripleO quickstart in AIO / virt mode
and I'm getting by the last step deploying the overcloud the following
"Heat Stack create failed" message (There are not enough hosts available,
due to Configuration has 4 errors, fix them before proceeding ????).
After running openstack overcloud deploy I'm getting *Configuration has 4
errors, fix them before proceeding*: (and I guess the problem lies somehow
here with the "incorrectly configured driver_info"):
[stack@undercloud ~]$ openstack overcloud deploy --templates
Node uuid=a62116c4-1daf-45e9-aa2d-ef8a4effdc20 has an incorrectly
configured driver_info/deploy_ramdisk. Expected
"482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
Node uuid=a62116c4-1daf-45e9-aa2d-ef8a4effdc20 has an incorrectly
configured driver_info/deploy_kernel. Expected
"482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
Node uuid=cfc60017-36e8-4808-842d-8c65ffb5e4b1 has an incorrectly
configured driver_info/deploy_ramdisk. Expected
"482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
Node uuid=cfc60017-36e8-4808-842d-8c65ffb5e4b1 has an incorrectly
configured driver_info/deploy_kernel. Expected
"482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
*Configuration has 4 errors, fix them before proceeding.* Ignoring these
errors is likely to lead to a failed deploy.
Deploying templates in the directory
/usr/share/openstack-tripleo-heat-templates
2016-03-25 17:45:13 [overcloud]: CREATE_IN_PROGRESS Stack CREATE started
2016-03-25 17:45:13 [MysqlRootPassword]: CREATE_IN_PROGRESS state changed
2016-03-25 17:45:14 [Networks]: CREATE_IN_PROGRESS state changed
.......
2016-03-25 17:47:15 [overcloud]: CREATE_FAILED Resource CREATE failed:
resources.Compute: ResourceInError: resources[0].resources.NovaCompute:
Went to status ERROR due to "Message: No valid host was found. *There are
not enough hosts available*., Code: 500"
*Stack overcloud CREATE_FAILED*
*Heat Stack create failed.*
[stack@undercloud ~]$ heat stack-list
+--------------------------------------+------------+---------------+---------------------+--------------+
| id | stack_name | stack_status |
creation_time | updated_time |
+--------------------------------------+------------+---------------+---------------------+--------------+
| 27fd6b76-7413-4e9b-9b5e-c7afb941ee0e | overcloud | *CREATE_FAILED* |
2016-03-25T17:45:12 | None |
+--------------------------------------+------------+---------------+---------------------+--------------+
By the way I tried to get the stable liberty and the latest mitaka working
with TripleO, no either worked.
And tried also Lars's tutorial here:
http://blog.oddbit.com/2016/02/19/deploy-an-ha-openstack-development-envir/
had not so much luck, but could learn a lot and would prefer to learn more
by running the ansible playbooks by hand as described by Lars.
Any help / advice is much appreciated.
Thx,
-Arash
10 years
[Rdo-list] Mitaka RC1 current status
by Haïkel
Hi,
just to share with you the current status of Mitaka RC1 rebuilds
http://paste.fedoraproject.org/344632/45883006/
The bulk of it has been rebuilt using an automation script done by
flepied (thanks to him for that!)
Remaining packages are ones without stable/mitaka branches, or
tarballs, and one FTBFS (cloudkitty)
I'll be focusing now on packstack and tripleO in order that we can
test the current set of stable builds
Regards,
H.
10 years
[Rdo-list] rdoproject.org infra outage post-mortem #2
by Tristan Cacqueray
Hello folks,
here is a little note about what happened... The underlying cloud
(called rcip-dev) experienced an outage yesterday morning.
Anomalies observed:
* Mar 23 04:09:20 - compute - first AMQP error
* Mar 23 08:11:48 - controller - OOM killed nova-scheduler
* Mar 23 08:47:52 - controller - RabbitMQ service was unavailable
Possible root causes:
* PCS tried to restart the scheduler repeatedly and may have caused
pending AMQP connections to stall, potentially exhausting its
resources
* Nova databases wasn't purged and since nova-scheduler cache the whole
instances table it was overrun.
* nova-manage db archive_deleted_rows failed because of IntegrityError:
a foreign key constraint fails
* This result in a total of 70k instances and more than 120k
instance_actions_events to be loaded in nova-scheduler each time.
-> Manually cleaning the nova database of all deleted instances reduce
nova-scheduler memory to 80KB (down from >3GB)
* Then once rabbitmq was down, services started to fail.
However, the timestamps doesn't exactly match with the
trunk.rdoproject.org instance outage. Investigation is still on-going.
Timeline:
Mar 23 07:40:00 - apevec noticed trunk.rdoproject.org lost connectivity
Mar 23 09:00:00 - rabbitmq cluster rebuilt, controller node restarted
Mar 23 09:50:00 - service restored
Mar 23 10:13:00 - trunk.rdoproject.org restored after hard reboot
Services' API and instances are now nominals.
Regards,
-Tristan
10 years
[Rdo-list] Keystone eventlet vs WSGI
by Charles Short
Hi,
'Back in the days' when I was installing Kilo with Packstack I noticed
that Keystone was running by default as a WSGI process instead of a
Python eventlet.
This was due to the Keystone eventlet being deprecated.
I recently installed Liberty Triple0 on bare metal with three
controllers (Delorean stable branch) and was surprised to see that
Keystone was
running by default as a Python eventlet again!
I have found a related bug here -
https://bugzilla.redhat.com/show_bug.cgi?id=1264011
I need Keystone running as WSGI as this is a prerequisite for me to
install a VOMs plugin to federate.
Can anyone point me to the best (safest) way to change from eventlet to
WSGI manually (or indeed with templates)
Thanks
Charles
--
Charles Short
Cloud Engineer
Virtualization and Cloud Team
European Bioinformatics Institute (EMBL-EBI)
Tel: +44 (0)1223 494205
10 years
[Rdo-list] RDO meeting (2016-03-23) Minutes
by John Trowbridge
==============================
#rdo: RDO meeting (2016-03-23)
==============================
Meeting started by trown at 15:00:46 UTC. The full logs are available at
https://meetbot.fedoraproject.org/rdo/2016-03-23/rdo_meeting_(2016-03-23)...
.
Meeting summary
---------------
* LINK: agenda https://etherpad.openstack.org/p/RDO-Meeting (trown,
15:02:29)
* Defintion of Done for Mitaka release (trown, 15:03:57)
* LINK:
https://www.redhat.com/archives/rdo-list/2016-March/msg00118.html
(trown, 15:04:28)
* Packaging status of project-specific Horizon dashboards? (trown,
15:10:32)
* LINK:
https://github.com/javierpena/openstack-example-spec/blob/master/example-...
(apevec, 15:14:09)
* LINK: trello card for tracking
https://trello.com/c/Of7pkmjI/145-add-missing-ui-packages (trown,
15:22:35)
* RDO Mitaka in CBS status (trown, 15:24:44)
* LINK: https://bugs.centos.org/view.php?id=10593 (apevec, 15:35:09)
* new -pending tags have been requested (number80, 15:35:13)
* Update for discussions regarding making trunk repos more available
(trown, 15:36:47)
* Chair for next meeting? (trown, 15:45:11)
* ACTION: imcsk8 to chair for next meeting. (chandankumar, 15:47:30)
* open floor (trown, 15:47:49)
Meeting ended at 15:57:23 UTC.
Action Items
------------
* imcsk8 to chair for next meeting.
Action Items, by person
-----------------------
* imcsk8
* imcsk8 to chair for next meeting.
* **UNASSIGNED**
* (none)
People Present (lines said)
---------------------------
* apevec (65)
* trown (55)
* number80 (35)
* dmsimard (22)
* tosky (18)
* chandankumar (13)
* imcsk8 (11)
* jruzicka (8)
* tristanC (7)
* zodbot (7)
* jlibosva (4)
* derekh (3)
* hewbrocc` (2)
* hewbrocca (2)
* sshnaidm (1)
Generated by `MeetBot`_ 0.1.4
.. _`MeetBot`: http://wiki.debian.org/MeetBot
10 years
[Rdo-list] snat and my WRT54G router
by John Alway
Hello,
I'm still not able to get snat to work (connecting to the Internet) with my
RDO all-in-one installation, and I'm wondering if my router is the issue.
My router is a Linksys WRT54G, which does not support a "DHCP reservation"
feature. I was able to set a fixed ip on it, because there is a range
available from 192.168.1.2 through to 192.168.1.99, also 192.168.1.150
through 192.168.1.254.
This is according to "toomanydonuts" posting here:
http://community.linksys.com/t5/Wireless-Routers/WRT54G-Static-IP-Questio...
I've been using the lower address range. Could this be the problem, or
should I look elsewhere?
In my setup I have two private subnets, and three VMs. I can ping between
the VMs, but can't ping the Internet. A virtual router connects the
subnets and external network.
I set up my external subnet as 192.168.1.0/28. I use the 28 to limit the
range for my router. The external range is the same as my actual physical
addresses on my LAN.
I should add, I'm not a network guy. I'm learning a lot of networking on
the fly here.
Thanks for any feedback!!
...John
10 years
