Re: [Rdo-list] TripleO quickstart problem by deploying the overcloud
by Arash Kaffamanesh
Deleted the ironic nodes and ran openstack baremetal configure boot:
stack@undercloud ~]$ ironic node-list
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| UUID | Name | Instance UUID | Power
State | Provisioning State | Maintenance |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| 496caaf1-aef6-43ab-b863-f0330ea94217 | control-0 | None | None
| available | False |
| 27d032c9-1b18-4147-a299-1ac7b733bdcd | compute-0 | None | None
| available | False |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
but I'm getting a timeout after 120 seconds:
[stack@undercloud ~]$ openstack baremetal configure boot
Node 496caaf1-aef6-43ab-b863-f0330ea94217 power state is in
transition. *Waiting
up to 120 seconds for it to complete.*
Timed out waiting for node 496caaf1-aef6-43ab-b863-f0330ea94217 power state.
and after running ironic node-list again, the nodes go to Maintenance set
to True:
[stack@undercloud ~]$ ironic node-list
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| UUID | Name | Instance UUID | Power
State | Provisioning State | Maintenance |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| 496caaf1-aef6-43ab-b863-f0330ea94217 | control-0 | None | None
| available | True |
| 27d032c9-1b18-4147-a299-1ac7b733bdcd | compute-0 | None | None
| available | True |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
Thx!
Mit freundlichen Grüßen,
Arash Kaffamanesh
Like <https://www.facebook.com/cloudssky> | Follow
<https://twitter.com/CLOUDSSKYONE>
*Arash Kaffamanesh (GF)*
*Clouds Sky GmbH**Im Mediapark 4C*
*50670 Köln*
Tel.: +49 221 204 726 76
Mobile: +49 177 880 77 34
www.cloudssky.com
On Fri, Mar 25, 2016 at 9:42 PM, Dan Sneddon <dsneddon(a)redhat.com> wrote:
> On 03/25/2016 01:15 PM, Arash Kaffamanesh wrote:
> > Dan, thx!
> >
> > After running:
> >
> > [stack@undercloud ~]$ openstack baremetal configure boot
> >
> > nothing is get shown (and I'm somehow sure and guess that this step
> > does not complete successfully, but my current knowledge ans a
> > ooo-newbie doesn't allow to investigate this further for now :-)).
> >
> > And the introspection finishes too fast for my taste :-)
> >
> > [stack@undercloud ~]$ openstack baremetal introspection bulk start
> >
> > Setting nodes for introspection to manageable...
> >
> > Waiting for introspection to finish...
> >
> > Setting manageable nodes to available...
> >
> > Introspection completed.
> >
> >
> > And yes, I've a baremetal machine with 32 GB RAM and 160 GB SSD disk.
> >
> > And if I run ironic node-show I get the last error which states: node
> > state None does not match expected state.
> >
> >
> > [stack@undercloud ~]$ ironic node-show
> a62116c4-1daf-45e9-aa2d-ef8a4effdc20
> >
> >
> +------------------------+--------------------------------------------------------------------------+
> >
> > | Property | Value
> > |
> >
> >
> +------------------------+--------------------------------------------------------------------------+
> >
> > | target_power_state | None
> > |
> >
> > | extra | {}
> > |
> >
> > | last_error | During sync_power_state, max retries
> > exceeded for node a62116c4-1daf- |
> >
> > | | 45e9-aa2d-ef8a4effdc20, node state None does
> > not match expected state |
> >
> > | | 'None'. Updating DB state to 'None'
> > Switching node to maintenance mode. |
> >
> >
> > I also deleted the undercloud node and re-ran a fresh install of the
> > undercloud and I'm going to do a fresh baremetal install of the
> > virthost now and document all steps one by for the quickstart.
> >
> > One question: does the upstream documentation for TripleO work for
> > anyone (without quickstart?). For the virt-install I got the instack
> > running, but that was a nightmare :-)
> >
> > Thx,
> > -Arash
> >
> >
> >
> > Mit freundlichen Grüßen,
> > Arash Kaffamanesh
> >
> > Like <https://www.facebook.com/cloudssky> | Follow
> > <https://twitter.com/CLOUDSSKYONE>
> >
> > *Arash Kaffamanesh (GF)**
> >
> > Clouds Sky GmbH
> > **Im Mediapark 4C*
> >
> > *50670 Köln*
> >
> > Tel.: +49 221 204 726 76
> > Mobile: +49 177 880 77 34
> > www.cloudssky.com <http://www.cloudssky.com/>
> >
> > **
> >
> >
> > On Fri, Mar 25, 2016 at 8:20 PM, Dan Sneddon <dsneddon(a)redhat.com
> > <mailto:dsneddon@redhat.com>> wrote:
> >
> > On 03/25/2016 11:52 AM, Arash Kaffamanesh wrote:
> > > Hi,
> > >
> > > I'm trying to deploy OpenStack via TripleO quickstart in AIO / virt
> > > mode and I'm getting by the last step deploying the overcloud the
> > > following "Heat Stack create failed" message (There are not enough
> > > hosts available, due to Configuration has 4 errors, fix them before
> > > proceeding ????).
> > > *
> > > *
> > >
> > > After running openstack overcloud deploy I'm getting
> > *Configuration has
> > > 4 errors, fix them before proceeding*: (and I guess the problem
> lies
> > > somehow here with the "incorrectly configured driver_info"):
> > >
> > > [stack@undercloud ~]$ openstack overcloud deploy --templates
> > >
> > > Node uuid=a62116c4-1daf-45e9-aa2d-ef8a4effdc20 has an incorrectly
> > > configured driver_info/deploy_ramdisk. Expected
> > > "482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
> > >
> > > Node uuid=a62116c4-1daf-45e9-aa2d-ef8a4effdc20 has an incorrectly
> > > configured driver_info/deploy_kernel. Expected
> > > "482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
> > >
> > > Node uuid=cfc60017-36e8-4808-842d-8c65ffb5e4b1 has an incorrectly
> > > configured driver_info/deploy_ramdisk. Expected
> > > "482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
> > >
> > > Node uuid=cfc60017-36e8-4808-842d-8c65ffb5e4b1 has an incorrectly
> > > configured driver_info/deploy_kernel. Expected
> > > "482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
> > >
> > > *Configuration has 4 errors, fix them before proceeding.* Ignoring
> > > these errors is likely to lead to a failed deploy.
> > >
> > > Deploying templates in the directory
> > > /usr/share/openstack-tripleo-heat-templates
> > >
> > > 2016-03-25 17:45:13 [overcloud]: CREATE_IN_PROGRESS Stack CREATE
> started
> > >
> > > 2016-03-25 17:45:13 [MysqlRootPassword]: CREATE_IN_PROGRESS state
> changed
> > >
> > > 2016-03-25 17:45:14 [Networks]: CREATE_IN_PROGRESS state changed
> > >
> > > .......
> > >
> > > 2016-03-25 17:47:15 [overcloud]: CREATE_FAILED Resource CREATE
> failed:
> > > resources.Compute: ResourceInError:
> resources[0].resources.NovaCompute:
> > > Went to status ERROR due to "Message: No valid host was found.
> *There
> > > are not enough hosts available*., Code: 500"
> > >
> > > *Stack overcloud CREATE_FAILED*
> > >
> > > *Heat Stack create failed.*
> > >
> > > [stack@undercloud ~]$ heat stack-list
> > >
> > >
> +--------------------------------------+------------+---------------+---------------------+--------------+
> > >
> > > | id | stack_name |
> stack_status |
> > > creation_time | updated_time |
> > >
> > >
> +--------------------------------------+------------+---------------+---------------------+--------------+
> > >
> > > | 27fd6b76-7413-4e9b-9b5e-c7afb941ee0e | overcloud |
> > *CREATE_FAILED* |
> > > 2016-03-25T17:45:12 | None |
> > >
> > >
> +--------------------------------------+------------+---------------+---------------------+--------------+
> > >
> > >
> > > By the way I tried to get the stable liberty and the latest mitaka
> > > working with TripleO, no either worked.
> > > And tried also Lars's tutorial here:
> > >
> > >
> http://blog.oddbit.com/2016/02/19/deploy-an-ha-openstack-development-envir/
> > >
> > > had not so much luck, but could learn a lot and would prefer to
> learn
> > > more by running the ansible playbooks by hand as described by Lars.
> > >
> > > Any help / advice is much appreciated.
> > >
> > > Thx,
> > > -Arash
> > >
> > >
> > >
> > >
> > > _______________________________________________
> > > Rdo-list mailing list
> > > Rdo-list(a)redhat.com <mailto:Rdo-list@redhat.com>
> > > https://www.redhat.com/mailman/listinfo/rdo-list
> > >
> > > To unsubscribe: rdo-list-unsubscribe(a)redhat.com
> > <mailto:rdo-list-unsubscribe@redhat.com>
> > >
> >
> > This sounds like the nodes either weren't introspected properly, have
> > incorrect boot settings, or do not meet the criteria for your
> flavors.
> >
> > In particular, did you possibly forget to run "openstack baremetal
> > configure boot"? This has to be run after you import the nodes from
> > instack_env.json, and it will assign the kernel and ramdisk to the
> > nodes.
> >
> > The instructions for this process begin here:
> >
> http://docs.openstack.org/developer/tripleo-docs/basic_deployment/basic_d...
> >
> > You want to make sure that when you run "openstack baremetal
> > introspection bulk start" that the introspection completes
> > successfully. You can then use "ironic node-list" and "ironic
> node-show
> > <UUID>" to see the basic info about the host. The default baremetal
> > flavor requires 4G of RAM and 40G of hard drive space. Do your nodes
> > meet that minimum criteria? That's another cause of the "not enough
> > hosts available", although I think the configure boot setting is a
> more
> > likely culprit.
> >
> > If you are trying to assign nodes to roles (Controller, Compute,
> etc.),
> > then you will want to review this section:
> >
> >
> http://docs.openstack.org/developer/tripleo-docs/advanced_deployment/prof...
> >
> > --
> > Dan Sneddon | Principal OpenStack Engineer
> > dsneddon(a)redhat.com <mailto:dsneddon@redhat.com> |
> > redhat.com/openstack <http://redhat.com/openstack>
> > 650.254.4025 | dsneddon:irc @dxs:twitter
> >
> > _______________________________________________
> > Rdo-list mailing list
> > Rdo-list(a)redhat.com <mailto:Rdo-list@redhat.com>
> > https://www.redhat.com/mailman/listinfo/rdo-list
> >
> > To unsubscribe: rdo-list-unsubscribe(a)redhat.com
> > <mailto:rdo-list-unsubscribe@redhat.com>
> >
> >
>
> That introspection doesn't look right. Are you sure that you imported
> the nodes?
>
> "openstack baremetal import --json instackenv.json"
>
> You should then see the nodes actually being introspected. Does
> anything show up now in an "ironic node-list"? Try deleting whatever
> shows up in that list with "ironic node-delete <UUID>", then run the
> import command above, followed by "openstack baremetal configure boot",
> followed by "openstack baremetal introspection bulk start".
>
> Start here, and make sure you follow all the steps:
>
>
> http://docs.openstack.org/developer/tripleo-docs/basic_deployment/basic_d...
>
> --
> Dan Sneddon | Principal OpenStack Engineer
> dsneddon(a)redhat.com | redhat.com/openstack
> 650.254.4025 | dsneddon:irc @dxs:twitter
>
8 years, 8 months
[Rdo-list] TripleO quickstart problem by deploying the overcloud
by Arash Kaffamanesh
Hi,
I'm trying to deploy OpenStack via TripleO quickstart in AIO / virt mode
and I'm getting by the last step deploying the overcloud the following
"Heat Stack create failed" message (There are not enough hosts available,
due to Configuration has 4 errors, fix them before proceeding ????).
After running openstack overcloud deploy I'm getting *Configuration has 4
errors, fix them before proceeding*: (and I guess the problem lies somehow
here with the "incorrectly configured driver_info"):
[stack@undercloud ~]$ openstack overcloud deploy --templates
Node uuid=a62116c4-1daf-45e9-aa2d-ef8a4effdc20 has an incorrectly
configured driver_info/deploy_ramdisk. Expected
"482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
Node uuid=a62116c4-1daf-45e9-aa2d-ef8a4effdc20 has an incorrectly
configured driver_info/deploy_kernel. Expected
"482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
Node uuid=cfc60017-36e8-4808-842d-8c65ffb5e4b1 has an incorrectly
configured driver_info/deploy_ramdisk. Expected
"482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
Node uuid=cfc60017-36e8-4808-842d-8c65ffb5e4b1 has an incorrectly
configured driver_info/deploy_kernel. Expected
"482254d3-4b0c-4c3f-b2ba-bdf34badbbd3" but got "None".
*Configuration has 4 errors, fix them before proceeding.* Ignoring these
errors is likely to lead to a failed deploy.
Deploying templates in the directory
/usr/share/openstack-tripleo-heat-templates
2016-03-25 17:45:13 [overcloud]: CREATE_IN_PROGRESS Stack CREATE started
2016-03-25 17:45:13 [MysqlRootPassword]: CREATE_IN_PROGRESS state changed
2016-03-25 17:45:14 [Networks]: CREATE_IN_PROGRESS state changed
.......
2016-03-25 17:47:15 [overcloud]: CREATE_FAILED Resource CREATE failed:
resources.Compute: ResourceInError: resources[0].resources.NovaCompute:
Went to status ERROR due to "Message: No valid host was found. *There are
not enough hosts available*., Code: 500"
*Stack overcloud CREATE_FAILED*
*Heat Stack create failed.*
[stack@undercloud ~]$ heat stack-list
+--------------------------------------+------------+---------------+---------------------+--------------+
| id | stack_name | stack_status |
creation_time | updated_time |
+--------------------------------------+------------+---------------+---------------------+--------------+
| 27fd6b76-7413-4e9b-9b5e-c7afb941ee0e | overcloud | *CREATE_FAILED* |
2016-03-25T17:45:12 | None |
+--------------------------------------+------------+---------------+---------------------+--------------+
By the way I tried to get the stable liberty and the latest mitaka working
with TripleO, no either worked.
And tried also Lars's tutorial here:
http://blog.oddbit.com/2016/02/19/deploy-an-ha-openstack-development-envir/
had not so much luck, but could learn a lot and would prefer to learn more
by running the ansible playbooks by hand as described by Lars.
Any help / advice is much appreciated.
Thx,
-Arash
8 years, 8 months
[Rdo-list] Mitaka RC1 current status
by Haïkel
Hi,
just to share with you the current status of Mitaka RC1 rebuilds
http://paste.fedoraproject.org/344632/45883006/
The bulk of it has been rebuilt using an automation script done by
flepied (thanks to him for that!)
Remaining packages are ones without stable/mitaka branches, or
tarballs, and one FTBFS (cloudkitty)
I'll be focusing now on packstack and tripleO in order that we can
test the current set of stable builds
Regards,
H.
8 years, 8 months
[Rdo-list] rdoproject.org infra outage post-mortem #2
by Tristan Cacqueray
Hello folks,
here is a little note about what happened... The underlying cloud
(called rcip-dev) experienced an outage yesterday morning.
Anomalies observed:
* Mar 23 04:09:20 - compute - first AMQP error
* Mar 23 08:11:48 - controller - OOM killed nova-scheduler
* Mar 23 08:47:52 - controller - RabbitMQ service was unavailable
Possible root causes:
* PCS tried to restart the scheduler repeatedly and may have caused
pending AMQP connections to stall, potentially exhausting its
resources
* Nova databases wasn't purged and since nova-scheduler cache the whole
instances table it was overrun.
* nova-manage db archive_deleted_rows failed because of IntegrityError:
a foreign key constraint fails
* This result in a total of 70k instances and more than 120k
instance_actions_events to be loaded in nova-scheduler each time.
-> Manually cleaning the nova database of all deleted instances reduce
nova-scheduler memory to 80KB (down from >3GB)
* Then once rabbitmq was down, services started to fail.
However, the timestamps doesn't exactly match with the
trunk.rdoproject.org instance outage. Investigation is still on-going.
Timeline:
Mar 23 07:40:00 - apevec noticed trunk.rdoproject.org lost connectivity
Mar 23 09:00:00 - rabbitmq cluster rebuilt, controller node restarted
Mar 23 09:50:00 - service restored
Mar 23 10:13:00 - trunk.rdoproject.org restored after hard reboot
Services' API and instances are now nominals.
Regards,
-Tristan
8 years, 8 months
[Rdo-list] Keystone eventlet vs WSGI
by Charles Short
Hi,
'Back in the days' when I was installing Kilo with Packstack I noticed
that Keystone was running by default as a WSGI process instead of a
Python eventlet.
This was due to the Keystone eventlet being deprecated.
I recently installed Liberty Triple0 on bare metal with three
controllers (Delorean stable branch) and was surprised to see that
Keystone was
running by default as a Python eventlet again!
I have found a related bug here -
https://bugzilla.redhat.com/show_bug.cgi?id=1264011
I need Keystone running as WSGI as this is a prerequisite for me to
install a VOMs plugin to federate.
Can anyone point me to the best (safest) way to change from eventlet to
WSGI manually (or indeed with templates)
Thanks
Charles
--
Charles Short
Cloud Engineer
Virtualization and Cloud Team
European Bioinformatics Institute (EMBL-EBI)
Tel: +44 (0)1223 494205
8 years, 8 months
[Rdo-list] RDO meeting (2016-03-23) Minutes
by John Trowbridge
==============================
#rdo: RDO meeting (2016-03-23)
==============================
Meeting started by trown at 15:00:46 UTC. The full logs are available at
https://meetbot.fedoraproject.org/rdo/2016-03-23/rdo_meeting_(2016-03-23)...
.
Meeting summary
---------------
* LINK: agenda https://etherpad.openstack.org/p/RDO-Meeting (trown,
15:02:29)
* Defintion of Done for Mitaka release (trown, 15:03:57)
* LINK:
https://www.redhat.com/archives/rdo-list/2016-March/msg00118.html
(trown, 15:04:28)
* Packaging status of project-specific Horizon dashboards? (trown,
15:10:32)
* LINK:
https://github.com/javierpena/openstack-example-spec/blob/master/example-...
(apevec, 15:14:09)
* LINK: trello card for tracking
https://trello.com/c/Of7pkmjI/145-add-missing-ui-packages (trown,
15:22:35)
* RDO Mitaka in CBS status (trown, 15:24:44)
* LINK: https://bugs.centos.org/view.php?id=10593 (apevec, 15:35:09)
* new -pending tags have been requested (number80, 15:35:13)
* Update for discussions regarding making trunk repos more available
(trown, 15:36:47)
* Chair for next meeting? (trown, 15:45:11)
* ACTION: imcsk8 to chair for next meeting. (chandankumar, 15:47:30)
* open floor (trown, 15:47:49)
Meeting ended at 15:57:23 UTC.
Action Items
------------
* imcsk8 to chair for next meeting.
Action Items, by person
-----------------------
* imcsk8
* imcsk8 to chair for next meeting.
* **UNASSIGNED**
* (none)
People Present (lines said)
---------------------------
* apevec (65)
* trown (55)
* number80 (35)
* dmsimard (22)
* tosky (18)
* chandankumar (13)
* imcsk8 (11)
* jruzicka (8)
* tristanC (7)
* zodbot (7)
* jlibosva (4)
* derekh (3)
* hewbrocc` (2)
* hewbrocca (2)
* sshnaidm (1)
Generated by `MeetBot`_ 0.1.4
.. _`MeetBot`: http://wiki.debian.org/MeetBot
8 years, 8 months
[Rdo-list] snat and my WRT54G router
by John Alway
Hello,
I'm still not able to get snat to work (connecting to the Internet) with my
RDO all-in-one installation, and I'm wondering if my router is the issue.
My router is a Linksys WRT54G, which does not support a "DHCP reservation"
feature. I was able to set a fixed ip on it, because there is a range
available from 192.168.1.2 through to 192.168.1.99, also 192.168.1.150
through 192.168.1.254.
This is according to "toomanydonuts" posting here:
http://community.linksys.com/t5/Wireless-Routers/WRT54G-Static-IP-Questio...
I've been using the lower address range. Could this be the problem, or
should I look elsewhere?
In my setup I have two private subnets, and three VMs. I can ping between
the VMs, but can't ping the Internet. A virtual router connects the
subnets and external network.
I set up my external subnet as 192.168.1.0/28. I use the 28 to limit the
range for my router. The external range is the same as my actual physical
addresses on my LAN.
I should add, I'm not a network guy. I'm learning a lot of networking on
the fly here.
Thanks for any feedback!!
...John
8 years, 8 months
