[rdo-dev] Heat problem with containerised undercloud

Alex Schultz aschultz at redhat.com
Thu Apr 12 16:02:27 UTC 2018


So it should be noted that we're actively working on the containerized
undercloud deployment process for Rocky and you might want to try the
new way we will be going forward with. You can see the updated
documentation https://review.openstack.org/#/c/558893/. It's much
simpler than the existing docs.

That being said I think you're missing a step around the the container
prep part as  "Property DockerRabbitmqConfigImage not assigned"
usually means the docker information is not being passed during the
deployment.  This information is generated with the:

openstack overcloud container image prepare \
  --output-env-file $HOME/docker_registry.yaml


You then need to add -e $HOME/docker_registry.yaml to your deploy command.

Thanks,
-Alex

On Thu, Apr 12, 2018 at 7:29 AM, Adam Huffman
<adam.huffman.lists at gmail.com> wrote:
> Here's the more detailed log:
>
> 2018-04-12 14:25:24.769 21111 INFO heat.engine.service
> [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] Creating stack
> undercloud-UndercloudServiceChain-elou4xokwrep-ServiceChain-e6umma7beuwd
> 2018-04-12 14:25:26.368 21111 INFO heat.engine.resource
> [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] Validating
> TemplateResource "36"
> 2018-04-12 14:25:26.447 21111 INFO heat.engine.resource
> [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] CREATE:
> ResourceChain "ServiceChain" Stack
> "undercloud-UndercloudServiceChain-elou4xokwrep"
> [3c27ccbf-8653-4519-ad95-79b469dde2e2]
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource Traceback (most
> recent call last):
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 918, in
> _action_recorder
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     yield
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 1026, in
> _do_action
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     yield
> self.action_handler_task(action, args=handler_args)
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/scheduler.py", line 329, in
> wrapper
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     step =
> next(subtask)
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 971, in
> action_handler_task
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     handler_data =
> handler(*args)
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resources/openstack/heat/resource_chain.py",
> line 110, in handle_create
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     return
> self.create_with_template(self.child_template())
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py",
> line 338, in create_with_template
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> kwargs['template_id'])
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in
> __exit__
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> self.force_reraise()
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in
> force_reraise
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> six.reraise(self.type_, self.value, self.tb)
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py",
> line 333, in create_with_template
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     **kwargs)
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/rpc/client.py", line 301, in
> _create_stack
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     version='1.29')
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/rpc/client.py", line 88, in call
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     return
> client.call(ctxt, method, **kwargs)
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 174,
> in call
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> retry=self.retry)
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 131, in
> _send
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> timeout=timeout, retry=retry)
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_fake.py",
> line 219, in send
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     return
> self._send(target, ctxt, message, wait_for_reply, timeout)
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_fake.py",
> line 206, in _send
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     raise failure
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> StackValidationFailed: Property error: resources[36].properties: Property
> DockerRabbitmqConfigImage not assigned
> 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> 2018-04-12 14:25:26.460 21111 INFO eventlet.wsgi.server
> [req-87fd4006-5992-4ab3-b217-72748c671c1b admin admin - - -] 127.0.0.1 - -
> [12/Apr/2018 14:25:26] "GET
> /v1/admin/stacks/2340cfb8-064d-4e4d-8096-89be7a3b2757/events?marker=d5abce43-e93b-402f-aa34-7089f00c7811&nested_depth=6&sort_dir=asc
> HTTP/1.1" 302 849 0.070983
> 2018-04-12 14:25:26.474 21111 INFO heat.engine.stack
> [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] Stack CREATE
> FAILED (undercloud-UndercloudServiceChain-elou4xokwrep): Resource CREATE
> failed: StackValidationFailed: resources.ServiceChain: Property error:
> ServiceChain.resources[36].properties: Property DockerRabbitmqConfigImage
> not assigned
> 2018-04-12 14:25:26.520 21111 INFO eventlet.wsgi.server
> [req-8207c6e0-a86c-4c17-8eed-6c396176b853 admin admin - - -] 127.0.0.1 - -
> [12/Apr/2018 14:25:26] "GET
> /v1/admin/stacks/undercloud/2340cfb8-064d-4e4d-8096-89be7a3b2757/events?marker=d5abce43-e93b-402f-aa34-7089f00c7811&nested_depth=6&sort_dir=asc
> HTTP/1.1" 200 11250 0.051634
> 2018-04-12 14:25:26.548 21111 INFO eventlet.wsgi.server
> [req-d98e7628-6f3c-45a9-945f-5efed6cdfb5f admin admin - - -] 127.0.0.1 - -
> [12/Apr/2018 14:25:26] "GET
> /v1/admin/stacks/2340cfb8-064d-4e4d-8096-89be7a3b2757 HTTP/1.1" 302 612
> 0.024857
> 2018-04-12 14:25:26.908 21111 INFO eventlet.wsgi.server
> [req-0d67916e-4d4e-4692-b7ed-2eff87a1b1b4 admin admin - - -] 127.0.0.1 - -
> [12/Apr/2018 14:25:26] "GET
> /v1/admin/stacks/undercloud/2340cfb8-064d-4e4d-8096-89be7a3b2757 HTTP/1.1"
> 200 26774 0.358471
> 2018-04-12 14:25:27.396 21111 INFO heat.engine.resource
> [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] CREATE:
> TemplateResource "UndercloudServiceChain"
> [3c27ccbf-8653-4519-ad95-79b469dde2e2] Stack "undercloud"
> [2340cfb8-064d-4e4d-8096-89be7a3b2757]
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource Traceback (most
> recent call last):
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 918, in
> _action_recorder
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource     yield
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 1026, in
> _do_action
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource     yield
> self.action_handler_task(action, args=handler_args)
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/scheduler.py", line 346, in
> wrapper
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource     step =
> next(subtask)
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 977, in
> action_handler_task
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource     done =
> check(handler_data)
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py",
> line 404, in check_create_complete
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource     return
> self._check_status_complete(self.CREATE)
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py",
> line 454, in _check_status_complete
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource     action=action)
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource ResourceFailure:
> StackValidationFailed:
> resources.UndercloudServiceChain.resources.ServiceChain: Property error:
> ServiceChain.resources[36].properties: Property DockerRabbitmqConfigImage
> not assigned
> 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource
> 2018-04-12 14:25:27.402 21111 INFO heat.engine.stack
> [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] Stack CREATE
> FAILED (undercloud): Resource CREATE failed: StackValidationFailed:
> resources.UndercloudServiceChain.resources.ServiceChain: Property error:
> ServiceChain.resources[36].properties: Property DockerRabbitmqConfigImage
> not assigned
> 2018-04-12 14:25:28.931 21111 INFO eventlet.wsgi.server
> [req-3dc46209-6a23-478e-92a3-b3b75357bb28 admin admin - - -] 127.0.0.1 - -
> [12/Apr/2018 14:25:28] "GET
> /v1/admin/stacks/2340cfb8-064d-4e4d-8096-89be7a3b2757/events?marker=0a1d1832-e877-43c6-9b03-bede83ff0404&nested_depth=6&sort_dir=asc
> HTTP/1.1" 302 849 0.016178
> 2018-04-12 14:25:29.001 21111 INFO eventlet.wsgi.server
> [req-590a4e1d-71cf-401f-97b8-5f0cc9fcbd6d admin admin - - -] 127.0.0.1 - -
> [12/Apr/2018 14:25:29] "GET
> /v1/admin/stacks/undercloud/2340cfb8-064d-4e4d-8096-89be7a3b2757/events?marker=0a1d1832-e877-43c6-9b03-bede83ff0404&nested_depth=6&sort_dir=asc
> HTTP/1.1" 200 2344 0.067888
> 2018-04-12 14:25:29.031 21111 INFO eventlet.wsgi.server
> [req-1b44e39c-f35f-4dea-95bc-9aff2effa316 admin admin - - -] 127.0.0.1 - -
> [12/Apr/2018 14:25:29] "GET
> /v1/admin/stacks/2340cfb8-064d-4e4d-8096-89be7a3b2757 HTTP/1.1" 302 612
> 0.028547
> 2018-04-12 14:25:29.497 21111 INFO eventlet.wsgi.server
> [req-9cc37a1b-7aa9-4f55-834b-42cf941d4694 admin admin - - -] 127.0.0.1 - -
> [12/Apr/2018 14:25:29] "GET
> /v1/admin/stacks/undercloud/2340cfb8-064d-4e4d-8096-89be7a3b2757 HTTP/1.1"
> 200 26955 0.463922
>
>
>
> On 12 April 2018 at 14:27, Adam Huffman <adam.huffman.lists at gmail.com>
> wrote:
>>
>> Thanks, a bit further now:
>>
>> 2018-04-12 13:25:23Z [undercloud.UndercloudServiceChain]:
>> CREATE_IN_PROGRESS  state changed
>> 2018-04-12 13:25:24Z [undercloud.UndercloudServiceChain]:
>> CREATE_IN_PROGRESS  Stack CREATE started
>> 2018-04-12 13:25:24Z
>> [undercloud.UndercloudServiceChain.LoggingConfiguration]: CREATE_IN_PROGRESS
>> state changed
>> 2018-04-12 13:25:24Z [undercloud.UndercloudServiceChain.ServiceChain]:
>> CREATE_IN_PROGRESS  state changed
>> 2018-04-12 13:25:26Z [undercloud.UndercloudServiceChain.ServiceChain]:
>> CREATE_FAILED  StackValidationFailed: resources.ServiceChain: Property
>> error: resources[36].properties: Property DockerRabbitmqConfigImage not
>> assigned
>> 2018-04-12 13:25:26Z
>> [undercloud.UndercloudServiceChain.LoggingConfiguration]: CREATE_FAILED
>> CREATE aborted
>> 2018-04-12 13:25:26Z [undercloud.UndercloudServiceChain]: CREATE_FAILED
>> Resource CREATE failed: StackValidationFailed: resources.ServiceChain:
>> Property error: ServiceChain.resources[36].properties: Property
>> DockerRabbitmqConfigImage not assigned
>> 2018-04-12 13:25:27Z [undercloud.UndercloudServiceChain]: CREATE_FAILED
>> StackValidationFailed:
>> resources.UndercloudServiceChain.resources.ServiceChain: Property error:
>> ServiceChain.resources[36].properties: Property DockerRabbitmqConfigImage
>> not assigned
>> 2018-04-12 13:25:27Z [undercloud]: CREATE_FAILED  Resource CREATE failed:
>> StackValidationFailed:
>> resources.UndercloudServiceChain.resources.ServiceChain: Property error:
>> ServiceChain.resources[36].properties: Property DockerRabbitmqConfigImage
>> not assigned
>> Exception: Stack create failed
>> ['Traceback (most recent call last):\n', '  File
>> "/usr/lib/python2.7/site-packages/tripleoclient/v1/undercloud_deploy.py",
>> line 511, in take_action\n    parsed_args.timeout)\n', '  File
>> "/usr/lib/python2.7/site-packages/tripleoclient/v1/undercloud_deploy.py",
>> line 346, in _wait_for_heat_complete\n    raise Exception(\'Stack create
>> failed\')\n', 'Exception: Stack create failed\n']
>> ERROR: Heat log files: /var/tmp/undercloud/undercloud_deploy-KVv2ms
>>
>>
>>
>> On 12 April 2018 at 13:56, Thomas Herve <therve at redhat.com> wrote:
>>>
>>> On Thu, Apr 12, 2018 at 1:50 PM, Adam Huffman
>>> <adam.huffman.lists at gmail.com> wrote:
>>> > I've been following the guide at:
>>> >
>>> > http://tripleo.org/containers_deployment/undercloud.html
>>> >
>>> > to test a containerised deployment.
>>> >
>>> > Here's what I have installed:
>>> >
>>> > [stack at tripleo000 containers-2018-04-12]$ rpm -q python-tripleoclient
>>> > python2-openstackclient openstack-heat-agents docker openvswitch
>>> > python-tripleoclient-9.2.1-0.20180410161616.1c1af2a.el7.centos.noarch
>>> >
>>> > python2-openstackclient-3.14.1-0.20180402185834.a3caf7b.el7.centos.noarch
>>> > openstack-heat-agents-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch
>>> > docker-1.13.1-53.git774336d.el7.centos.x86_64
>>> > openvswitch-2.9.0-3.el7.x86_64
>>> >
>>> > [stack at tripleo000 containers-2018-04-12]$ rpm -q python-tripleoclient
>>> > python2-openstackclient openstack-heat-agents docker openvswitch
>>> > python-tripleoclient-9.2.1-0.20180410161616.1c1af2a.el7.centos.noarch
>>> >
>>> > python2-openstackclient-3.14.1-0.20180402185834.a3caf7b.el7.centos.noarch
>>> > openstack-heat-agents-1.5.4-0.20180308153305.ecf43c7.el7.centos.noarch
>>> > docker-1.13.1-53.git774336d.el7.centos.x86_64
>>> > openvswitch-2.9.0-3.el7.x86_64
>>> >
>>> > and here are the configured yum repos:
>>> >
>>> > repo id
>>> > repo name
>>> > status
>>> > base/7/x86_64
>>> > CentOS-7 - Base
>>> > dell-system-update_dependent/7/x86_64
>>> > dell-system-update_dependent
>>> > dell-system-update_independent
>>> > dell-system-update_independent
>>> > delorean-queens
>>> >
>>> > delorean-openstack-kuryr-kubernetes-c394b695dfbf823de626276a61069089ccdb0aca
>>> > delorean-queens-testing
>>> > dlrn-queens-testing
>>> > extras/7/x86_64
>>> > CentOS-7 - Extras
>>> > rdo-qemu-ev/x86_64
>>> > RDO CentOS-7 - QEMU EV
>>> > tripleo-centos-ceph-luminous
>>> > tripleo-centos-ceph-luminous
>>> > updates/7/x86_64
>>> > CentOS-7 - Updates
>>> >
>>> > Here's the attempted installation:
>>> >
>>> > export THT_ROOT=/usr/share/openstack-tripleo-heat-templates/
>>> > [stack at tripleo000 containers-2018-04-12]$ !40
>>> > sudo openstack undercloud deploy --templates=$THT_ROOT
>>> > --local-ip=192.168.24.1 --keep-running   -e
>>> > $THT_ROOT/environments/services-docker/ironic.yaml   -e
>>> > $THT_ROOT/environments/services-docker/mistral.yaml   -e
>>> > $THT_ROOT/environments/services-docker/zaqar.yaml   -e
>>> > $THT_ROOT/environments/docker.yaml   -e
>>> > $THT_ROOT/environments/mongodb-nojournal.yaml   -e
>>> > $HOME/src/containers-2018-04-12/custom.yaml
>>> >
>>> > Undercloud deploy is an experimental developer focused feature that
>>> > does not
>>> > yet replace 'openstack undercloud install'.
>>> > Configuring puppet modules symlinks ...
>>> > Exception: list index out of range
>>> > ['Traceback (most recent call last):\n', '  File
>>> >
>>> > "/usr/lib/python2.7/site-packages/tripleoclient/v1/undercloud_deploy.py",
>>> > line 502, in take_action\n    orchestration_client =
>>> > self._launch_heat(parsed_args)\n', '  File
>>> >
>>> > "/usr/lib/python2.7/site-packages/tripleoclient/v1/undercloud_deploy.py",
>>> > line 187, in _launch_heat\n    parsed_args.heat_user)\n', '  File
>>> > "/usr/lib/python2.7/site-packages/tripleoclient/heat_launcher.py", line
>>> > 306,
>>> > in __init__\n    user)\n', '  File
>>> > "/usr/lib/python2.7/site-packages/tripleoclient/heat_launcher.py", line
>>> > 170,
>>> > in __init__\n    uid = int(self.get_heat_uid())\n', '  File
>>> > "/usr/lib/python2.7/site-packages/tripleoclient/heat_launcher.py", line
>>> > 318,
>>> > in get_heat_uid\n    return
>>> > p.communicate()[0].rstrip().split(\':\')[2]\n',
>>> > 'IndexError: list index out of range\n']
>>> > 'DeployUndercloud' object has no attribute 'heat_launch'
>>>
>>> Hi,
>>>
>>> I think the guide is missing heat. You need to have it installed as
>>> well prior to the deploy, that's probably what's missing (the
>>> deployment is failing when doing getent passwd heat, it needs the heat
>>> user).
>>>
>>> --
>>> Thomas
>>
>>
>
>
> _______________________________________________
> dev mailing list
> dev at lists.rdoproject.org
> http://lists.rdoproject.org/mailman/listinfo/dev
>
> To unsubscribe: dev-unsubscribe at lists.rdoproject.org
>


More information about the dev mailing list