[rdo-dev] Heat problem with containerised undercloud

Adam Huffman adam.huffman.lists at gmail.com
Thu Apr 12 16:10:15 UTC 2018 

Hi Alex,

Thanks, that step was indeed missing from the instructions, and it gets a
lot further.

I'll take a look at the updated documentation too.

Best Wishes,
Adam

On 12 April 2018 at 17:02, Alex Schultz <aschultz at redhat.com> wrote:

> So it should be noted that we're actively working on the containerized
> undercloud deployment process for Rocky and you might want to try the
> new way we will be going forward with. You can see the updated
> documentation https://review.openstack.org/#/c/558893/. It's much
> simpler than the existing docs.
>
> That being said I think you're missing a step around the the container
> prep part as  "Property DockerRabbitmqConfigImage not assigned"
> usually means the docker information is not being passed during the
> deployment.  This information is generated with the:
>
> openstack overcloud container image prepare \
>   --output-env-file $HOME/docker_registry.yaml
>
>
> You then need to add -e $HOME/docker_registry.yaml to your deploy command.
>
> Thanks,
> -Alex
>
> On Thu, Apr 12, 2018 at 7:29 AM, Adam Huffman
> <adam.huffman.lists at gmail.com> wrote:
> > Here's the more detailed log:
> >
> > 2018-04-12 14:25:24.769 21111 INFO heat.engine.service
> > [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] Creating
> stack
> > undercloud-UndercloudServiceChain-elou4xokwrep-ServiceChain-e6umma7beuwd
> > 2018-04-12 14:25:26.368 21111 INFO heat.engine.resource
> > [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] Validating
> > TemplateResource "36"
> > 2018-04-12 14:25:26.447 21111 INFO heat.engine.resource
> > [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] CREATE:
> > ResourceChain "ServiceChain" Stack
> > "undercloud-UndercloudServiceChain-elou4xokwrep"
> > [3c27ccbf-8653-4519-ad95-79b469dde2e2]
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource Traceback (most
> > recent call last):
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 918, in
> > _action_recorder
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     yield
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 1026,
> in
> > _do_action
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     yield
> > self.action_handler_task(action, args=handler_args)
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/scheduler.py", line 329,
> in
> > wrapper
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     step =
> > next(subtask)
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 971, in
> > action_handler_task
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
>  handler_data =
> > handler(*args)
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/resources/openstack/heat/
> resource_chain.py",
> > line 110, in handle_create
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     return
> > self.create_with_template(self.child_template())
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/
> resources/stack_resource.py",
> > line 338, in create_with_template
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> > kwargs['template_id'])
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in
> > __exit__
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> > self.force_reraise()
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in
> > force_reraise
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> > six.reraise(self.type_, self.value, self.tb)
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/
> resources/stack_resource.py",
> > line 333, in create_with_template
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     **kwargs)
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/rpc/client.py", line 301, in
> > _create_stack
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
>  version='1.29')
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/rpc/client.py", line 88, in call
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     return
> > client.call(ctxt, method, **kwargs)
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line
> 174,
> > in call
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> > retry=self.retry)
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line
> 131, in
> > _send
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> > timeout=timeout, retry=retry)
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_fake.py",
> > line 219, in send
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     return
> > self._send(target, ctxt, message, wait_for_reply, timeout)
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_fake.py",
> > line 206, in _send
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource     raise
> failure
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> > StackValidationFailed: Property error: resources[36].properties: Property
> > DockerRabbitmqConfigImage not assigned
> > 2018-04-12 14:25:26.447 21111 ERROR heat.engine.resource
> > 2018-04-12 14:25:26.460 21111 INFO eventlet.wsgi.server
> > [req-87fd4006-5992-4ab3-b217-72748c671c1b admin admin - - -] 127.0.0.1
> - -
> > [12/Apr/2018 14:25:26] "GET
> > /v1/admin/stacks/2340cfb8-064d-4e4d-8096-89be7a3b2757/
> events?marker=d5abce43-e93b-402f-aa34-7089f00c7811&nested_
> depth=6&sort_dir=asc
> > HTTP/1.1" 302 849 0.070983
> > 2018-04-12 14:25:26.474 21111 INFO heat.engine.stack
> > [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] Stack
> CREATE
> > FAILED (undercloud-UndercloudServiceChain-elou4xokwrep): Resource CREATE
> > failed: StackValidationFailed: resources.ServiceChain: Property error:
> > ServiceChain.resources[36].properties: Property
> DockerRabbitmqConfigImage
> > not assigned
> > 2018-04-12 14:25:26.520 21111 INFO eventlet.wsgi.server
> > [req-8207c6e0-a86c-4c17-8eed-6c396176b853 admin admin - - -] 127.0.0.1
> - -
> > [12/Apr/2018 14:25:26] "GET
> > /v1/admin/stacks/undercloud/2340cfb8-064d-4e4d-8096-
> 89be7a3b2757/events?marker=d5abce43-e93b-402f-aa34-
> 7089f00c7811&nested_depth=6&sort_dir=asc
> > HTTP/1.1" 200 11250 0.051634
> > 2018-04-12 14:25:26.548 21111 INFO eventlet.wsgi.server
> > [req-d98e7628-6f3c-45a9-945f-5efed6cdfb5f admin admin - - -] 127.0.0.1
> - -
> > [12/Apr/2018 14:25:26] "GET
> > /v1/admin/stacks/2340cfb8-064d-4e4d-8096-89be7a3b2757 HTTP/1.1" 302 612
> > 0.024857
> > 2018-04-12 14:25:26.908 21111 INFO eventlet.wsgi.server
> > [req-0d67916e-4d4e-4692-b7ed-2eff87a1b1b4 admin admin - - -] 127.0.0.1
> - -
> > [12/Apr/2018 14:25:26] "GET
> > /v1/admin/stacks/undercloud/2340cfb8-064d-4e4d-8096-89be7a3b2757
> HTTP/1.1"
> > 200 26774 0.358471
> > 2018-04-12 14:25:27.396 21111 INFO heat.engine.resource
> > [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] CREATE:
> > TemplateResource "UndercloudServiceChain"
> > [3c27ccbf-8653-4519-ad95-79b469dde2e2] Stack "undercloud"
> > [2340cfb8-064d-4e4d-8096-89be7a3b2757]
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource Traceback (most
> > recent call last):
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 918, in
> > _action_recorder
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource     yield
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 1026,
> in
> > _do_action
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource     yield
> > self.action_handler_task(action, args=handler_args)
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/scheduler.py", line 346,
> in
> > wrapper
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource     step =
> > next(subtask)
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 977, in
> > action_handler_task
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource     done =
> > check(handler_data)
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/
> resources/stack_resource.py",
> > line 404, in check_create_complete
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource     return
> > self._check_status_complete(self.CREATE)
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource   File
> > "/usr/lib/python2.7/site-packages/heat/engine/
> resources/stack_resource.py",
> > line 454, in _check_status_complete
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource
>  action=action)
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource ResourceFailure:
> > StackValidationFailed:
> > resources.UndercloudServiceChain.resources.ServiceChain: Property error:
> > ServiceChain.resources[36].properties: Property
> DockerRabbitmqConfigImage
> > not assigned
> > 2018-04-12 14:25:27.396 21111 ERROR heat.engine.resource
> > 2018-04-12 14:25:27.402 21111 INFO heat.engine.stack
> > [req-3e106a9e-6b06-445e-abcf-44706c00d50a admin admin - - -] Stack
> CREATE
> > FAILED (undercloud): Resource CREATE failed: StackValidationFailed:
> > resources.UndercloudServiceChain.resources.ServiceChain: Property error:
> > ServiceChain.resources[36].properties: Property
> DockerRabbitmqConfigImage
> > not assigned
> > 2018-04-12 14:25:28.931 21111 INFO eventlet.wsgi.server
> > [req-3dc46209-6a23-478e-92a3-b3b75357bb28 admin admin - - -] 127.0.0.1
> - -
> > [12/Apr/2018 14:25:28] "GET
> > /v1/admin/stacks/2340cfb8-064d-4e4d-8096-89be7a3b2757/
> events?marker=0a1d1832-e877-43c6-9b03-bede83ff0404&nested_
> depth=6&sort_dir=asc
> > HTTP/1.1" 302 849 0.016178
> > 2018-04-12 14:25:29.001 21111 INFO eventlet.wsgi.server
> > [req-590a4e1d-71cf-401f-97b8-5f0cc9fcbd6d admin admin - - -] 127.0.0.1
> - -
> > [12/Apr/2018 14:25:29] "GET
> > /v1/admin/stacks/undercloud/2340cfb8-064d-4e4d-8096-
> 89be7a3b2757/events?marker=0a1d1832-e877-43c6-9b03-
> bede83ff0404&nested_depth=6&sort_dir=asc
> > HTTP/1.1" 200 2344 0.067888
> > 2018-04-12 14:25:29.031 21111 INFO eventlet.wsgi.server
> > [req-1b44e39c-f35f-4dea-95bc-9aff2effa316 admin admin - - -] 127.0.0.1
> - -
> > [12/Apr/2018 14:25:29] "GET
> > /v1/admin/stacks/2340cfb8-064d-4e4d-8096-89be7a3b2757 HTTP/1.1" 302 612
> > 0.028547
> > 2018-04-12 14:25:29.497 21111 INFO eventlet.wsgi.server
> > [req-9cc37a1b-7aa9-4f55-834b-42cf941d4694 admin admin - - -] 127.0.0.1
> - -
> > [12/Apr/2018 14:25:29] "GET
> > /v1/admin/stacks/undercloud/2340cfb8-064d-4e4d-8096-89be7a3b2757
> HTTP/1.1"
> > 200 26955 0.463922
> >
> >
> >
> > On 12 April 2018 at 14:27, Adam Huffman <adam.huffman.lists at gmail.com>
> > wrote:
> >>
> >> Thanks, a bit further now:
> >>
> >> 2018-04-12 13:25:23Z [undercloud.UndercloudServiceChain]:
> >> CREATE_IN_PROGRESS  state changed
> >> 2018-04-12 13:25:24Z [undercloud.UndercloudServiceChain]:
> >> CREATE_IN_PROGRESS  Stack CREATE started
> >> 2018-04-12 13:25:24Z
> >> [undercloud.UndercloudServiceChain.LoggingConfiguration]:
> CREATE_IN_PROGRESS
> >> state changed
> >> 2018-04-12 13:25:24Z [undercloud.UndercloudServiceChain.ServiceChain]:
> >> CREATE_IN_PROGRESS  state changed
> >> 2018-04-12 13:25:26Z [undercloud.UndercloudServiceChain.ServiceChain]:
> >> CREATE_FAILED  StackValidationFailed: resources.ServiceChain: Property
> >> error: resources[36].properties: Property DockerRabbitmqConfigImage not
> >> assigned
> >> 2018-04-12 13:25:26Z
> >> [undercloud.UndercloudServiceChain.LoggingConfiguration]: CREATE_FAILED
> >> CREATE aborted
> >> 2018-04-12 13:25:26Z [undercloud.UndercloudServiceChain]: CREATE_FAILED
> >> Resource CREATE failed: StackValidationFailed: resources.ServiceChain:
> >> Property error: ServiceChain.resources[36].properties: Property
> >> DockerRabbitmqConfigImage not assigned
> >> 2018-04-12 13:25:27Z [undercloud.UndercloudServiceChain]: CREATE_FAILED
> >> StackValidationFailed:
> >> resources.UndercloudServiceChain.resources.ServiceChain: Property
> error:
> >> ServiceChain.resources[36].properties: Property
> DockerRabbitmqConfigImage
> >> not assigned
> >> 2018-04-12 13:25:27Z [undercloud]: CREATE_FAILED  Resource CREATE
> failed:
> >> StackValidationFailed:
> >> resources.UndercloudServiceChain.resources.ServiceChain: Property
> error:
> >> ServiceChain.resources[36].properties: Property
> DockerRabbitmqConfigImage
> >> not assigned
> >> Exception: Stack create failed
> >> ['Traceback (most recent call last):\n', '  File
> >> "/usr/lib/python2.7/site-packages/tripleoclient/v1/
> undercloud_deploy.py",
> >> line 511, in take_action\n    parsed_args.timeout)\n', '  File
> >> "/usr/lib/python2.7/site-packages/tripleoclient/v1/
> undercloud_deploy.py",
> >> line 346, in _wait_for_heat_complete\n    raise Exception(\'Stack create
> >> failed\')\n', 'Exception: Stack create failed\n']
> >> ERROR: Heat log files: /var/tmp/undercloud/undercloud_deploy-KVv2ms
> >>
> >>
> >>
> >> On 12 April 2018 at 13:56, Thomas Herve <therve at redhat.com> wrote:
> >>>
> >>> On Thu, Apr 12, 2018 at 1:50 PM, Adam Huffman
> >>> <adam.huffman.lists at gmail.com> wrote:
> >>> > I've been following the guide at:
> >>> >
> >>> > http://tripleo.org/containers_deployment/undercloud.html
> >>> >
> >>> > to test a containerised deployment.
> >>> >
> >>> > Here's what I have installed:
> >>> >
> >>> > [stack at tripleo000 containers-2018-04-12]$ rpm -q
> python-tripleoclient
> >>> > python2-openstackclient openstack-heat-agents docker openvswitch
> >>> > python-tripleoclient-9.2.1-0.20180410161616.1c1af2a.el7.
> centos.noarch
> >>> >
> >>> > python2-openstackclient-3.14.1-0.20180402185834.a3caf7b.
> el7.centos.noarch
> >>> > openstack-heat-agents-1.5.4-0.20180308153305.ecf43c7.el7.
> centos.noarch
> >>> > docker-1.13.1-53.git774336d.el7.centos.x86_64
> >>> > openvswitch-2.9.0-3.el7.x86_64
> >>> >
> >>> > [stack at tripleo000 containers-2018-04-12]$ rpm -q
> python-tripleoclient
> >>> > python2-openstackclient openstack-heat-agents docker openvswitch
> >>> > python-tripleoclient-9.2.1-0.20180410161616.1c1af2a.el7.
> centos.noarch
> >>> >
> >>> > python2-openstackclient-3.14.1-0.20180402185834.a3caf7b.
> el7.centos.noarch
> >>> > openstack-heat-agents-1.5.4-0.20180308153305.ecf43c7.el7.
> centos.noarch
> >>> > docker-1.13.1-53.git774336d.el7.centos.x86_64
> >>> > openvswitch-2.9.0-3.el7.x86_64
> >>> >
> >>> > and here are the configured yum repos:
> >>> >
> >>> > repo id
> >>> > repo name
> >>> > status
> >>> > base/7/x86_64
> >>> > CentOS-7 - Base
> >>> > dell-system-update_dependent/7/x86_64
> >>> > dell-system-update_dependent
> >>> > dell-system-update_independent
> >>> > dell-system-update_independent
> >>> > delorean-queens
> >>> >
> >>> > delorean-openstack-kuryr-kubernetes-c394b695dfbf823de626276a610690
> 89ccdb0aca
> >>> > delorean-queens-testing
> >>> > dlrn-queens-testing
> >>> > extras/7/x86_64
> >>> > CentOS-7 - Extras
> >>> > rdo-qemu-ev/x86_64
> >>> > RDO CentOS-7 - QEMU EV
> >>> > tripleo-centos-ceph-luminous
> >>> > tripleo-centos-ceph-luminous
> >>> > updates/7/x86_64
> >>> > CentOS-7 - Updates
> >>> >
> >>> > Here's the attempted installation:
> >>> >
> >>> > export THT_ROOT=/usr/share/openstack-tripleo-heat-templates/
> >>> > [stack at tripleo000 containers-2018-04-12]$ !40
> >>> > sudo openstack undercloud deploy --templates=$THT_ROOT
> >>> > --local-ip=192.168.24.1 --keep-running   -e
> >>> > $THT_ROOT/environments/services-docker/ironic.yaml   -e
> >>> > $THT_ROOT/environments/services-docker/mistral.yaml   -e
> >>> > $THT_ROOT/environments/services-docker/zaqar.yaml   -e
> >>> > $THT_ROOT/environments/docker.yaml   -e
> >>> > $THT_ROOT/environments/mongodb-nojournal.yaml   -e
> >>> > $HOME/src/containers-2018-04-12/custom.yaml
> >>> >
> >>> > Undercloud deploy is an experimental developer focused feature that
> >>> > does not
> >>> > yet replace 'openstack undercloud install'.
> >>> > Configuring puppet modules symlinks ...
> >>> > Exception: list index out of range
> >>> > ['Traceback (most recent call last):\n', '  File
> >>> >
> >>> > "/usr/lib/python2.7/site-packages/tripleoclient/v1/
> undercloud_deploy.py",
> >>> > line 502, in take_action\n    orchestration_client =
> >>> > self._launch_heat(parsed_args)\n', '  File
> >>> >
> >>> > "/usr/lib/python2.7/site-packages/tripleoclient/v1/
> undercloud_deploy.py",
> >>> > line 187, in _launch_heat\n    parsed_args.heat_user)\n', '  File
> >>> > "/usr/lib/python2.7/site-packages/tripleoclient/heat_launcher.py",
> line
> >>> > 306,
> >>> > in __init__\n    user)\n', '  File
> >>> > "/usr/lib/python2.7/site-packages/tripleoclient/heat_launcher.py",
> line
> >>> > 170,
> >>> > in __init__\n    uid = int(self.get_heat_uid())\n', '  File
> >>> > "/usr/lib/python2.7/site-packages/tripleoclient/heat_launcher.py",
> line
> >>> > 318,
> >>> > in get_heat_uid\n    return
> >>> > p.communicate()[0].rstrip().split(\':\')[2]\n',
> >>> > 'IndexError: list index out of range\n']
> >>> > 'DeployUndercloud' object has no attribute 'heat_launch'
> >>>
> >>> Hi,
> >>>
> >>> I think the guide is missing heat. You need to have it installed as
> >>> well prior to the deploy, that's probably what's missing (the
> >>> deployment is failing when doing getent passwd heat, it needs the heat
> >>> user).
> >>>
> >>> --
> >>> Thomas
> >>
> >>
> >
> >
> > _______________________________________________
> > dev mailing list
> > dev at lists.rdoproject.org
> > http://lists.rdoproject.org/mailman/listinfo/dev
> >
> > To unsubscribe: dev-unsubscribe at lists.rdoproject.org
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.rdoproject.org/pipermail/dev/attachments/20180412/9f167abb/attachment-0001.html>

More information about the dev mailing list