<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:"Courier New";
mso-fareast-language:EN-IN;}
span.m
{mso-style-name:m;}
.MsoChpDefault
{mso-style-type:export-only;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-IN" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Hi,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="color:black">I am trying to implement AIO POC with Trove enabled using packstack on centos 7. I have created image for mongodb and data store is also configured.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">I am having issue when I try to create trove instance, instance status is error. Though trove was deployed by packstack, I cross checked all trove config files as per this guide
<a href="https://docs.openstack.org/trove/latest/install/install-rdo.html">https://docs.openstack.org/trove/latest/install/install-rdo.html</a> they seems ok.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">trove-api.log has following error,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">2017-12-08 13:14:48.021 15950 INFO trove.instance.service [-] Creating a database instance for tenant 'b20cf7ccbd1a4636bb8a8bdf8cd3973d'<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:48.048 15950 WARNING trove.common.cfg [-] Manager name ('datastore_manager') not defined, using 'mysql' options instead.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:48.049 15950 WARNING trove.common.cfg [-] Manager name ('datastore_manager') not defined, using 'mysql' options instead.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:48.062 15950 WARNING novaclient.v2.client [-] Property `management_url` is deprecated for SessionClient. It should be set via `endpoint_override` variable while class initialization.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:49.426 15950 INFO eventlet.wsgi [-] 172.16.5.184 - - [08/Dec/2017 13:14:49] "POST /v1.0/b20cf7ccbd1a4636bb8a8bdf8cd3973d/instances HTTP/1.1" 200 1085 1.411768<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:49.851 15963 INFO trove.instance.service [-] Listing database instances for tenant 'b20cf7ccbd1a4636bb8a8bdf8cd3973d'<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:49.855 15963 WARNING novaclient.v2.client [-] Property `management_url` is deprecated for SessionClient. It should be set via `endpoint_override` variable while class initialization.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:51.215 15963 INFO eventlet.wsgi [-] 172.16.5.184 - - [08/Dec/2017 13:14:51] "GET /v1.0/b20cf7ccbd1a4636bb8a8bdf8cd3973d/instances?limit=20 HTTP/1.1" 200 949 1.738005<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:51.230 15963 WARNING novaclient.v2.client [-] Property `management_url` is deprecated for SessionClient. It should be set via `endpoint_override` variable while class initialization.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:52.299 15963 INFO eventlet.wsgi [-] 172.16.5.184 - - [08/Dec/2017 13:14:52] "GET /v1.0/b20cf7ccbd1a4636bb8a8bdf8cd3973d/flavors HTTP/1.1" 200 1936 1.080438<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:52.306 15955 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes
inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers
option.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.313 15955 INFO trove.instance.service [-] Showing database instance '62b40b11-9440-41ad-929f-7fd8b0bb6208' for tenant 'b20cf7ccbd1a4636bb8a8bdf8cd3973d'<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api [-] Error calling get_filesystem_stats: MessagingTimeout: Timed out waiting for a reply to message ID 5827c0618531497f9e7da6cf01de28b1<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api Traceback (most recent call last):<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api File "/usr/lib/python2.7/site-packages/trove/guestagent/api.py", line 90, in _call<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api result = cctxt.call(self.context, method_name, **kwargs)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 169, in call<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api retry=self.retry)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 123, in _send<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api timeout=timeout, retry=retry)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 578, in send<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api retry=retry)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 567, in _send<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api result = self._waiter.wait(msg_id, timeout)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 459, in wait<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api message = self.waiters.get(msg_id, timeout=timeout)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 347, in get<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api 'to message ID %s' % msg_id)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api MessagingTimeout: Timed out waiting for a reply to message ID 5827c0618531497f9e7da6cf01de28b1<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.422 15955 ERROR trove.guestagent.api <o:p>
</o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.424 15955 ERROR trove.instance.models [-] An error occurred communicating with the guest: Timed out waiting for a reply to message ID 5827c0618531497f9e7da6cf01de28b1.: GuestError: An error occurred communicating with
the guest: Timed out waiting for a reply to message ID 5827c0618531497f9e7da6cf01de28b1.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.424 15955 ERROR trove.instance.models Traceback (most recent call last):<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.424 15955 ERROR trove.instance.models File "/usr/lib/python2.7/site-packages/trove/instance/models.py", line 561, in load_guest_info<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.424 15955 ERROR trove.instance.models volume_info = guest.get_volume_info()<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.424 15955 ERROR trove.instance.models File "/usr/lib/python2.7/site-packages/trove/guestagent/api.py", line 423, in get_volume_info<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.424 15955 ERROR trove.instance.models version=version, fs_path=None)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.424 15955 ERROR trove.instance.models File "/usr/lib/python2.7/site-packages/trove/guestagent/api.py", line 99, in _call<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.424 15955 ERROR trove.instance.models raise exception.GuestError(original_message=str(e))<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.424 15955 ERROR trove.instance.models GuestError: An error occurred communicating with the guest: Timed out waiting for a reply to message ID 5827c0618531497f9e7da6cf01de28b1.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.424 15955 ERROR trove.instance.models <o:p>
</o:p></p>
<p class="MsoNormal">2017-12-08 13:14:58.483 15955 WARNING novaclient.v2.client [-] Property `management_url` is deprecated for SessionClient. It should be set via `endpoint_override` variable while class initialization.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:59.795 15955 INFO eventlet.wsgi [-] 172.16.5.184 - - [08/Dec/2017 13:14:59] "GET /v1.0/b20cf7ccbd1a4636bb8a8bdf8cd3973d/instances/62b40b11-9440-41ad-929f-7fd8b0bb6208 HTTP/1.1" 200 2327 7.491198<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Whereas trove-taskmanager.log has following error,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">2017-12-08 13:07:25.719 15981 WARNING novaclient.v2.client [-] Property `management_url` is deprecated for SessionClient. It should be set via `endpoint_override` variable while class initialization.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:07:26.715 15981 ERROR trove.instance.models [-] Could not find nova server_id(None).: NotFound: Instance None could not be found. (HTTP 404) (Request-ID: req-dba69b39-19ed-49bc-8f32-d37d7d356a24)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:07:26.716 15981 ERROR trove.common.exception [-] Cannot find compute instance None for instance 3f9f4c53-7ba6-4e78-9278-ffd9918de42b.: NotFound: Instance None could not be found. (HTTP 404) (Request-ID: req-dba69b39-19ed-49bc-8f32-d37d7d356a24)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:07:26.716 15981 ERROR trove.instance.models [-] Could not load compute instance None.: ComputeInstanceNotFound: Resource 3f9f4c53-7ba6-4e78-9278-ffd9918de42b can not be retrieved.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:07:26.724 15981 WARNING novaclient.v2.client [-] Property `management_url` is deprecated for SessionClient. It should be set via `endpoint_override` variable while class initialization.: UnprocessableEntity: Instance 3f9f4c53-7ba6-4e78-9278-ffd9918de42b
is not ready.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:49.336 15981 INFO trove.taskmanager.models [-] Creating instance 62b40b11-9440-41ad-929f-7fd8b0bb6208.<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.094 15981 ERROR trove.taskmanager.models [-] Failed to create volume for instance 62b40b11-9440-41ad-929f-7fd8b0bb6208<o:p></o:p></p>
<p class="MsoNormal">The resource could not be found.<br /><br /><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">(HTTP 404)<o:p></o:p></p>
<p class="MsoNormal">Traceback (most recent call last):<o:p></o:p></p>
<p class="MsoNormal"> File "/usr/lib/python2.7/site-packages/trove/taskmanager/models.py", line 811, in _build_volume_info<o:p></o:p></p>
<p class="MsoNormal"> volume_size, volume_type, datastore_manager)<o:p></o:p></p>
<p class="MsoNormal"> File "/usr/lib/python2.7/site-packages/trove/taskmanager/models.py", line 848, in _create_volume<o:p></o:p></p>
<p class="MsoNormal"> volume_type=volume_type)<o:p></o:p></p>
<p class="MsoNormal"> File "/usr/lib/python2.7/site-packages/cinderclient/v2/volumes.py", line 290, in create<o:p></o:p></p>
<p class="MsoNormal"> return self._create('/volumes', body, 'volume')<o:p></o:p></p>
<p class="MsoNormal"> File "/usr/lib/python2.7/site-packages/cinderclient/base.py", line 324, in _create<o:p></o:p></p>
<p class="MsoNormal"> resp, body = self.api.client.post(url, body=body)<o:p></o:p></p>
<p class="MsoNormal"> File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 434, in post<o:p></o:p></p>
<p class="MsoNormal"> return self._cs_request(url, 'POST', **kwargs)<o:p></o:p></p>
<p class="MsoNormal"> File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 387, in _cs_request<o:p></o:p></p>
<p class="MsoNormal"> resp, body = self.request(url, method, **kwargs)<o:p></o:p></p>
<p class="MsoNormal"> File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 369, in request<o:p></o:p></p>
<p class="MsoNormal"> raise exceptions.from_response(resp, body)<o:p></o:p></p>
<p class="MsoNormal">NotFound: The resource could not be found.<br /><br /><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">(HTTP 404)<o:p></o:p></p>
<p class="MsoNormal">: NotFound: The resource could not be found.<br /><br /><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">(HTTP 404)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server [-] Exception during message handling: TroveError: Failed to create volume for instance 62b40b11-9440-41ad-929f-7fd8b0bb6208<o:p></o:p></p>
<p class="MsoNormal">The resource could not be found.<br /><br /><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">(HTTP 404)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server Traceback (most recent call last):<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 153, in wrapper<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server return f(*args, **kwargs)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/trove/taskmanager/manager.py", line 384, in create_instance<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server locality)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/trove/taskmanager/manager.py", line 364, in _create_instance<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server scheduler_hints)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/trove/taskmanager/models.py", line 505, in create_instance<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server scheduler_hints)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/trove/taskmanager/models.py", line 782, in _create_server_volume_individually<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server volume_type=volume_type)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/trove/taskmanager/models.py", line 815, in _build_volume_info<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server self._log_and_raise(e, msg, err)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/trove/taskmanager/models.py", line 839, in _log_and_raise<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server raise TroveError(message=full_message)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server TroveError: Failed to create volume for instance 62b40b11-9440-41ad-929f-7fd8b0bb6208<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server The resource could not be found.<br /><br /><o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server
<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server
<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server (HTTP 404)<o:p></o:p></p>
<p class="MsoNormal">2017-12-08 13:14:53.247 15981 ERROR oslo_messaging.rpc.server<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Regards,<o:p></o:p></p>
<p class="MsoNormal">/Sonali<o:p></o:p></p>
</div>
</body>
</html>