<div dir="ltr">I just found this error in my compute log file:<div>oslo_messaging._drivers.impl_rabbit [-] Failed to consume message from queue: 'NoneType' object has no attribute '__getitem__'<br></div><div><br></div><div>It keeps happening, and in horizon the instance build is staying in scheduling.</div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature">--Brian</div></div>
<br><div class="gmail_quote">On Wed, Jul 22, 2015 at 6:02 PM, brian lee <span dir="ltr"><<a href="mailto:brian@brianlee.org" target="_blank">brian@brianlee.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Yes rabbitmq is running, and the firewall ports are open:<div><br></div><div><div>ACCEPT tcp -- 10.32.97.133 <a href="http://0.0.0.0/0" target="_blank">0.0.0.0/0</a> multiport dports 5671,5672 /* 001 amqp incoming amqp_10.32.97.133 */</div><div>ACCEPT tcp -- 10.32.97.137 <a href="http://0.0.0.0/0" target="_blank">0.0.0.0/0</a> multiport dports 5671,5672 /* 001 amqp incoming amqp_10.32.97.137 */</div></div><div><br></div><div>.133 is the controller, .137 is the compute node.</div></div><div class="gmail_extra"><br clear="all"><div><div>--Brian</div></div>
<br><div class="gmail_quote"><span class="">On Wed, Jul 22, 2015 at 6:02 PM, Rhys Oxenham <span dir="ltr"><<a href="mailto:roxenham@redhat.com" target="_blank">roxenham@redhat.com</a>></span> wrote:<br></span><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">On your controller node, do you have RabbitMQ running?<br>
<br>
# systemctl status rabbitmq-server<br>
<br>
I suspect that this isn’t running, yet the firewall port is open, hence the connection refused message.<br>
<br>
Cheers<br>
Rhys<br>
</span><div><div class="h5"><div><div><br>
> On 22 Jul 2015, at 23:23, brian lee <<a href="mailto:brian@brianlee.org" target="_blank">brian@brianlee.org</a>> wrote:<br>
><br>
> The compute node can ping the controller.<br>
><br>
> I did just find this error in the compute log file:<br>
><br>
> 2015-07-22 21:30:36.756 18880 ERROR nova.compute.manager [-] Instance failed network setup after 1 attempt(s)<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager Traceback (most recent call last):<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1770, in _allocate_network_async<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager dhcp_options=dhcp_options)<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/network/api.py", line 49, in wrapped<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager return func(self, context, *args, **kwargs)<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/network/base_api.py", line 64, in wrapper<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager res = f(self, context, *args, **kwargs)<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/network/api.py", line 281, in allocate_for_instance<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager nw_info = self.network_rpcapi.allocate_for_instance(context, **args)<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/network/rpcapi.py", line 152, in allocate_for_instance<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager macs=jsonutils.to_primitive(macs))<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py", line 156, in call<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager retry=self.retry)<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 90, in _send<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager timeout=timeout, retry=retry)<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 350, in send<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager retry=retry)<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 339, in _send<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager result = self._waiter.wait(msg_id, timeout)<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 243, in wait<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager message = self.waiters.get(msg_id, timeout=timeout)<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 149, in get<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager 'to message ID %s' % msg_id)<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager MessagingTimeout: Timed out waiting for a reply to message ID 63bcf088157e44b592913f7245249d07<br>
> 2015-07-22 21:30:36.756 18880 TRACE nova.compute.manager<br>
> 2015-07-22 21:30:36.761 18880 ERROR nova.compute.manager [req-3c3ddcae-0f6a-4aed-9f72-2ec3fd8ac073 - - - - -] [instance: 5e4d609c-0139-44cd-94e3-ecb765209b1e] Instance failed to spawn<br>
><br>
><br>
> --Brian<br>
><br>
</div></div></div></div><span class=""><span>> On Wed, Jul 22, 2015 at 5:20 PM, Kevin Tibi <<a href="mailto:kevintibi@hotmail.com" target="_blank">kevintibi@hotmail.com</a>> wrote:<br>
> Hi,<br>
><br>
> I see error for rabbitmq. The compute node can ping the controller ?<br>
><br>
> Kevin Tibi<br>
><br>
</span></span><span><span class="">> Le 23 juil. 2015 00:07, "brian lee" <<a href="mailto:brian@brianlee.org" target="_blank">brian@brianlee.org</a>> a écrit :<br>
> I have a fresh 2 node install of Kilo, maybe working with Nova networking (I dont know yet). When I try to start a VM I get this error in Horizon:<br>
> Error: No valid host was found. There are not enough hosts available.<br>
><br>
> There is nothing really telling in the logs beside this in the scheduler:<br>
><br></span>
> 2015-07-22 19:57:<a href="tel:56.232%2022843" value="+15623222843" target="_blank">56.232 22843</a> ERROR oslo_messaging._drivers.impl_rabbit [-] Failed to consume message from queue:<span class=""><br>
> 2015-07-22 19:59:19.465 997 WARNING oslo_config.cfg [req-d19b6788-9f3b-49e6-9124-b945f4c3e3e6 - - - - -] Option "sql_connection" from group "DEFAULT" is deprecated. Use option "connection" from group "database".<br>
> 2015-07-22 19:59:20.739 997 WARNING oslo_config.cfg [req-d19b6788-9f3b-49e6-9124-b945f4c3e3e6 - - - - -] Option "lock_path" from group "DEFAULT" is deprecated. Use option "lock_path" from group "oslo_concurrency".<br>
> 2015-07-22 19:59:20.785 997 INFO nova.service [-] Starting scheduler node (version 2015.1.0-3.el7)<br>
</span></span>> 2015-07-22 19:59:20.959 997 INFO oslo_messaging._drivers.impl_rabbit [req-0d6a61c6-54eb-42df-a2a2-596d535a8ac5 - - - - -] Connecting to AMQP server on <a href="http://10.32.97.133:5672" rel="noreferrer" target="_blank">10.32.97.133:5672</a><br>
> 2015-07-22 19:59:20.976 997 ERROR oslo_messaging._drivers.impl_rabbit [req-0d6a61c6-54eb-42df-a2a2-596d535a8ac5 - - - - -] AMQP server on <a href="http://10.32.97.133:5672" rel="noreferrer" target="_blank">10.32.97.133:5672</a> is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.<span class=""><br>
<span>><br>
> I am not seeing any other errors in the log files, any idea what else to check?<br>
><br>
> --Brian<br>
><br>
><br>
> _______________________________________________<br>
> Rdo-list mailing list<br>
</span></span><span class="">> <a href="mailto:Rdo-list@redhat.com" target="_blank">Rdo-list@redhat.com</a><br>
> <a href="https://www.redhat.com/mailman/listinfo/rdo-list" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/rdo-list</a><br>
><br></span>
> To unsubscribe: <a href="mailto:rdo-list-unsubscribe@redhat.com" target="_blank">rdo-list-unsubscribe@redhat.com</a><br>
><br>
> _______________________________________________<br>
> Rdo-list mailing list<span class=""><br>
> <a href="mailto:Rdo-list@redhat.com" target="_blank">Rdo-list@redhat.com</a><br>
> <a href="https://www.redhat.com/mailman/listinfo/rdo-list" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/rdo-list</a><br>
><br>
> To unsubscribe: <a href="mailto:rdo-list-unsubscribe@redhat.com" target="_blank">rdo-list-unsubscribe@redhat.com</a><br>
<br>
</span></blockquote></div><br></div>
</blockquote></div><br></div>