<div dir="ltr">Hi, <div><br></div><div>following <a href="https://repos.fedorapeople.org/repos/openstack-m/instack-undercloud/html/troubleshooting/troubleshooting-overcloud.html">https://repos.fedorapeople.org/repos/openstack-m/instack-undercloud/html/troubleshooting/troubleshooting-overcloud.html</a> and running <span style="color:rgb(64,64,64);font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5;background-color:rgb(255,255,255)">sudo journalctl -u os-collect-config on the controller node it seems to be a rabbitmq issue, it's not running. I see this in the logs:</span></div><div><span style="color:rgb(64,64,64);font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5;background-color:rgba(0,0,0,0.0470588)"><br></span></div><div><span style="background-color:rgba(0,0,0,0.0470588)"><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px">Stack trace:</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> [{rabbit_node_monitor,write_cluster_status,1,</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> [{file,"src/rabbit_node_monitor.erl"},{line,137}]},</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> {rabbit_node_monitor,prepare_cluster_status_files,0,</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> [{file,"src/rabbit_node_monitor.erl"},{line,123}]},</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> {rabbit,'-boot/0-fun-1-',0,[{file,"src/rabbit.erl"},{line,328}]},</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> {rabbit,start_it,1,[{file,"src/rabbit.erl"},{line,358}]},</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> {init,start_it,1,[]},</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> {init,start_em,1,[]}]</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"><br></span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"><br></span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px">=INFO REPORT==== 5-May-2015::01:18:00 ===</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px">Error description:</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> {error,{could_not_write_file,"/var/lib/rabbitmq/mnesia/rabbit@ov-x3un7k6nv4d-0-fjkcdpnvfnew-controller-pjaxihpukyl6/cluster_nodes.config",</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> enospc}}</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"><br></span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px">Log files (may contain more information):</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> /var/log/rabbitmq/rabbit@ov-x3un7k6nv4d-0-fjkcdpnvfnew-controller-pjaxihpukyl6.log</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> /var/log/rabbitmq/rabbit@ov-x3un7k6nv4d-0-fjkcdpnvfnew-controller-pjaxihpukyl6-sasl.log</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"><br></span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px">Stack trace:</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> [{rabbit_node_monitor,write_cluster_status,1,</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> [{file,"src/rabbit_node_monitor.erl"},{line,137}]},</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> {rabbit_node_monitor,prepare_cluster_status_files,0,</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> [{file,"src/rabbit_node_monitor.erl"},{line,123}]},</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> {rabbit,'-boot/0-fun-1-',0,[{file,"src/rabbit.erl"},{line,328}]},</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> {rabbit,start_it,1,[{file,"src/rabbit.erl"},{line,358}]},</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> {init,start_it,1,[]},</span></font></div><div style><font color="#404040" face="Consolas, Andale Mono WT, Andale Mono, Lucida Console, Lucida Sans Typewriter, DejaVu Sans Mono, Bitstream Vera Sans Mono, Liberation Mono, Nimbus Mono L, Monaco, Courier New, Courier, monospace"><span style="font-size:12px;line-height:18px"> {init,start_em,1,[]}]</span></font></div><div style="color:rgb(64,64,64);font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5"><br></div><div style="color:rgb(64,64,64);font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5">Any hint?</div><div style="color:rgb(64,64,64);font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5"><br></div><div style="color:rgb(64,64,64);font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5">Thanks</div></span></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, May 4, 2015 at 5:38 PM, Pedro Sousa <span dir="ltr"><<a href="mailto:pgsousa@gmail.com" target="_blank">pgsousa@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi all,<div><br></div><div>I'm having a problem deploying overcloud controller node, the stack is failling, when I run the command: <span style="font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5;color:rgb(51,51,51)">instack</span><span style="color:rgb(64,64,64);font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5;font-weight:bold">-</span><span style="font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5;color:rgb(51,51,51)">deploy</span><span style="color:rgb(64,64,64);font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5;font-weight:bold">-</span><span style="font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5;color:rgb(51,51,51)">overcloud</span><span style="color:rgb(64,64,64);font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5;background-color:rgba(0,0,0,0.0470588)"> </span><span style="color:rgb(64,64,64);font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5;font-weight:bold">--</span><span style="font-family:Consolas,'Andale Mono WT','Andale Mono','Lucida Console','Lucida Sans Typewriter','DejaVu Sans Mono','Bitstream Vera Sans Mono','Liberation Mono','Nimbus Mono L',Monaco,'Courier New',Courier,monospace;font-size:12px;line-height:1.5;color:rgb(51,51,51)">tuskar</span></div><div><br></div><div><br></div><div>Logging on the controller and looking to cloud-init.log I see this:</div><div><br></div><div>2015-05-04 16:17:51,839 - url_helper.py[WARNING]: Calling '<a href="http://169.254.169.254/2009-04-04/meta-data/instance-id" target="_blank">http://169.254.169.254/2009-04-04/meta-data/instance-id</a>' failed [0/120s]: unexpected error ['NoneType' object has no attribute 'status_code']<br></div><div><br></div><div><br></div><div><div>May 4 16:17:51 localhost cloud-init: ci-info: +++++++++++++++++++++++Net device info+++++++++++++++++++++++</div><div>May 4 16:17:51 localhost cloud-init: ci-info: +--------+------+-----------+-----------+-------------------+</div><div>May 4 16:17:51 localhost cloud-init: ci-info: | Device | Up | Address | Mask | Hw-Address |</div><div>May 4 16:17:51 localhost cloud-init: ci-info: +--------+------+-----------+-----------+-------------------+</div><div>May 4 16:17:51 localhost cloud-init: ci-info: | lo: | True | 127.0.0.1 | 255.0.0.0 | . |</div><div>May 4 16:17:51 localhost cloud-init: ci-info: | eth0: | True | . | . | 00:f9:f1:ed:e5:92 |</div><div>May 4 16:17:51 localhost cloud-init: ci-info: +--------+------+-----------+-----------+-------------------+</div><div>May 4 16:17:51 localhost cloud-init: ci-info: !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!Route info failed!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!</div></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><div>[root@ov-x3un7k6nv4d-0-fjkcdpnvfnew-controller-pjaxihpukyl6 ~]# ifconfig</div><div>br-ex: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500</div><div> inet 192.0.2.10 netmask 255.255.255.0 broadcast 192.0.2.255</div><div> inet6 fe80::2f9:f1ff:feed:e592 prefixlen 64 scopeid 0x20<link></div><div> ether 00:f9:f1:ed:e5:92 txqueuelen 0 (Ethernet)</div><div> RX packets 18091 bytes 4033820 (3.8 MiB)</div><div> RX errors 0 dropped 0 overruns 0 frame 0</div><div> TX packets 18423 bytes 1486362 (1.4 MiB)</div><div> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0</div><div><br></div><div>eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500</div><div> inet6 fe80::2f9:f1ff:feed:e592 prefixlen 64 scopeid 0x20<link></div><div> ether 00:f9:f1:ed:e5:92 txqueuelen 1000 (Ethernet)</div><div> RX packets 18291 bytes 4100404 (3.9 MiB)</div><div> RX errors 0 dropped 0 overruns 0 frame 0</div><div> TX packets 18673 bytes 1519312 (1.4 MiB)</div><div> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0</div><div><br></div></div><div><br></div><div>Seems some network issue, any hint?</div><div><br></div><div>Thanks,</div><div>Pedro Sousa</div><div><br></div></div>
</blockquote></div><br></div>