From: rdo-list-bounces@redhat.com <rdo-list-bounces@redhat.com> on behalf of Chinmaya Dwibedy <ckdwibedy@gmail.com>
Sent: Wednesday, June 8, 2016 8:08 AM
To: rdo-list@redhat.com
Subject: [rdo-list] Fwd: ConnectFailure error upon triggering “nova image-list” command using openstack-mitaka release

Hi ,

I am getting the ConnectFailure error message upon triggering “nova image-list” command. nova-api process should be listening on 8774. It doesn't look like it is not running. Also I do not find any error logs in nova-api.log

[BD]

# netstat -antp | grep 8774

# iptables-save | grep 8774

If first command return xxxxxx/python

then `ps -ef | grep xxxxxx`

nova-compute.log and nova-conductor.log. I am using openstack-mitaka release on host (Cent OS 7.2). How can I debug and know what prevents it from running ? please suggest.

Note: This was working while back and got this issue all of a sudden.

Here are some logs.

[root@localhost ~(keystone_admin)]# nova image-list

ERROR (ConnectFailure): Unable to establish connection to http://172.18.121.48:8774/v2/4bc608763cee41d9a8df26d3ef919825

[root@localhost ~(keystone_admin)]#

[root@localhost ~(keystone_admin)]# service openstack-nova-api restart

Redirecting to /bin/systemctl restart openstack-nova-api.service

Job for openstack-nova-api.service failed because the control process exited with error code. See "systemctl status openstack-nova-api.service" and "journalctl -xe" for details.

[root@localhost ~(keystone_admin)]# systemctl status openstack-nova-api.service

â openstack-nova-api.service - OpenStack Nova API Server

Loaded: loaded (/usr/lib/systemd/system/openstack-nova-api.service; enabled; vendor preset: disabled)

Active: activating (start) since Wed 2016-06-08 07:59:20 EDT; 2s ago

Main PID: 179955 (nova-api)

CGroup: /system.slice/openstack-nova-api.service

ââ179955 /usr/bin/python2 /usr/bin/nova-api

Jun 08 07:59:20 localhost systemd[1]: Starting OpenStack Nova API Server...

Jun 08 07:59:22 localhost python2[179955]: detected unhandled Python exception in '/usr/bin/nova-api'

[root@localhost ~(keystone_admin)]#

[root@localhost ~(keystone_admin)]# keystone endpoint-list

/usr/lib/python2.7/site-packages/keystoneclient/shell.py:64: DeprecationWarning: The keystone CLI is deprecated in favor of python-openstackclient. For a Python library, continue using python-keystoneclient.

'python-keystoneclient.', DeprecationWarning)

/usr/lib/python2.7/site-packages/keystoneclient/v2_0/client.py:145: DeprecationWarning: Constructing an instance of the keystoneclient.v2_0.client.Client class without a session is deprecated as of the 1.7.0 release and may be removed in the 2.0.0 release.

'the 2.0.0 release.', DeprecationWarning)

/usr/lib/python2.7/site-packages/keystoneclient/v2_0/client.py:147: DeprecationWarning: Using the 'tenant_name' argument is deprecated in version '1.7.0' and will be removed in version '2.0.0', please use the 'project_name' argument instead

super(Client, self).__init__(**kwargs)

/usr/lib/python2.7/site-packages/debtcollector/renames.py:45: DeprecationWarning: Using the 'tenant_id' argument is deprecated in version '1.7.0' and will be removed in version '2.0.0', please use the 'project_id' argument instead

return f(*args, **kwargs)

/usr/lib/python2.7/site-packages/keystoneclient/httpclient.py:371: DeprecationWarning: Constructing an HTTPClient instance without using a session is deprecated as of the 1.7.0 release and may be removed in the 2.0.0 release.

'the 2.0.0 release.', DeprecationWarning)

/usr/lib/python2.7/site-packages/keystoneclient/session.py:140: DeprecationWarning: keystoneclient.session.Session is deprecated as of the 2.1.0 release in favor of keystoneauth1.session.Session. It will be removed in future releases.

DeprecationWarning)

/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py:56: DeprecationWarning: keystoneclient auth plugins are deprecated as of the 2.1.0 release in favor of keystoneauth1 plugins. They will be removed in future releases.

'in future releases.', DeprecationWarning)

+----------------------------------+-----------+-------------------------------------------------+-------------------------------------------------+-------------------------------------------------+----------------------------------+

[root@localhost ~(keystone_admin)]#

[root@localhost ~(keystone_admin)]# netstat -ntlp | grep 8774

[root@localhost ~(keystone_admin)]#

[root@localhost ~(keystone_admin)]# ps -ef | grep nova-api

nova 156427 1 86 07:51 ? 00:00:01 /usr/bin/python2 /usr/bin/nova-api

[root@localhost ~(keystone_admin)]#

[root@localhost ~(keystone_admin)]# lsof -i :8774

[root@localhost ~(keystone_admin)]#

[root@localhost ~(keystone_admin)]# keystone user-list

'python-keystoneclient.', DeprecationWarning)

'the 2.0.0 release.', DeprecationWarning)

super(Client, self).__init__(**kwargs)

return f(*args, **kwargs)

'the 2.0.0 release.', DeprecationWarning)

DeprecationWarning)

'in future releases.', DeprecationWarning)

+----------------------------------+------------+---------+----------------------+

+----------------------------------+------------+---------+----------------------+

+----------------------------------+------------+---------+----------------------+

[root@localhost ~(keystone_admin)]#

[root@localhost ~(keystone_admin)]# nova-manage service list

Option "verbose" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future.

Option "notification_driver" from group "DEFAULT" is deprecated. Use option "driver" from group "oslo_messaging_notifications".

Option "notification_topics" from group "DEFAULT" is deprecated. Use option "topics" from group "oslo_messaging_notifications".

DEPRECATED: Use the nova service-* commands from python-novaclient instead or the os-services REST resource. The service subcommand will be removed in the 14.0 release.

Binary Host Zone Status State Updated_At

nova-osapi_compute 0.0.0.0 internal enabled XXX None

nova-metadata 0.0.0.0 internal enabled XXX None

nova-cert localhost internal enabled XXX 2016-06-08 06:12:38

nova-consoleauth localhost internal enabled XXX 2016-06-08 06:12:37

nova-scheduler localhost internal enabled XXX 2016-06-08 06:12:38

nova-conductor localhost internal enabled XXX 2016-06-08 06:12:37

nova-compute localhost nova enabled XXX 2016-06-08 06:12:43

[root@localhost ~(keystone_admin)]#

[root@localhost ~(keystone_admin)]# ls -l /var/log/nova/

total 4

-rw-r--r--. 1 nova nova 0 Jun 8 05:22 nova-api.log

-rw-r--r--. 1 nova nova 0 Jun 8 05:22 nova-cert.log

-rw-r--r--. 1 nova nova 0 Jun 8 05:22 nova-compute.log

-rw-r--r--. 1 nova nova 0 Jun 8 05:22 nova-conductor.log

-rw-r--r--. 1 nova nova 0 Jun 8 05:22 nova-consoleauth.log

-rw-r--r--. 1 root root 0 Jun 8 05:22 nova-manage.log

-rw-r--r--. 1 nova nova 995 Jun 8 05:32 nova-novncproxy.log

-rw-r--r--. 1 nova nova 0 Jun 8 05:23 nova-scheduler.log

[root@localhost ~(keystone_admin)]#

Regards,

Chinmaya