Marius,

I am getting a permission error when trying to run nova-manage
[heat-admin@overcloud-controller-2 ~]$ /usr/bin/nova-manage db sync
Traceback (most recent call last):
  File "/usr/bin/nova-manage", line 10, in <module>
    sys.exit(main())
  File "/usr/lib/python2.7/site-packages/nova/cmd/manage.py", line 1330, in main
    config.parse_args(sys.argv)
  File "/usr/lib/python2.7/site-packages/nova/config.py", line 56, in parse_args
    default_config_files=default_config_files)
  File "/usr/lib/python2.7/site-packages/oslo_config/cfg.py", line 1860, in __call__
    self._namespace._files_permission_denied)
oslo_config.cfg.ConfigFilesPermissionDeniedError: Failed to open some config files: /usr/share/nova/nova-dist.conf,/etc/nova/nova.conf

These files are owned by nova:nova

[heat-admin@overcloud-controller-2 nova]$ ll
total 148
-rw-r-----. 1 root nova   4130 Jul 28 19:53 api-paste.ini
-rw-r-----. 1 nova nova 111964 Sep 11 16:49 nova.conf
-rw-r-----. 1 root nova  20086 Jul 28 19:53 policy.json
-rw-r--r--. 1 root root     72 Aug 21 14:16 release
-rw-r-----. 1 root nova    936 Jul 28 19:53 rootwrap.conf


Also, nova-manage.log seems to be going fine until it gets this error:

2015-09-11 16:49:40.904 30583 DEBUG migrate.versioning.repository [-] Config: OrderedDict([('db_settings', OrderedDict([('__name__', 'db_settings'), ('repository_id', 'nova'), ('version_table', 'migrate_version'), ('required_dbs', '[]')]))]) __init__ /usr/lib/python2.7/site-packages/migrate/versioning/repository.py:83
2015-09-11 16:49:40.924 30583 DEBUG oslo_db.sqlalchemy.session [-] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/session.py:513
2015-09-11 16:49:40.956 30583 INFO migrate.versioning.api [-] 266 -> 267... 
2015-09-11 16:49:41.294 30583 CRITICAL nova [-] OperationalError: (OperationalError) (1061, "Duplicate key name 'uniq_instances0uuid'") 'ALTER TABLE instances ADD CONSTRAINT uniq_instances0uuid UNIQUE (uuid)' ()


__
Ignacio Bravo
LTG Federal, Inc
www.ltgfederal.com
Office: (703) 951-7760

On Sep 10, 2015, at 5:01 PM, Marius Cornea <marius@remote-lab.net> wrote:

Hi,

Can you ssh to the overcloud-controller-2 node and try to manually run
the commands it failed: /usr/bin/nova-manage db sync and glance-manage
--config-file=/etc/glance/glance-registry.conf db_sync? Also check the
nova and glance logs for some indications on why they might have
failed. /var/log/messages and journalctl -l -u os-collect-config could
also indicate more detailed errors.

Thanks,
Marius

On Wed, Sep 9, 2015 at 11:53 PM, Ignacio Bravo <ibravo@ltgfederal.com> wrote:
I was able to move past the network issue (boot order of the servers have
them booting from the 2nd NIC as well, causing them to register with
Foreman, Ups!)

Now the issue is deeper in the deployment: