thank you for your reply. Yes the nodes can reach dhcp, but my understanding is that cloud init starts first than I get ip addresses.
If I restart cloud-init I will see the routes tables being created properly. However, after I restart cloud-init nothing happens, I don't see the deployment to resume, I only see this in the logs:
Jun 19 16:38:19 localhost os-collect-config: 2015-06-19 16:38:19.357 1518 WARNING os_collect_config.heat [-] No auth_url configured.
Jun 19 16:38:19 localhost os-collect-config: 2015-06-19 16:38:19.359 1518 WARNING os_collect_config.request [-] No metadata_url configured.
Jun 19 16:38:19 localhost os-collect-config: 2015-06-19 16:38:19.359 1518 WARNING os-collect-config [-] Source [request] Unavailable.
Jun 19 16:38:19 localhost os-collect-config: 2015-06-19 16:38:19.359 1518 WARNING os_collect_config.local [-] /var/lib/os-collect-config/local-data not found. Skipping
Jun 19 16:38:19 localhost os-collect-config: 2015-06-19 16:38:19.359 1518 WARNING os_collect_config.local [-] No local metadata found (['/var/lib/os-collect-config/local-data'])
[stack@instack ~]$ heat resource-show overcloud Controller
+------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+
| Property | Value |
+------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+
| attributes | { |
| | "attributes": null, |
| | "refs": null |
| | } |
| description | |
| logical_resource_id | Controller |
| physical_resource_id | 89b52bb2-de3b-45c5-8ec4-43c2545b8d04 |
| required_by | allNodesConfig |
| | VipDeployment |
| | ControllerAllNodesDeployment |
| | ControllerIpListMap |
| | CephClusterConfig |
| | ControllerBootstrapNodeConfig |
| | ControllerCephDeployment |
| | ControllerBootstrapNodeDeployment |
| | ControllerClusterConfig |
| | ControllerSwiftDeployment |
| | SwiftDevicesAndProxyConfig |
| | ControllerNodesPostDeployment |
| | ControllerClusterDeployment |
| resource_name | Controller |
| resource_status | CREATE_IN_PROGRESS |
| resource_status_reason | state changed |
| resource_type | OS::Heat::ResourceGroup |
| updated_time | 2015-06-19T17:25:45Z |
+------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+