[Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on RDO Liberty

[Boris Derzhavets]

I've got VMs up and running :-
[root at ServerCentOS7 ~(keystone_admin)]# nova list
+--------------------------------------+------------------------------------+--------+------------+-------------+----------------------------------+
| ID                                   | Name                               | Status | Task State | Power State | Networks                         |
+--------------------------------------+------------------------------------+--------+------------+-------------+----------------------------------+
| fccee6b5-af62-4008-b12b-5966dcf56bd6 | demo-cluster1-hadoop-master-node-0 | ACTIVE | -          | Running     | private=50.0.0.17, 192.168.1.157 |
| e9bbf603-5eb9-45ff-8375-f583742720bf | demo-cluster1-hadoop-work-node-0   | ACTIVE | -          | Running     | private=50.0.0.16, 192.168.1.156 |
+--------------------------------------+------------------------------------+--------+------------+-------------+----------------------------------+

But when I logged into any of them `java -version` reports that java is not  installed.
Looks like I am supposed set up 2 Node Hadoop Cluster manually.

Thanks.
Boris

________________________________________
From: rdo-list-bounces at redhat.com <rdo-list-bounces at redhat.com> on behalf of Boris Derzhavets <bderzhavets at hotmail.com>
Sent: Sunday, February 7, 2016 6:01 AM
To: rdo-list
Subject: [Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on      RDO Liberty

Daemons to run on VMs generated via heat templates hadoop-master-node and hadoop-worker-node
configured  following :-

[root at ServerCentOS7 2.6.0]# cat node_group_template_master.json
{
    "name": "vanilla-master",
    "flavor": "3",
    "node_processes": [
        "namenode",
        "resourcemanager",
        "historyserver",
        "oozie"
    ],
    "auto_security_group": true
}

[root at ServerCentOS7 2.6.0]# cat node_group_template_worker.json
{
    "name": "vanilla-worker",
    "flavor": "3",
    "node_processes": [
        "datanode",
        "nodemanager"
    ],
    "auto_security_group": true
}

Spawning of Cluster ends up with errors in sahara-api.log :-

2016-02-07 13:07:54.376 1418 ERROR sahara.utils.api [req-f70c9137-c7b1-449c-9c0f-716e3dc46dc6 ] Not Found exception occurred: error_code=404, error_message=Object with {'id': u'33417a54-1e73-45d7-bea6-ea3865441f0e'} not found

in sahara-engine.log :-

CommandException: Error during command execution: "mv temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93 /opt/hadoop/etc/hadoop/mapred-site.xml"
Return code: 1
STDERR:
mv: cannot move temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93 to /opt/hadoop/etc/hadoop/mapred-site.xml: No such file or directory

In heat-engine.log I see :-

2016-02-07 12:00:01.721 26853 ERROR stevedore.extension   File "/usr/lib/python2.7/site-packages/heat/engine/clients/os/zaqar.py", line 20, in <module>
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension     from zaqarclient.queues.v1 import client as zaqarclient
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension ImportError: No module named zaqarclient.queues.v1
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] Could not load 'mistral': No module named mistralclient.api
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] No module named mistralclient.api
. . . . .
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension ImportError: No module named barbicanclient
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension
2016-02-07 12:00:01.752 26853 ERROR stevedore.extension [-] Could not load 'designate': No module named designateclient
2016-02-07 12:00:01.753 26853 ERROR stevedore.extension [-] No module named designateclient

and so . Bunch of imports is failing.

I woul also expect path /usr/lib/python2.7/site-packages/sahara/tests/scenario/templates/vanilla/2.6.0 to finish with 2.7.1
Attempt to generate Custer based on Hadoop Vanilla plugin  2.6.0 gets  rejected right away.
Please, advise

Boris.