[Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on RDO Liberty

[Boris Derzhavets]

I saw   http://sahara-files.mirantis.com/images/upstream/liberty/
question closed.
Boris.

________________________________________
From: rdo-list-bounces at redhat.com <rdo-list-bounces at redhat.com> on behalf of Boris Derzhavets <bderzhavets at hotmail.com>
Sent: Sunday, February 7, 2016 6:01 AM
To: rdo-list
Subject: [Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on      RDO Liberty

Daemons to run on VMs generated via heat templates hadoop-master-node and hadoop-worker-node
configured  following :-

[root at ServerCentOS7 2.6.0]# cat node_group_template_master.json
{
    "name": "vanilla-master",
    "flavor": "3",
    "node_processes": [
        "namenode",
        "resourcemanager",
        "historyserver",
        "oozie"
    ],
    "auto_security_group": true
}

[root at ServerCentOS7 2.6.0]# cat node_group_template_worker.json
{
    "name": "vanilla-worker",
    "flavor": "3",
    "node_processes": [
        "datanode",
        "nodemanager"
    ],
    "auto_security_group": true
}

Spawning of Cluster ends up with errors in sahara-api.log :-

2016-02-07 13:07:54.376 1418 ERROR sahara.utils.api [req-f70c9137-c7b1-449c-9c0f-716e3dc46dc6 ] Not Found exception occurred: error_code=404, error_message=Object with {'id': u'33417a54-1e73-45d7-bea6-ea3865441f0e'} not found

in sahara-engine.log :-

CommandException: Error during command execution: "mv temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93 /opt/hadoop/etc/hadoop/mapred-site.xml"
Return code: 1
STDERR:
mv: cannot move temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93 to /opt/hadoop/etc/hadoop/mapred-site.xml: No such file or directory

In heat-engine.log I see :-

2016-02-07 12:00:01.721 26853 ERROR stevedore.extension   File "/usr/lib/python2.7/site-packages/heat/engine/clients/os/zaqar.py", line 20, in <module>
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension     from zaqarclient.queues.v1 import client as zaqarclient
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension ImportError: No module named zaqarclient.queues.v1
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] Could not load 'mistral': No module named mistralclient.api
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] No module named mistralclient.api
. . . . .
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension ImportError: No module named barbicanclient
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension
2016-02-07 12:00:01.752 26853 ERROR stevedore.extension [-] Could not load 'designate': No module named designateclient
2016-02-07 12:00:01.753 26853 ERROR stevedore.extension [-] No module named designateclient

and so . Bunch of imports is failing.

I woul also expect path /usr/lib/python2.7/site-packages/sahara/tests/scenario/templates/vanilla/2.6.0 to finish with 2.7.1
Attempt to generate Custer based on Hadoop Vanilla plugin  2.6.0 gets  rejected right away.
Please, advise

Boris.