[Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on RDO Liberty

Boris Derzhavets bderzhavets at hotmail.com
Sun Feb 7 11:01:27 UTC 2016


Daemons to run on VMs generated via heat templates hadoop-master-node and hadoop-worker-node
configured  following :-

[root at ServerCentOS7 2.6.0]# cat node_group_template_master.json
{
    "name": "vanilla-master",
    "flavor": "3",
    "node_processes": [
        "namenode",
        "resourcemanager",
        "historyserver",
        "oozie"
    ],
    "auto_security_group": true
}

[root at ServerCentOS7 2.6.0]# cat node_group_template_worker.json
{
    "name": "vanilla-worker",
    "flavor": "3",
    "node_processes": [
        "datanode",
        "nodemanager"
    ],
    "auto_security_group": true
}

Spawning of Cluster ends up with errors in sahara-api.log :-
 
2016-02-07 13:07:54.376 1418 ERROR sahara.utils.api [req-f70c9137-c7b1-449c-9c0f-716e3dc46dc6 ] Not Found exception occurred: error_code=404, error_message=Object with {'id': u'33417a54-1e73-45d7-bea6-ea3865441f0e'} not found

in sahara-engine.log :-

CommandException: Error during command execution: "mv temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93 /opt/hadoop/etc/hadoop/mapred-site.xml"
Return code: 1
STDERR:
mv: cannot move temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93 to /opt/hadoop/etc/hadoop/mapred-site.xml: No such file or directory

In heat-engine.log I see :-

2016-02-07 12:00:01.721 26853 ERROR stevedore.extension   File "/usr/lib/python2.7/site-packages/heat/engine/clients/os/zaqar.py", line 20, in <module>
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension     from zaqarclient.queues.v1 import client as zaqarclient
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension ImportError: No module named zaqarclient.queues.v1
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] Could not load 'mistral': No module named mistralclient.api
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] No module named mistralclient.api
. . . . .
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension ImportError: No module named barbicanclient
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension
2016-02-07 12:00:01.752 26853 ERROR stevedore.extension [-] Could not load 'designate': No module named designateclient
2016-02-07 12:00:01.753 26853 ERROR stevedore.extension [-] No module named designateclient

and so . Bunch of imports is failing.

I woul also expect path /usr/lib/python2.7/site-packages/sahara/tests/scenario/templates/vanilla/2.6.0 to finish with 2.7.1
Attempt to generate Custer based on Hadoop Vanilla plugin  2.6.0 gets  rejected right away.
Please, advise

Boris.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: sahara-api.log.gz
Type: application/gzip
Size: 4405 bytes
Desc: sahara-api.log.gz
URL: <http://lists.rdoproject.org/pipermail/dev/attachments/20160207/03df1b54/attachment.gz>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: sahara-engine.log.gz
Type: application/gzip
Size: 3622 bytes
Desc: sahara-engine.log.gz
URL: <http://lists.rdoproject.org/pipermail/dev/attachments/20160207/03df1b54/attachment-0001.gz>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: heat-engine.log.gz
Type: application/gzip
Size: 49996 bytes
Desc: heat-engine.log.gz
URL: <http://lists.rdoproject.org/pipermail/dev/attachments/20160207/03df1b54/attachment-0002.gz>


More information about the dev mailing list