Daemons to run on VMs generated via heat templates hadoop-master-node and
hadoop-worker-node
configured following :-
[root@ServerCentOS7 2.6.0]# cat node_group_template_master.json
{
"name": "vanilla-master",
"flavor": "3",
"node_processes": [
"namenode",
"resourcemanager",
"historyserver",
"oozie"
],
"auto_security_group": true
}
[root@ServerCentOS7 2.6.0]# cat node_group_template_worker.json
{
"name": "vanilla-worker",
"flavor": "3",
"node_processes": [
"datanode",
"nodemanager"
],
"auto_security_group": true
}
Spawning of Cluster ends up with errors in sahara-api.log :-
2016-02-07 13:07:54.376 1418 ERROR sahara.utils.api
[req-f70c9137-c7b1-449c-9c0f-716e3dc46dc6 ] Not Found exception occurred: error_code=404,
error_message=Object with {'id': u'33417a54-1e73-45d7-bea6-ea3865441f0e'}
not found
in sahara-engine.log :-
CommandException: Error during command execution: "mv
temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93
/opt/hadoop/etc/hadoop/mapred-site.xml"
Return code: 1
STDERR:
mv: cannot move temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93 to
/opt/hadoop/etc/hadoop/mapred-site.xml: No such file or directory
In heat-engine.log I see :-
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension File
"/usr/lib/python2.7/site-packages/heat/engine/clients/os/zaqar.py", line 20, in
<module>
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension from zaqarclient.queues.v1
import client as zaqarclient
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension ImportError: No module named
zaqarclient.queues.v1
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] Could not load
'mistral': No module named mistralclient.api
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] No module named
mistralclient.api
. . . . .
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension ImportError: No module named
barbicanclient
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension
2016-02-07 12:00:01.752 26853 ERROR stevedore.extension [-] Could not load
'designate': No module named designateclient
2016-02-07 12:00:01.753 26853 ERROR stevedore.extension [-] No module named
designateclient
and so . Bunch of imports is failing.
I woul also expect path
/usr/lib/python2.7/site-packages/sahara/tests/scenario/templates/vanilla/2.6.0 to finish
with 2.7.1
Attempt to generate Custer based on Hadoop Vanilla plugin 2.6.0 gets rejected right
away.
Please, advise
Boris.