11:04 a.m.
The RDO Community Newsletter for February is now available on the
website at https://www.rdoproject.org/newsletter/2016-february/
Especially don't miss the report from the RDO Community Day at FOSDEM -
http://rdoproject.org/newsletter/2016-february#fosdem-and-the-rdo-communi...
Thanks for being part of the RDO community!
--Rich
--
Rich Bowen - rbowen(a)redhat.com
OpenStack Community Liaison
http://rdoproject.org/
_______________________________________________
Rdo-newsletter mailing list
Rdo-newsletter(a)redhat.com
https://www.redhat.com/mailman/listinfo/rdo-newsletter
5:01 a.m.
New subject: [Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on RDO Liberty
Daemons to run on VMs generated via heat templates hadoop-master-node and
hadoop-worker-node
configured following :-
[root@ServerCentOS7 2.6.0]# cat node_group_template_master.json
{
"name": "vanilla-master",
"flavor": "3",
"node_processes": [
"namenode",
"resourcemanager",
"historyserver",
"oozie"
],
"auto_security_group": true
}
[root@ServerCentOS7 2.6.0]# cat node_group_template_worker.json
{
"name": "vanilla-worker",
"flavor": "3",
"node_processes": [
"datanode",
"nodemanager"
],
"auto_security_group": true
}
Spawning of Cluster ends up with errors in sahara-api.log :-
2016-02-07 13:07:54.376 1418 ERROR sahara.utils.api
[req-f70c9137-c7b1-449c-9c0f-716e3dc46dc6 ] Not Found exception occurred: error_code=404,
error_message=Object with {'id': u'33417a54-1e73-45d7-bea6-ea3865441f0e'}
not found
in sahara-engine.log :-
CommandException: Error during command execution: "mv
temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93
/opt/hadoop/etc/hadoop/mapred-site.xml"
Return code: 1
STDERR:
mv: cannot move temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93 to
/opt/hadoop/etc/hadoop/mapred-site.xml: No such file or directory
In heat-engine.log I see :-
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension File
"/usr/lib/python2.7/site-packages/heat/engine/clients/os/zaqar.py", line 20, in
<module>
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension from zaqarclient.queues.v1
import client as zaqarclient
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension ImportError: No module named
zaqarclient.queues.v1
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] Could not load
'mistral': No module named mistralclient.api
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] No module named
mistralclient.api
. . . . .
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension ImportError: No module named
barbicanclient
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension
2016-02-07 12:00:01.752 26853 ERROR stevedore.extension [-] Could not load
'designate': No module named designateclient
2016-02-07 12:00:01.753 26853 ERROR stevedore.extension [-] No module named
designateclient
and so . Bunch of imports is failing.
I woul also expect path
/usr/lib/python2.7/site-packages/sahara/tests/scenario/templates/vanilla/2.6.0 to finish
with 2.7.1
Attempt to generate Custer based on Hadoop Vanilla plugin 2.6.0 gets rejected right
away.
Please, advise
Boris.
6:35 a.m.
New subject: [Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on RDO Liberty
I've got VMs up and running :-
[root@ServerCentOS7 ~(keystone_admin)]# nova list
+--------------------------------------+------------------------------------+--------+------------+-------------+----------------------------------+
| ID | Name | Status |
Task State | Power State | Networks |
+--------------------------------------+------------------------------------+--------+------------+-------------+----------------------------------+
| fccee6b5-af62-4008-b12b-5966dcf56bd6 | demo-cluster1-hadoop-master-node-0 | ACTIVE | -
| Running | private=50.0.0.17, 192.168.1.157 |
| e9bbf603-5eb9-45ff-8375-f583742720bf | demo-cluster1-hadoop-work-node-0 | ACTIVE | -
| Running | private=50.0.0.16, 192.168.1.156 |
+--------------------------------------+------------------------------------+--------+------------+-------------+----------------------------------+
But when I logged into any of them `java -version` reports that java is not installed.
Looks like I am supposed set up 2 Node Hadoop Cluster manually.
Thanks.
Boris
________________________________________
From: rdo-list-bounces(a)redhat.com <rdo-list-bounces(a)redhat.com> on behalf of Boris
Derzhavets <bderzhavets(a)hotmail.com>
Sent: Sunday, February 7, 2016 6:01 AM
To: rdo-list
Subject: [Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on RDO
Liberty
Daemons to run on VMs generated via heat templates hadoop-master-node and
hadoop-worker-node
configured following :-
[root@ServerCentOS7 2.6.0]# cat node_group_template_master.json
{
"name": "vanilla-master",
"flavor": "3",
"node_processes": [
"namenode",
"resourcemanager",
"historyserver",
"oozie"
],
"auto_security_group": true
}
[root@ServerCentOS7 2.6.0]# cat node_group_template_worker.json
{
"name": "vanilla-worker",
"flavor": "3",
"node_processes": [
"datanode",
"nodemanager"
],
"auto_security_group": true
}
Spawning of Cluster ends up with errors in sahara-api.log :-
2016-02-07 13:07:54.376 1418 ERROR sahara.utils.api
[req-f70c9137-c7b1-449c-9c0f-716e3dc46dc6 ] Not Found exception occurred: error_code=404,
error_message=Object with {'id': u'33417a54-1e73-45d7-bea6-ea3865441f0e'}
not found
in sahara-engine.log :-
CommandException: Error during command execution: "mv
temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93
/opt/hadoop/etc/hadoop/mapred-site.xml"
Return code: 1
STDERR:
mv: cannot move temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93 to
/opt/hadoop/etc/hadoop/mapred-site.xml: No such file or directory
In heat-engine.log I see :-
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension File
"/usr/lib/python2.7/site-packages/heat/engine/clients/os/zaqar.py", line 20, in
<module>
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension from zaqarclient.queues.v1
import client as zaqarclient
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension ImportError: No module named
zaqarclient.queues.v1
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] Could not load
'mistral': No module named mistralclient.api
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] No module named
mistralclient.api
. . . . .
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension ImportError: No module named
barbicanclient
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension
2016-02-07 12:00:01.752 26853 ERROR stevedore.extension [-] Could not load
'designate': No module named designateclient
2016-02-07 12:00:01.753 26853 ERROR stevedore.extension [-] No module named
designateclient
and so . Bunch of imports is failing.
I woul also expect path
/usr/lib/python2.7/site-packages/sahara/tests/scenario/templates/vanilla/2.6.0 to finish
with 2.7.1
Attempt to generate Custer based on Hadoop Vanilla plugin 2.6.0 gets rejected right
away.
Please, advise
Boris.
11:21 a.m.
New subject: [Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on RDO Liberty
I have increased number data nodes up to 3 (as required ) same error.
________________________________________
From: rdo-list-bounces(a)redhat.com <rdo-list-bounces(a)redhat.com> on behalf of Boris
Derzhavets <bderzhavets(a)hotmail.com>
Sent: Sunday, February 7, 2016 7:35 AM
To: rdo-list
Subject: Re: [Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on
RDO Liberty
I've got VMs up and running :-
[root@ServerCentOS7 ~(keystone_admin)]# nova list
+--------------------------------------+------------------------------------+--------+------------+-------------+----------------------------------+
| ID | Name | Status |
Task State | Power State | Networks |
+--------------------------------------+------------------------------------+--------+------------+-------------+----------------------------------+
| fccee6b5-af62-4008-b12b-5966dcf56bd6 | demo-cluster1-hadoop-master-node-0 | ACTIVE | -
| Running | private=50.0.0.17, 192.168.1.157 |
| e9bbf603-5eb9-45ff-8375-f583742720bf | demo-cluster1-hadoop-work-node-0 | ACTIVE | -
| Running | private=50.0.0.16, 192.168.1.156 |
+--------------------------------------+------------------------------------+--------+------------+-------------+----------------------------------+
But when I logged into any of them `java -version` reports that java is not installed.
Looks like I am supposed set up 2 Node Hadoop Cluster manually.
Thanks.
Boris
________________________________________
From: rdo-list-bounces(a)redhat.com <rdo-list-bounces(a)redhat.com> on behalf of Boris
Derzhavets <bderzhavets(a)hotmail.com>
Sent: Sunday, February 7, 2016 6:01 AM
To: rdo-list
Subject: [Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on RDO
Liberty
Daemons to run on VMs generated via heat templates hadoop-master-node and
hadoop-worker-node
configured following :-
[root@ServerCentOS7 2.6.0]# cat node_group_template_master.json
{
"name": "vanilla-master",
"flavor": "3",
"node_processes": [
"namenode",
"resourcemanager",
"historyserver",
"oozie"
],
"auto_security_group": true
}
[root@ServerCentOS7 2.6.0]# cat node_group_template_worker.json
{
"name": "vanilla-worker",
"flavor": "3",
"node_processes": [
"datanode",
"nodemanager"
],
"auto_security_group": true
}
Spawning of Cluster ends up with errors in sahara-api.log :-
2016-02-07 13:07:54.376 1418 ERROR sahara.utils.api
[req-f70c9137-c7b1-449c-9c0f-716e3dc46dc6 ] Not Found exception occurred: error_code=404,
error_message=Object with {'id': u'33417a54-1e73-45d7-bea6-ea3865441f0e'}
not found
in sahara-engine.log :-
CommandException: Error during command execution: "mv
temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93
/opt/hadoop/etc/hadoop/mapred-site.xml"
Return code: 1
STDERR:
mv: cannot move temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93 to
/opt/hadoop/etc/hadoop/mapred-site.xml: No such file or directory
In heat-engine.log I see :-
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension File
"/usr/lib/python2.7/site-packages/heat/engine/clients/os/zaqar.py", line 20, in
<module>
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension from zaqarclient.queues.v1
import client as zaqarclient
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension ImportError: No module named
zaqarclient.queues.v1
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] Could not load
'mistral': No module named mistralclient.api
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] No module named
mistralclient.api
. . . . .
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension ImportError: No module named
barbicanclient
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension
2016-02-07 12:00:01.752 26853 ERROR stevedore.extension [-] Could not load
'designate': No module named designateclient
2016-02-07 12:00:01.753 26853 ERROR stevedore.extension [-] No module named
designateclient
and so . Bunch of imports is failing.
I woul also expect path
/usr/lib/python2.7/site-packages/sahara/tests/scenario/templates/vanilla/2.6.0 to finish
with 2.7.1
Attempt to generate Custer based on Hadoop Vanilla plugin 2.6.0 gets rejected right
away.
Please, advise
Boris.
_______________________________________________
Rdo-list mailing list
Rdo-list(a)redhat.com
https://www.redhat.com/mailman/listinfo/rdo-list
To unsubscribe: rdo-list-unsubscribe(a)redhat.com
3:07 a.m.
New subject: [Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on RDO Liberty
I saw http://sahara-files.mirantis.com/images/upstream/liberty/
question closed.
Boris.
________________________________________
From: rdo-list-bounces(a)redhat.com <rdo-list-bounces(a)redhat.com> on behalf of Boris
Derzhavets <bderzhavets(a)hotmail.com>
Sent: Sunday, February 7, 2016 6:01 AM
To: rdo-list
Subject: [Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on RDO
Liberty
Daemons to run on VMs generated via heat templates hadoop-master-node and
hadoop-worker-node
configured following :-
[root@ServerCentOS7 2.6.0]# cat node_group_template_master.json
{
"name": "vanilla-master",
"flavor": "3",
"node_processes": [
"namenode",
"resourcemanager",
"historyserver",
"oozie"
],
"auto_security_group": true
}
[root@ServerCentOS7 2.6.0]# cat node_group_template_worker.json
{
"name": "vanilla-worker",
"flavor": "3",
"node_processes": [
"datanode",
"nodemanager"
],
"auto_security_group": true
}
Spawning of Cluster ends up with errors in sahara-api.log :-
2016-02-07 13:07:54.376 1418 ERROR sahara.utils.api
[req-f70c9137-c7b1-449c-9c0f-716e3dc46dc6 ] Not Found exception occurred: error_code=404,
error_message=Object with {'id': u'33417a54-1e73-45d7-bea6-ea3865441f0e'}
not found
in sahara-engine.log :-
CommandException: Error during command execution: "mv
temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93
/opt/hadoop/etc/hadoop/mapred-site.xml"
Return code: 1
STDERR:
mv: cannot move temp-file-c25429c6-a9b7-4a1e-9847-c19974b81d93 to
/opt/hadoop/etc/hadoop/mapred-site.xml: No such file or directory
In heat-engine.log I see :-
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension File
"/usr/lib/python2.7/site-packages/heat/engine/clients/os/zaqar.py", line 20, in
<module>
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension from zaqarclient.queues.v1
import client as zaqarclient
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension ImportError: No module named
zaqarclient.queues.v1
2016-02-07 12:00:01.721 26853 ERROR stevedore.extension
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] Could not load
'mistral': No module named mistralclient.api
2016-02-07 12:00:01.732 26853 ERROR stevedore.extension [-] No module named
mistralclient.api
. . . . .
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension ImportError: No module named
barbicanclient
2016-02-07 12:00:01.737 26853 ERROR stevedore.extension
2016-02-07 12:00:01.752 26853 ERROR stevedore.extension [-] Could not load
'designate': No module named designateclient
2016-02-07 12:00:01.753 26853 ERROR stevedore.extension [-] No module named
designateclient
and so . Bunch of imports is failing.
I woul also expect path
/usr/lib/python2.7/site-packages/sahara/tests/scenario/templates/vanilla/2.6.0 to finish
with 2.7.1
Attempt to generate Custer based on Hadoop Vanilla plugin 2.6.0 gets rejected right
away.
Please, advise
Boris.
5:33 a.m.
New subject: [Rdo-list] Failure to launch Hadoop Cluster via Sahara Wizards on RDO Liberty
On Monday 08 of February 2016 09:07:06 Boris Derzhavets wrote:
I saw http://sahara-files.mirantis.com/images/upstream/liberty/
question closed.
What do you mean? Did you retry with the image there and it worked?
Also, can you please answer on the bug you opened?
https://bugzilla.redhat.com/show_bug.cgi?id=1305345
--
Luigi
3001
days inactive
3005
days old
5 comments
3 participants
participants (3)
-
Boris Derzhavets -
Luigi Toscano -
Rich Bowen