[Rdo-list] Failure to launch Hadoop HDP 2.0.6 Cluster via Sahara Wizards on RDO Liberty

[Boris Derzhavets]

I saw   http://sahara-files.mirantis.com/images/upstream/liberty/
question closed.
Boris.
________________________________________
From: rdo-list-bounces at redhat.com <rdo-list-bounces at redhat.com> on behalf of Boris Derzhavets <bderzhavets at hotmail.com>
Sent: Monday, February 8, 2016 1:01 AM
To: rdo-list at redhat.com
Subject: [Rdo-list] Failure to launch Hadoop HDP 2.0.6 Cluster via Sahara Wizards on RDO Liberty

Per   https://bugzilla.redhat.com/show_bug.cgi?id=1298265
plugins CDH 5.0.4 and HDP 2.0.6 with images generated via sahara-image-elements-3.0.0-3.el7ost.noarch
seem to work on RHOSP 8  ( RHEL 7.2)

I have to register Ubutu 14.04 image ( or any other glance image) with SAHARA on RDO Liberty
with corresponding tags "hdp" and "2.0.6"

Then I created Master && Slave templates initializing daemons follow
samples :-
[root at ServerCentOS7 version_2_0_6(keystone_admin)]# cat master.json
{
    "plugin_name": "hdp",
    "hadoop_version": "2.0.6",
    "node_processes": [
        "NAMENODE",
        "AMBARI_SERVER",
        "RESOURCEMANAGER",
        "HISTORYSERVER",
        "ZOOKEEPER_SERVER"
    ],
    "name": "hdp-206-default-master",
    "floating_ip_pool": "{floating_ip_pool}",
    "flavor_id": "{flavor_id}",
    "auto_security_group": "{auto_security_group}",
    "security_groups": "{security_groups}"
}


[root at ServerCentOS7 version_2_0_6(keystone_admin)]# cat worker.json
{
    "plugin_name": "hdp",
    "hadoop_version": "2.0.6",
    "node_processes": [
        "DATANODE",
        "NODEMANAGER"
    ],
    "name": "hdp-206-default-worker",
    "floating_ip_pool": "{floating_ip_pool}",
    "flavor_id": "{flavor_id}",
    "auto_security_group": "{auto_security_group}",
    "security_groups": "{security_groups}

Creating Cluster's template I multiplied by 3 Slave's template
trying to fork 4 VMs at a time.

Finally spawning the HDP 2.0.6 Cluster results
an error /val/log/sahara/sahara-engine.log :-


3eb98f8c6e7] HeatStackException: Heat stack failed with status Resource CREATE failed: resources.hdp-206-default-master: OverQuotaClient: resources[0].resources.hdp-206-cluster1-hdp-206-default-master-b33b997e: Quota exceeded for resources: ['security_group_rule']
26-02-07 21:21:01.359 1384 ERROR sahara.service.ops [instance: none, cluster: 902d7bc4-a0cb-45dc-9e81-33eb98f8c6e7] Error ID: 1826c6f4-bbc2-4c91-be0c-57bdcd02faf2
2016-02-07 21:21:01.359 1384 ERROR sahara.service.ops [instance: none, cluster: 902d7bc4-a0cb-45dc-9e81-33eb98f8c6e7]
2016-02-07 21:21:10.701 1384 WARNING sahara.service.heat.heat_engine [req-c0192e44-e84c-4f59-bf80-19c9584baa39 ] [instance: none, cluster: 902d7bc4-a0cb-45dc-9e81-33eb98f8c6e7] Cluster creation rollback (reason: Heat stack failed with status Resource CREATE failed: resources.hdp-206-default-master: OverQuotaClient: resources[0].resources.hdp-206-cluster1-hdp-206-default-master-b33b997e: Quota exceeded for resources: ['security_group_rule']
Error ID: 1826c6f4-bbc2-4c91-be0c-57bdcd02faf2)
2016-02-07 21:21:10.958 1384 INFO sahara.utils.cluster [req-c0192e44-e84c-4f59-bf80-19c9584baa39 ] [instance: none, cluster: 902d7bc4-a0cb-45dc-9e81-33eb98f8c6e7] Cluster status has been changed. New status=Error

Actually , I don't see downstream sahara-images package on RDO Liberty

[root at ServerCentOS7 ~]# rpm -qa \*sahara\*
openstack-sahara-engine-3.0.0-5.cc218ddgit.el7.noarch
python-saharaclient-0.11.1-1.el7.noarch
openstack-sahara-api-3.0.0-5.cc218ddgit.el7.noarch
openstack-sahara-common-3.0.0-5.cc218ddgit.el7.noarch

I have also noticed that I am not the only one person having such kind of problems :-

https://ask.openstack.org/en/question/84726/what-are-the-minimum-requirements-to-run-sahara-hadoop-cluster-in-liberty/
Per link above :-
"Sahara cluster hangs mostly on Starting phase and returns error. Instances keep running but Hadoop processes do not look properly running when SSH to the new instances."
Question stays unaddressed since 11/18/2015.

Thank you
Boris.





_______________________________________________
Rdo-list mailing list
Rdo-list at redhat.com
https://www.redhat.com/mailman/listinfo/rdo-list

To unsubscribe: rdo-list-unsubscribe at redhat.com