<div dir="ltr">It's likely that the puppet-tripleo patch needs to be applied in Ussuri. I think we switched back to the puppet version at some point which would explain why this is still a problem. <a href="https://review.opendev.org/c/openstack/puppet-tripleo/+/799827">https://review.opendev.org/c/openstack/puppet-tripleo/+/799827</a></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jul 7, 2021 at 7:01 AM Benjamin Zapiec <<a href="mailto:zapiec@gonicus.de">zapiec@gonicus.de</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hello *,<br>
<br>
i have encountered an error after a hard power loss on<br>
nearly each compute node. The neutron-haproxy-ovnmeta container didn't <br>
came up after the hard shutdown. Down below under "error message" i've<br>
posted the exact error message.<br>
<br>
After a quick search i found the following bug reported<br>
in the red hat bug tracker. It looks like the exact same issue.<br>
<br>
<a href="https://bugzilla.redhat.com/show_bug.cgi?id=1797892" rel="noreferrer" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1797892</a><br>
<br>
But it is supposed to fixed in the "Train" release.<br>
<a href="https://bugzilla.redhat.com/show_bug.cgi?id=1797892" rel="noreferrer" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1797892</a><br>
<br>
Any ideas on this? Is it the same issue or something similar?<br>
Would an update to Victoria solve this issue?<br>
<br>
I think it's non of a big deal so since we try to avoid<br>
unexpected shutdowns but it may happen due to power loss.<br>
<br>
<br>
Now some details on the Openstack setup.<br>
We are using Ussuri release and did a pretty basic<br>
tirpleO Setup. We are using 3 Controller Nodes<br>
and 8 Computes with Ceph storage attached.<br>
<br>
I think there is nothing special in our configuration<br>
that may favor this type of issue but if you think<br>
so i will post the necessary configuration details.<br>
<br>
<br>
Error message:<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event [-] Unexpected <br>
exception in notify_loop: neutron_lib.exceptions.ProcessExecutionError: <br>
Exit code: 125; Stdin: ; Stdout: Starting a new child container <br>
neutron-haproxy-ovnmeta-4c8e69e6-3e1a-4d7e-bde0-33241c0d383e<br>
; Stderr: Error: error creating container storage: the container name <br>
"neutron-haproxy-ovnmeta-4c8e69e6-3e1a-4d7e-bde0-33241c0d383e" is <br>
already in use by <br>
"37b687a1d31adf73275ffdcadc3c5fd5ed1a72fe0c2547f38ec571556480c852". You <br>
have to remove that container to be able to reuse that name.: that name <br>
is already in use<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event Traceback (most recent <br>
call last):<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event File <br>
"/usr/lib/python3.6/site-packages/ovsdbapp/event.py", line 143, in <br>
notify_loop<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event match.run(event, <br>
row, updates)<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event File <br>
"/usr/lib/python3.6/site-packages/neutron/agent/ovn/metadata/agent.py", <br>
line 83, in run<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event <br>
self.agent.update_datapath(str(row.datapath.uuid))<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event File <br>
"/usr/lib/python3.6/site-packages/neutron/agent/ovn/metadata/agent.py", <br>
line 342, in update_datapath<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event <br>
self.provision_datapath(datapath)<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event File <br>
"/usr/lib/python3.6/site-packages/neutron/agent/ovn/metadata/agent.py", <br>
line 457, in provision_datapath<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event network_id=datapath)<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event File <br>
"/usr/lib/python3.6/site-packages/neutron/agent/ovn/metadata/driver.py", <br>
line 200, in spawn_monitored_metadata_proxy<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event pm.enable()<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event File <br>
"/usr/lib/python3.6/site-packages/neutron/agent/linux/external_process.py", <br>
line 90, in enable<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event <br>
run_as_root=self.run_as_root)<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event File <br>
"/usr/lib/python3.6/site-packages/neutron/agent/linux/ip_lib.py", line <br>
724, in execute<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event <br>
run_as_root=run_as_root)<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event File <br>
"/usr/lib/python3.6/site-packages/neutron/agent/linux/utils.py", line <br>
147, in execute<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event returncode=returncode)<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event <br>
neutron_lib.exceptions.ProcessExecutionError: Exit code: 125; Stdin: ; <br>
Stdout: Starting a new child container <br>
neutron-haproxy-ovnmeta-4c8e69e6-3e1a-4d7e-bde0-33241c0d383e<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event ; Stderr: Error: error <br>
creating container storage: the container name <br>
"neutron-haproxy-ovnmeta-4c8e69e6-3e1a-4d7e-bde0-33241c0d383e" is <br>
already in use by <br>
"37b687a1d31adf73275ffdcadc3c5fd5ed1a72fe0c2547f38ec571556480c852". You <br>
have to remove that container to be able to reuse that name.: that name <br>
is already in use<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event<br>
2021-06-23 08:11:28.928 4823 ERROR ovsdbapp.event<br>
2021-06-23 08:16:34.975 4823 INFO neutron.agent.ovn.metadata.agent [-] <br>
Port 983831dd-8aae-4b01-9953-8cbce86f89a8 in datapath <br>
d98d35e0-765e-4128-bf7f-ab71b2701986 bound to our chassis<br>
2021-06-23 08:16:35.965 4823 ERROR neutron.agent.linux.utils [-] Exit <br>
code: 125; Stdin: ; Stdout: Starting a new child container <br>
neutron-haproxy-ovnmeta-d98d35e0-765e-4128-bf7f-ab71b2701986<br>
; Stderr: Error: error creating container storage: the container name <br>
"neutron-haproxy-ovnmeta-d98d35e0-765e-4128-bf7f-ab71b2701986" is <br>
already in use by <br>
"bd037c9c5688efd56ccc0521bdebc0bcdc261ffd584e151da6a8e690aefdfb22". You <br>
have to remove that container to be able to reuse that name.: that name <br>
is already in use<br>
<br>
<br>
<br>
<br>
-- <br>
Benjamin Zapiec <<a href="mailto:benjamin.zapiec@gonicus.de" target="_blank">benjamin.zapiec@gonicus.de</a>> (System Engineer)<br>
* GONICUS GmbH * Moehnestrasse 55 (Kaiserhaus) * D-59755 Arnsberg<br>
* Tel.: +49 2932 916-0 * Fax: +49 2932 916-245<br>
* <a href="http://www.GONICUS.de" rel="noreferrer" target="_blank">http://www.GONICUS.de</a><br>
<br>
* Sitz der Gesellschaft: Moehnestrasse 55 * D-59755 Arnsberg<br>
* Geschaeftsfuehrer: Rainer Luelsdorf, Alfred Schroeder<br>
* Vorsitzender des Beirats: Juergen Michels<br>
* Amtsgericht Arnsberg * HRB 1968<br>
<br>
Wir erfüllen unsere Informationspflichten zum Datenschutz gem. der <br>
Artikel 13<br>
und 14 DS-GVO durch Veröffentlichung auf unserer Internetseite unter:<br>
<a href="https://www.gonicus.de/datenschutz" rel="noreferrer" target="_blank">https://www.gonicus.de/datenschutz</a> oder durch Zusendung auf Ihre <br>
formlose Anfrage.<br>
_______________________________________________<br>
users mailing list<br>
<a href="mailto:users@lists.rdoproject.org" target="_blank">users@lists.rdoproject.org</a><br>
<a href="http://lists.rdoproject.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.rdoproject.org/mailman/listinfo/users</a><br>
<br>
To unsubscribe: <a href="mailto:users-unsubscribe@lists.rdoproject.org" target="_blank">users-unsubscribe@lists.rdoproject.org</a><br>
</blockquote></div>