<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    Hi,<br>
    In addition to that I have discovered that there are the following:<br>
    <br>
    [root@dhcp-4-126 ~]# ps aux |grep dns<br>
    <font color="#ff0000">nobody    2320  0.0  0.0  12888   576 ?       
      S    09:31   0:00 /usr/sbin/dnsmasq --strict-order --local=//
      --domain-needed --pid-file=/var/run/libvirt/network/default.pid
      --conf-file= --except-interface lo --bind-interfaces
      --listen-address 192.168.122.1 --dhcp-range
      192.168.122.2,192.168.122.254 --dhcp-</font>leasefile=/var/lib/libvirt/dnsmasq/default.leases
    --dhcp-lease-max=253 --dhcp-no-override
    --dhcp-hostsfile=/var/lib/libvirt/dnsmasq/default.hostsfile
    --addn-hosts=/var/lib/libvirt/dnsmasq/default.addnhosts<br>
    nobody    2718  0.0  0.0  12884   600 ?        S    09:32   0:00
    /usr/sbin/dnsmasq --no-hosts --no-resolv --strict-order
    --bind-interfaces --interface=tapd0ed5836-38 --except-interface=lo
    --pid-file=/var/lib/quantum/dhcp/45f9b635-c996-4230-89df-b8c6ac1adb71/pid
    --dhcp-hostsfile=/var/lib/quantum/dhcp/45f9b635-c996-4230-89df-b8c6ac1adb71/host
    --dhcp-optsfile=/var/lib/quantum/dhcp/45f9b635-c996-4230-89df-b8c6ac1adb71/opts
    --dhcp-script=/usr/bin/quantum-dhcp-agent-dnsmasq-lease-update
    --leasefile-ro --dhcp-range=set:tag0,10.0.0.0,static,120s
    --conf-file= --domain=openstacklocal<br>
    root      2719  0.0  0.0  12884   208 ?        S    09:32   0:00
    /usr/sbin/dnsmasq --no-hosts --no-resolv --strict-order
    --bind-interfaces --interface=tapd0ed5836-38 --except-interface=lo
    --pid-file=/var/lib/quantum/dhcp/45f9b635-c996-4230-89df-b8c6ac1adb71/pid
    --dhcp-hostsfile=/var/lib/quantum/dhcp/45f9b635-c996-4230-89df-b8c6ac1adb71/host
    --dhcp-optsfile=/var/lib/quantum/dhcp/45f9b635-c996-4230-89df-b8c6ac1adb71/opts
    --dhcp-script=/usr/bin/quantum-dhcp-agent-dnsmasq-lease-update
    --leasefile-ro --dhcp-range=set:tag0,10.0.0.0,static,120s
    --conf-file= --domain=openstacklocal<br>
    root      6054  0.0  0.0 103248   840 pts/0    S+   09:39   0:00
    grep dns<br>
    <br>
    When the process 2320 is killed the VM receives its address.<br>
    <br>
    So in short we have some hardening to do :)<br>
    With patches for the issues below and shutting down the
    aforementioned process I have a VM getting a address.<br>
    <br>
    Thanks<br>
    Gary<br>
    <br>
    <br>
    On 04/28/2013 01:55 PM, Gary Kotton wrote:
    <blockquote cite="mid:517D003B.6030802@redhat.com" type="cite">
      <meta content="text/html; charset=ISO-8859-1"
        http-equiv="Content-Type">
      Hi,<br>
      I have found a few problems and hopefully one or more may be
      related to the case that you have experienced:<br>
      1. When using OVS it is important you run the service
      ovs-quantum-cleanup when the host boots. This is due to the fact
      that OVS will store all tap device. This causes havoc when
      restarting hosts (in particular ones that have dhcp and l3
      agents). So please make sure you have run "chkconfig
      quantum-ovs-cleanup on" on all hosts that are running the OVS. You
      can verify if this is the case by checking of the DHCP agent has
      created an IP address on the host. [Please note that we have a
      problem here - in the file /etc/init.d/quantum-ovs-cleanup
      "--config-file /usr/share/$proj/$proj-dist.conf" needs to be
      removed].<br>
      2. Which dnsmasq version are you using? If this is 2.48 then there
      is a problem with the DHCP agent running. We are in the process of
      resolving this. If you make use of a version with tag support then
      this will work.<br>
      3. The quantum client needs to be updated to support the security
      groups.<br>
      Hopefully we will have solutions for all of the above ASAP.<br>
      Thanks<br>
      Gary<br>
      <br>
      <br>
      <br>
      On 04/28/2013 12:26 PM, Gary Kotton wrote:
      <blockquote cite="mid:517CEB42.1010005@redhat.com" type="cite">
        <meta content="text/html; charset=ISO-8859-1"
          http-equiv="Content-Type">
        Hi,<br>
        I have been able to reproduce the problem. I'll get back to you
        as soon as I have any information.<br>
        Thanks<br>
        Gary<br>
        <br>
        On 04/28/2013 11:56 AM, Zhang, Kimi (NSN - CN/Cheng Du) wrote:
        <blockquote
cite="mid:90CF2062F86FD8498897037C7FBBC0880470FB@SGSIMBX001.nsn-intra.net"
          type="cite">
          <meta http-equiv="Content-Type" content="text/html;
            charset=ISO-8859-1">
          <meta name="Generator" content="Microsoft Word 12 (filtered
            medium)">
          <style><!--
/* Font Definitions */
@font-face
        {font-family:Wingdings;
        panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
        {font-family:宋体;
        panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
        {font-family:微软雅黑;
        panose-1:2 11 5 3 2 2 4 2 2 4;}
@font-face
        {font-family:"\@微软雅黑";
        panose-1:2 11 5 3 2 2 4 2 2 4;}
@font-face
        {font-family:"\@宋体";
        panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
        {font-family:Consolas;
        panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0cm;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman","serif";
        color:black;}
a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {mso-style-priority:99;
        color:purple;
        text-decoration:underline;}
pre
        {mso-style-priority:99;
        mso-style-link:"HTML Preformatted Char";
        margin:0cm;
        margin-bottom:.0001pt;
        font-size:10.0pt;
        font-family:"Courier New";
        color:black;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
        {mso-style-priority:99;
        mso-style-link:"Balloon Text Char";
        margin:0cm;
        margin-bottom:.0001pt;
        font-size:8.0pt;
        font-family:"Tahoma","sans-serif";
        color:black;}
span.HTMLPreformattedChar
        {mso-style-name:"HTML Preformatted Char";
        mso-style-priority:99;
        mso-style-link:"HTML Preformatted";
        font-family:Consolas;
        color:black;}
span.BalloonTextChar
        {mso-style-name:"Balloon Text Char";
        mso-style-priority:99;
        mso-style-link:"Balloon Text";
        font-family:"Tahoma","sans-serif";
        color:black;}
p.emailquote, li.emailquote, div.emailquote
        {mso-style-name:emailquote;
        mso-margin-top-alt:auto;
        margin-right:0cm;
        mso-margin-bottom-alt:auto;
        margin-left:1.0pt;
        font-size:12.0pt;
        font-family:"Times New Roman","serif";
        color:black;}
span.EmailStyle22
        {mso-style-type:personal;
        font-family:"Calibri","sans-serif";
        color:#1F497D;}
span.EmailStyle23
        {mso-style-type:personal;
        font-family:"Calibri","sans-serif";
        color:#1F497D;}
span.EmailStyle24
        {mso-style-type:personal;
        font-family:"Calibri","sans-serif";
        color:#1F497D;}
span.EmailStyle25
        {mso-style-type:personal;
        font-family:"Calibri","sans-serif";
        color:#1F497D;}
span.EmailStyle26
        {mso-style-type:personal;
        font-family:"Calibri","sans-serif";
        color:#1F497D;}
span.EmailStyle27
        {mso-style-type:personal;
        font-family:"Calibri","sans-serif";
        color:#1F497D;}
span.EmailStyle28
        {mso-style-type:personal-reply;
        font-family:"Calibri","sans-serif";
        color:#1F497D;}
.MsoChpDefault
        {mso-style-type:export-only;
        font-size:10.0pt;}
@page WordSection1
        {size:612.0pt 792.0pt;
        margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
        {page:WordSection1;}
/* List Definitions */
@list l0
        {mso-list-id:42677692;
        mso-list-template-ids:1890857908;}
@list l0:level1
        {mso-level-tab-stop:36.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level2
        {mso-level-tab-stop:72.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level3
        {mso-level-tab-stop:108.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level4
        {mso-level-tab-stop:144.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level5
        {mso-level-tab-stop:180.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level6
        {mso-level-tab-stop:216.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level7
        {mso-level-tab-stop:252.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level8
        {mso-level-tab-stop:288.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l0:level9
        {mso-level-tab-stop:324.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l1
        {mso-list-id:272828655;
        mso-list-template-ids:-826647706;}
@list l1:level1
        {mso-level-start-at:2;
        mso-level-tab-stop:36.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l1:level2
        {mso-level-tab-stop:72.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l1:level3
        {mso-level-tab-stop:108.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l1:level4
        {mso-level-tab-stop:144.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l1:level5
        {mso-level-tab-stop:180.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l1:level6
        {mso-level-tab-stop:216.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l1:level7
        {mso-level-tab-stop:252.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l1:level8
        {mso-level-tab-stop:288.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l1:level9
        {mso-level-tab-stop:324.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l2
        {mso-list-id:333263871;
        mso-list-template-ids:-389783972;}
@list l2:level1
        {mso-level-start-at:3;
        mso-level-tab-stop:36.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l2:level2
        {mso-level-tab-stop:72.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l2:level3
        {mso-level-tab-stop:108.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l2:level4
        {mso-level-tab-stop:144.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l2:level5
        {mso-level-tab-stop:180.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l2:level6
        {mso-level-tab-stop:216.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l2:level7
        {mso-level-tab-stop:252.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l2:level8
        {mso-level-tab-stop:288.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l2:level9
        {mso-level-tab-stop:324.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l3
        {mso-list-id:574122068;
        mso-list-template-ids:1826642750;}
@list l3:level1
        {mso-level-number-format:bullet;
        mso-level-text:\F0B7;
        mso-level-tab-stop:36.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;
        mso-ansi-font-size:10.0pt;
        font-family:Symbol;}
@list l3:level2
        {mso-level-tab-stop:72.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l3:level3
        {mso-level-tab-stop:108.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l3:level4
        {mso-level-tab-stop:144.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l3:level5
        {mso-level-tab-stop:180.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l3:level6
        {mso-level-tab-stop:216.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l3:level7
        {mso-level-tab-stop:252.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l3:level8
        {mso-level-tab-stop:288.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l3:level9
        {mso-level-tab-stop:324.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l4
        {mso-list-id:799767944;
        mso-list-template-ids:853071402;}
@list l4:level1
        {mso-level-start-at:5;
        mso-level-tab-stop:36.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l4:level2
        {mso-level-tab-stop:72.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l4:level3
        {mso-level-tab-stop:108.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l4:level4
        {mso-level-tab-stop:144.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l4:level5
        {mso-level-tab-stop:180.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l4:level6
        {mso-level-tab-stop:216.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l4:level7
        {mso-level-tab-stop:252.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l4:level8
        {mso-level-tab-stop:288.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l4:level9
        {mso-level-tab-stop:324.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l5
        {mso-list-id:1510370860;
        mso-list-template-ids:-789040992;}
@list l5:level1
        {mso-level-number-format:bullet;
        mso-level-text:\F0B7;
        mso-level-tab-stop:36.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;
        mso-ansi-font-size:10.0pt;
        font-family:Symbol;}
@list l5:level2
        {mso-level-tab-stop:72.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l5:level3
        {mso-level-tab-stop:108.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l5:level4
        {mso-level-tab-stop:144.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l5:level5
        {mso-level-tab-stop:180.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l5:level6
        {mso-level-tab-stop:216.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l5:level7
        {mso-level-tab-stop:252.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l5:level8
        {mso-level-tab-stop:288.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l5:level9
        {mso-level-tab-stop:324.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l6
        {mso-list-id:1571231664;
        mso-list-template-ids:-1073566560;}
@list l6:level1
        {mso-level-start-at:4;
        mso-level-tab-stop:36.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l6:level2
        {mso-level-tab-stop:72.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l6:level3
        {mso-level-tab-stop:108.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l6:level4
        {mso-level-tab-stop:144.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l6:level5
        {mso-level-tab-stop:180.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l6:level6
        {mso-level-tab-stop:216.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l6:level7
        {mso-level-tab-stop:252.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l6:level8
        {mso-level-tab-stop:288.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l6:level9
        {mso-level-tab-stop:324.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l7
        {mso-list-id:1571498533;
        mso-list-template-ids:-339153802;}
@list l7:level1
        {mso-level-number-format:bullet;
        mso-level-text:\F0B7;
        mso-level-tab-stop:36.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;
        mso-ansi-font-size:10.0pt;
        font-family:Symbol;}
@list l7:level2
        {mso-level-tab-stop:72.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l7:level3
        {mso-level-tab-stop:108.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l7:level4
        {mso-level-tab-stop:144.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l7:level5
        {mso-level-tab-stop:180.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l7:level6
        {mso-level-tab-stop:216.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l7:level7
        {mso-level-tab-stop:252.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l7:level8
        {mso-level-tab-stop:288.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l7:level9
        {mso-level-tab-stop:324.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l8
        {mso-list-id:1971671850;
        mso-list-template-ids:-2042486348;}
@list l8:level1
        {mso-level-number-format:bullet;
        mso-level-text:\F0B7;
        mso-level-tab-stop:36.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;
        mso-ansi-font-size:10.0pt;
        font-family:Symbol;}
@list l8:level2
        {mso-level-tab-stop:72.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l8:level3
        {mso-level-tab-stop:108.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l8:level4
        {mso-level-tab-stop:144.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l8:level5
        {mso-level-tab-stop:180.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l8:level6
        {mso-level-tab-stop:216.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l8:level7
        {mso-level-tab-stop:252.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l8:level8
        {mso-level-tab-stop:288.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
@list l8:level9
        {mso-level-tab-stop:324.0pt;
        mso-level-number-position:left;
        text-indent:-18.0pt;}
ol
        {margin-bottom:0cm;}
ul
        {margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
          <div class="WordSection1">
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Yes,


                I did run quantum-dhcp-setup on network node.<o:p></o:p></span></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thanks,


                good luck there.<o:p></o:p></span></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
            <div>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Regards,<o:p></o:p></span></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Kimi


                  Zhang<o:p></o:p></span></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">MP:


                  +86 186 0800 8182<o:p></o:p></span></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Call


                  me(NCS): <a moz-do-not-send="true"
                    href="sip:+86018608008182">sip:+86018608008182</a><o:p></o:p></span></p>
            </div>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
            <div>
              <div style="border:none;border-top:solid #B5C4DF
                1.0pt;padding:3.0pt 0cm 0cm 0cm">
                <p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">
                    ext Gary Kotton [<a moz-do-not-send="true"
                      class="moz-txt-link-freetext"
                      href="mailto:gkotton@redhat.com">mailto:gkotton@redhat.com</a>]
                    <br>
                    <b>Sent:</b> Sunday, April 28, 2013 4:47 PM<br>
                    <b>To:</b> Zhang, Kimi (NSN - CN/Cheng Du)<br>
                    <b>Cc:</b> <a moz-do-not-send="true"
                      class="moz-txt-link-abbreviated"
                      href="mailto:rdo-list@redhat.com">rdo-list@redhat.com</a><br>
                    <b>Subject:</b> Re: [Rdo-list] [Grizzly] Network
                    problem with Quantum + Openvswitch + Vlan<o:p></o:p></span></p>
              </div>
            </div>
            <p class="MsoNormal"><o:p> </o:p></p>
            <p class="MsoNormal">Thanks.<br>
              One more question - on the network node, did you run
              quantum-dhcp-setup?<br>
              I am nearly ready with my setup. Hopefully I'll have a
              reproduction or some additional questions.<br>
              Thanks<br>
              Gary<br>
              <br>
              On 04/28/2013 11:41 AM, Zhang, Kimi (NSN - CN/Cheng Du)
              wrote: <o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Sure,


                my answers below. :)</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Regards,</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Kimi


                  Zhang</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">MP:


                  +86 186 0800 8182</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Call


                  me(NCS): <a moz-do-not-send="true"
                    href="sip:+86018608008182">sip:+86018608008182</a></span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <div style="border:none;border-top:solid #B5C4DF
                1.0pt;padding:3.0pt 0cm 0cm 0cm">
                <p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">
                    ext Gary Kotton [<a moz-do-not-send="true"
                      href="mailto:gkotton@redhat.com">mailto:gkotton@redhat.com</a>]
                    <br>
                    <b>Sent:</b> Sunday, April 28, 2013 4:31 PM<br>
                    <b>To:</b> Zhang, Kimi (NSN - CN/Cheng Du)<br>
                    <b>Cc:</b> <a moz-do-not-send="true"
                      href="mailto:rdo-list@redhat.com">rdo-list@redhat.com</a><br>
                    <b>Subject:</b> Re: [Rdo-list] [Grizzly] Network
                    problem with Quantum + Openvswitch + Vlan</span><o:p></o:p></p>
              </div>
            </div>
            <p class="MsoNormal"> <o:p></o:p></p>
            <p class="MsoNormal">Hi,<br>
              I have a few questions (please be patient with me):<br>
              1. On the compute node, which services are running?<o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><A>


                nova-compute, nova-novncproxy,
                quantum-openvswitch-agent, openvswitch</span><o:p></o:p></p>
            <p class="MsoNormal"><br>
              2. Can you please print the iptables on the compute node?<o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><A>


                I disabled it already, here's output before I do it.</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# iptables-save</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">#
                Generated by iptables-save v1.4.7 on Sun Apr 28 16:37:18
                2013</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">*filter</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:INPUT


                ACCEPT [22634:3487580]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:FORWARD


                ACCEPT [22:704]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:OUTPUT


                ACCEPT [22619:5860198]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-FORWARD


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-INPUT


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-OUTPUT


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-inst-26


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-local


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-provider


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-sg-fallback


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-filter-top


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                INPUT -j nova-compute-INPUT </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                FORWARD -j nova-filter-top </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                FORWARD -j nova-compute-FORWARD </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                OUTPUT -j nova-filter-top </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                OUTPUT -j nova-compute-OUTPUT </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-FORWARD -s 0.0.0.0/32 -d 255.255.255.255/32
                -p udp -m udp --sport 68 --dport 67 -j ACCEPT </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-INPUT -s 0.0.0.0/32 -d 255.255.255.255/32
                -p udp -m udp --sport 68 --dport 67 -j ACCEPT </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-inst-26 -m state --state INVALID -j DROP </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-inst-26 -m state --state
                RELATED,ESTABLISHED -j ACCEPT </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-inst-26 -j nova-compute-provider </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-inst-26 -s 172.1.1.3/32 -p udp -m udp
                --sport 67 --dport 68 -j ACCEPT </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-inst-26 -s 172.1.1.0/24 -j ACCEPT </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-inst-26 -p icmp -j ACCEPT </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-inst-26 -p tcp -m tcp --dport 22 -j ACCEPT
              </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-inst-26 -j nova-compute-sg-fallback </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-local -d 172.1.1.5/32 -j
                nova-compute-inst-26 </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-sg-fallback -j DROP </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-filter-top -j nova-compute-local </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">COMMIT</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">#
                Completed on Sun Apr 28 16:37:18 2013</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">#
                Generated by iptables-save v1.4.7 on Sun Apr 28 16:37:18
                2013</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">*mangle</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:PREROUTING


                ACCEPT [22733:3519752]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:INPUT


                ACCEPT [22733:3519752]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:FORWARD


                ACCEPT [175:50468]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:OUTPUT


                ACCEPT [22705:5868566]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:POSTROUTING


                ACCEPT [22880:5919034]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-POSTROUTING


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                POSTROUTING -j nova-compute-POSTROUTING </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">COMMIT</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">#
                Completed on Sun Apr 28 16:37:18 2013</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">#
                Generated by iptables-save v1.4.7 on Sun Apr 28 16:37:18
                2013</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">*nat</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:PREROUTING


                ACCEPT [16:14570]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:POSTROUTING


                ACCEPT [338:22855]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:OUTPUT


                ACCEPT [331:20579]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-OUTPUT


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-POSTROUTING


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-PREROUTING


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-float-snat


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-compute-snat


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:nova-postrouting-bottom


                - [0:0]</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                PREROUTING -j nova-compute-PREROUTING </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                POSTROUTING -j nova-compute-POSTROUTING </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                POSTROUTING -j nova-postrouting-bottom </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                OUTPUT -j nova-compute-OUTPUT </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-compute-snat -j nova-compute-float-snat </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-A


                nova-postrouting-bottom -j nova-compute-snat </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">COMMIT</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">#
                Completed on Sun Apr 28 16:37:18 2013</span><o:p></o:p></p>
            <p class="MsoNormal"><br>
              3. Can you please print the flow table rules (ovs-dpctl
              dump-flows br-int)?<o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><A>


              </span>I suppose you mean ovs-ofctl dump-flows br-int ?<o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# ovs-ofctl dump-flows br-int </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">NXST_FLOW


                reply (xid=0x4):</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">cookie=0x0,


                duration=4125.444s, table=0, n_packets=1707,
                n_bytes=90606, idle_age=12, priority=1 actions=NORMAL</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">cookie=0x0,


                duration=4123.006s, table=0, n_packets=143,
                n_bytes=8688, idle_age=20, priority=2,in_port=1
                actions=drop</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">cookie=0x0,


                duration=3349.566s, table=0, n_packets=0, n_bytes=0,
                idle_age=3349, priority=3,in_port=1,dl_vlan=1001
                actions=mod_vlan_vid:1,NORMAL</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Here’s


                also ovs-dpctl show:</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# ovs-dpctl show</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">system@br-p3p1:</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                lookups: hit:3967 missed:314 lost:0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                flows: 1</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                port 0: br-p3p1 (internal)</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                port 1: p3p1</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                port 2: phy-br-p3p1</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">system@br-int:</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                lookups: hit:1575 missed:302 lost:0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                flows: 0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                port 0: br-int (internal)</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                port 1: int-br-p3p1</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                port 4: qvo39242f22-ec</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><br>
              Thanks<br>
              Gary<br>
              <br>
              On 04/28/2013 11:17 AM, Zhang, Kimi (NSN - CN/Cheng Du)
              wrote: <o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi</span><span
                style="font-size:11.0pt;font-family:"微软雅黑",&
                amp; quot; sans-serif"" lang="ZH-CN">,</span><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
                Gary</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I
                tried capture packet while keeping VM to restart it’s
                network.</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I
                can see dhcp request broadcast packet on tap, qbr, qvb
                and qvo interfaces.</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Failed


                to see packet on int-br-p3p1 on bridge br-int. </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Not


                sure if it has something to do with openflow setting?  I
                attach some ovs-ofctl outputs</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I
                have not  seen “veth” port anywhere…</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">---Record---</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# brctl show </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">bridge


                name     bridge id               STP enabled    
                interfaces</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">qbr39242f22-ec         


                8000.c6f95e6a859a       no              qvb39242f22-ec</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">                                                       


                tap39242f22-ec</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">virbr0         


                8000.525400c47f62       yes             virbr0-nic</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# ovs-vsctl show</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">5660d1b5-1f26-46fc-bcb7-0ccfd06fe57b</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">   


                Bridge br-int</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                Port br-int</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">           


                Interface br-int</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">               


                type: internal</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                Port "int-br-p3p1"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">           


                Interface "int-br-p3p1"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                Port "qvo39242f22-ec"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">           


                tag: 1</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">           


                Interface "qvo39242f22-ec"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">   


                Bridge "br-p3p1"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                Port "phy-br-p3p1"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">           


                Interface "phy-br-p3p1"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                Port "p3p1"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">           


                Interface "p3p1"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">       


                Port "br-p3p1"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">           


                Interface "br-p3p1"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">               


                type: internal</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">   


                ovs_version: "1.9.0"</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# tcpdump -i  tap39242f22-ec    port 67              </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">tcpdump:


                WARNING: tap39242f22-ec: no IPv4 address assigned</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">tcpdump:


                verbose output suppressed, use -v or -vv for full
                protocol decode</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">listening


                on tap39242f22-ec, link-type EN10MB (Ethernet), capture
                size 65535 bytes</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">16:12:21.455212


                IP 0.0.0.0.bootpc > 255.255.255.255.bootps:
                BOOTP/DHCP, Request from fa:16:3e:15:82:82 (oui
                Unknown), length 300</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">16:12:21.455289


                IP 0.0.0.0.bootpc > 255.255.255.255.bootps:
                BOOTP/DHCP, Request from fa:16:3e:15:82:82 (oui
                Unknown), length 300</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">^C</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2
                packets captured</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2
                packets received by filter</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">0
                packets dropped by kernel</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# tcpdump -i  qbr39242f22-ec     port 67             
              </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">tcpdump:


                WARNING: qbr39242f22-ec: no IPv4 address assigned</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">tcpdump:


                verbose output suppressed, use -v or -vv for full
                protocol decode</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">listening


                on qbr39242f22-ec, link-type EN10MB (Ethernet), capture
                size 65535 bytes</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">16:12:34.456228


                IP 0.0.0.0.bootpc > 255.255.255.255.bootps:
                BOOTP/DHCP, Request from fa:16:3e:15:82:82 (oui
                Unknown), length 300</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">^C</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">1
                packets captured</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">1
                packets received by filter</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">0
                packets dropped by kernel</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# tcpdump -i   qvb39242f22-ec     port 67             
              </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">tcpdump:


                WARNING: qvb39242f22-ec: no IPv4 address assigned</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">tcpdump:


                verbose output suppressed, use -v or -vv for full
                protocol decode</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">listening


                on qvb39242f22-ec, link-type EN10MB (Ethernet), capture
                size 65535 bytes</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">16:12:43.460251


                IP 0.0.0.0.bootpc > 255.255.255.255.bootps:
                BOOTP/DHCP, Request from fa:16:3e:15:82:82 (oui
                Unknown), length 300</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">^C</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">1
                packets captured</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">1
                packets received by filter</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">0
                packets dropped by kernel</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# tcpdump -i   qvo39242f22-ec   port 67               
              </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">tcpdump:


                WARNING: qvo39242f22-ec: no IPv4 address assigned</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">tcpdump:


                verbose output suppressed, use -v or -vv for full
                protocol decode</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">listening


                on qvo39242f22-ec, link-type EN10MB (Ethernet), capture
                size 65535 bytes</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">16:13:03.712272


                IP 0.0.0.0.bootpc > 255.255.255.255.bootps:
                BOOTP/DHCP, Request from fa:16:3e:15:82:82 (oui
                Unknown), length 300</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">16:13:08.455932


                IP 0.0.0.0.bootpc > 255.255.255.255.bootps:
                BOOTP/DHCP, Request from fa:16:3e:15:82:82 (oui
                Unknown), length 300</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">^C</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2
                packets captured</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2
                packets received by filter</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">0
                packets dropped by kernel</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# tcpdump -i int-br-p3p1   port 67                 </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">tcpdump:


                WARNING: int-br-p3p1: no IPv4 address assigned</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">tcpdump:


                verbose output suppressed, use -v or -vv for full
                protocol decode</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">listening


                on int-br-p3p1, link-type EN10MB (Ethernet), capture
                size 65535 bytes</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">^C</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">0
                packets captured</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">0
                packets received by filter</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">0
                packets dropped by kernel</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">---output


                of ovs-ofctl---</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# ovs-ofctl show br-int</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">OFPT_FEATURES_REPLY


                (xid=0x1): dpid:000086401820f142</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">n_tables:255,


                n_buffers:256</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">capabilities:


                FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS
                ARP_MATCH_IP</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">actions:


                OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC
                SET_DL_DST SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC
                SET_TP_DST ENQUEUE</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">1(int-br-p3p1):


                addr:de:42:e4:9d:b7:1d</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                config:     0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                state:      0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                current:    10GB-FD COPPER</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                speed: 10000 Mbps now, 100 Mbps max</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">4(qvo39242f22-ec):


                addr:ea:5d:b8:7e:4a:78</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                config:     0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                state:      0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                current:    10GB-FD COPPER</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                speed: 10000 Mbps now, 100 Mbps max</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">LOCAL(br-int):


                addr:86:40:18:20:f1:42</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                config:     PORT_DOWN</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                state:      LINK_DOWN</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                speed: 100 Mbps now, 100 Mbps max</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">OFPT_GET_CONFIG_REPLY


                (xid=0x3): frags=normal miss_send_len=0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# ovs-ofctl show br-p3p1</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">OFPT_FEATURES_REPLY


                (xid=0x1): dpid:0000a0369f15d424</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">n_tables:255,


                n_buffers:256</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">capabilities:


                FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS
                ARP_MATCH_IP</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">actions:


                OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC
                SET_DL_DST SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC
                SET_TP_DST ENQUEUE</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">1(p3p1):


                addr:a0:36:9f:15:d4:24</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                config:     0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                state:      0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                current:    10GB-FD</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                advertised: 10GB-FD FIBER</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                supported:  10GB-FD FIBER</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                speed: 10000 Mbps now, 10000 Mbps max</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2(phy-br-p3p1):


                addr:be:3c:f9:8d:d9:d0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                config:     0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                state:      0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">  


                  current:    10GB-FD COPPER</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                speed: 10000 Mbps now, 100 Mbps max</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">LOCAL(br-p3p1):


                addr:a0:36:9f:15:d4:24</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                config:     PORT_DOWN</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                state:      LINK_DOWN</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">    


                speed: 100 Mbps now, 100 Mbps max</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">OFPT_GET_CONFIG_REPLY


                (xid=0x3): frags=normal miss_send_len=0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# ovs-ofctl dump-flows br-int </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">NXST_FLOW


                reply (xid=0x4):</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">cookie=0x0,


                duration=4125.444s, table=0, n_packets=1707,
                n_bytes=90606, idle_age=12, priority=1 actions=NORMAL</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">cookie=0x0,


                duration=4123.006s, table=0, n_packets=143,
                n_bytes=8688, idle_age=20, priority=2,in_port=1
                actions=drop</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">cookie=0x0,


                duration=3349.566s, table=0, n_packets=0, n_bytes=0,
                idle_age=3349, priority=3,in_port=1,dl_vlan=1001
                actions=mod_vlan_vid:1,NORMAL</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[root@computer-2


                ~]# ovs-ofctl dump-flows br-p3p1</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">NXST_FLOW


                reply (xid=0x4):</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">cookie=0x0,


                duration=4129.629s, table=0, n_packets=2175,
                n_bytes=138652, idle_age=0, priority=1 actions=NORMAL</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">cookie=0x0,


                duration=4127.415s, table=0, n_packets=16, n_bytes=1224,
                idle_age=1045, priority=2,in_port=2 actions=drop</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">cookie=0x0,


                duration=3354.578s, table=0, n_packets=1697,
                n_bytes=96638, idle_age=17,
                priority=4,in_port=2,dl_vlan=1
                actions=mod_vlan_vid:1001,NORMAL</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Regards,</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Kimi


                  Zhang</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">MP:


                  +86 186 0800 8182</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Call


                  me(NCS): <a moz-do-not-send="true"
                    href="sip:+86018608008182">sip:+86018608008182</a></span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <div style="border:none;border-top:solid #B5C4DF
                1.0pt;padding:3.0pt 0cm 0cm 0cm">
                <p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">
                    <a moz-do-not-send="true"
                      href="mailto:rdo-list-bounces@redhat.com">rdo-list-bounces@redhat.com</a>
                    [<a moz-do-not-send="true"
                      href="mailto:rdo-list-bounces@redhat.com">mailto:rdo-list-bounces@redhat.com</a>]
                    <b>On Behalf Of </b>ext Zhang, Kimi (NSN - CN/Cheng
                    Du)<br>
                    <b>Sent:</b> Sunday, April 28, 2013 3:40 PM<br>
                    <b>To:</b> <a moz-do-not-send="true"
                      href="mailto:gkotton@redhat.com">gkotton@redhat.com</a>;
                    <a moz-do-not-send="true"
                      href="mailto:rdo-list@redhat.com">
                      rdo-list@redhat.com</a><br>
                    <b>Subject:</b> Re: [Rdo-list] [Grizzly] Network
                    problem with Quantum + Openvswitch + Vlan</span><o:p></o:p></p>
              </div>
            </div>
            <p class="MsoNormal"> <o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Very


                nice pic, I am going to try to capture packet on each
                port.</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I
                did not configure to use quantum to manage firewall ,
                just leave it to nova-compute, will try your configs
                later.</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Regards,</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Kimi


                  Zhang</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">MP:


                  +86 186 0800 8182</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Call


                  me(NCS): <a moz-do-not-send="true"
                    href="sip:+86018608008182">sip:+86018608008182</a></span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <div style="border:none;border-top:solid #B5C4DF
                1.0pt;padding:3.0pt 0cm 0cm 0cm">
                <p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">
                    <a moz-do-not-send="true"
                      href="mailto:rdo-list-bounces@redhat.com">rdo-list-bounces@redhat.com</a>
                    [<a moz-do-not-send="true"
                      href="mailto:rdo-list-bounces@redhat.com">mailto:rdo-list-bounces@redhat.com</a>]
                    <b>On Behalf Of </b>ext Gary Kotton<br>
                    <b>Sent:</b> Sunday, April 28, 2013 3:33 PM<br>
                    <b>To:</b> <a moz-do-not-send="true"
                      href="mailto:rdo-list@redhat.com">rdo-list@redhat.com</a><br>
                    <b>Subject:</b> Re: [Rdo-list] [Grizzly] Network
                    problem with Quantum + Openvswitch + Vlan</span><o:p></o:p></p>
              </div>
            </div>
            <p class="MsoNormal"> <o:p></o:p></p>
            <p class="MsoNormal">Hi,<br>
              Can you also please check that firewall_driver =
              quantum.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver
              is configured in plugin.ini file.And security_group_api =
              quantum is set in nova.conf<br>
              Thanks<br>
              Gary<br>
              <br>
              On 04/28/2013 10:21 AM, Gary Kotton wrote: <o:p></o:p></p>
            <p class="MsoNormal">On 04/28/2013 10:16 AM, Zhang, Kimi
              (NSN - CN/Cheng Du) wrote: <o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi,


                Gary</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I
                tried to disable iptables on both network and compute
                nodes, still does not work out </span><span
                style="font-size:11.0pt;font-family:Wingdings;color:#1F497D">L</span><o:p></o:p></p>
            <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
              Can you please look at <a moz-do-not-send="true"
href="https://docs.google.com/drawings/d/1wax2Nlk-LRJeOXwF_6X9L05cAf9HKl2FI_0B51rG4XE/edit?usp=sharing">https://docs.google.com/drawings/d/1wax2Nlk-LRJeOXwF_6X9L05cAf9HKl2FI_0B51rG4XE/edit?usp=sharing</a><br>
              <br>
              When using the OVS there are a number of devices. Would it
              be possible that you try and capture on each device so
              that we can try and see where the packet is discarded.<br>
              <br>
              I will have a setup ready in about an hour.<br>
              <br>
              <br>
              <br>
              <o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">From


                quantum openvswitch agent logs, following messages keeps
                coming out repeatly every 2-3 seconds, not sure if they
                matter or not?</span><o:p></o:p></p>
            <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
              The messages below are OK - this is how the OVS agent
              works. It polls the OVS every interval to check if new
              ports are created.<br>
              <br>
              <br>
              <br>
              <o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:39    DEBUG [quantum.openstack.common.rpc.amqp]
                Making synchronous call on q-plugin ...</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:39    DEBUG [quantum.openstack.common.rpc.amqp]
                MSG_ID is 92f4e83cf92c46f1b9304c879f9b7a41</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:39    DEBUG [quantum.openstack.common.rpc.amqp]
                UNIQUE_ID is b27f9545ca9d4745961ac574abdc103b.</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:40    DEBUG [quantum.agent.linux.utils] Running
                command: ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'list-ports', 'br-int']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:40    DEBUG [quantum.agent.linux.utils] </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command:


                ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'list-ports', 'br-int']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit


                code: 0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout:


                'int-br-p3p1\n'</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr:


                ''</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:40    DEBUG [quantum.agent.linux.utils] Running
                command: ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'get', 'Interface', 'int-br-p3p1',
                'external_ids']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:41    DEBUG [quantum.agent.linux.utils] </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command:


                ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'get', 'Interface', 'int-br-p3p1',
                'external_ids']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit


                code: 0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout:


                '{}\n'</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr:


                ''</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:42    DEBUG [quantum.agent.linux.utils] Running
                command: ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'list-ports', 'br-int']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:42    DEBUG [quantum.agent.linux.utils] Running
                command: ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'list-ports', 'br-int']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:42    DEBUG [quantum.agent.linux.utils] </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command:


                ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'list-ports', 'br-int']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit


                code: 0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout:


                'int-br-p3p1\n'</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr:


                ''</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:42    DEBUG [quantum.agent.linux.utils] Running
                command: ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'get', 'Interface', 'int-br-p3p1',
                'external_ids']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:42    DEBUG [quantum.agent.linux.utils] </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command:


                ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'list-ports', 'br-int']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit


                code: 0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout:


                'int-br-p3p1\n'</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr:


                ''</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:42    DEBUG [quantum.agent.linux.utils] Running
                command: ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'get', 'Interface', 'int-br-p3p1',
                'external_ids']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:43    DEBUG [quantum.agent.linux.utils] </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command:


                ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'get', 'Interface', 'int-br-p3p1',
                'external_ids']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit


                code: 0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout:


                '{}\n'</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr:


                ''</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2013-04-28


                15:15:43    DEBUG [quantum.agent.linux.utils] </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command:


                ['sudo', 'quantum-rootwrap',
                '/etc/quantum/rootwrap.conf', 'ovs-vsctl',
                '--timeout=2', 'get', 'Interface', 'int-br-p3p1',
                'external_ids']</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit


                code: 0</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout:


                '{}\n'</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr:


                ''</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Regards,</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Kimi


                  Zhang</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">MP:


                  +86 186 0800 8182</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Call


                  me(NCS): <a moz-do-not-send="true"
                    href="sip:+86018608008182">sip:+86018608008182</a></span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <div style="border:none;border-top:solid #B5C4DF
                1.0pt;padding:3.0pt 0cm 0cm 0cm">
                <p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">
                    ext Gary Kotton [<a moz-do-not-send="true"
                      href="mailto:gkotton@redhat.com">mailto:gkotton@redhat.com</a>]
                    <br>
                    <b>Sent:</b> Sunday, April 28, 2013 3:08 PM<br>
                    <b>To:</b> Zhang, Kimi (NSN - CN/Cheng Du)<br>
                    <b>Cc:</b> <a moz-do-not-send="true"
                      href="mailto:rdo-list@redhat.com">rdo-list@redhat.com</a><br>
                    <b>Subject:</b> Re: [Rdo-list] [Grizzly] Network
                    problem with Quantum + Openvswitch + Vlan</span><o:p></o:p></p>
              </div>
            </div>
            <p class="MsoNormal"> <o:p></o:p></p>
            <p class="MsoNormal">On 04/28/2013 10:04 AM, Zhang, Kimi
              (NSN - CN/Cheng Du) wrote: <o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I
                tried that too, no lucky.</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">From


                tcpdump ,it seems br-int does not forward any packet to
                interfaces connect to br-p3p1, which connects to
                physical network…</span><o:p></o:p></p>
            <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
              There could be a number of issues here:<br>
              1. The iptables are dropping the traffic (I am in the
              process of getting a setup up and running)<br>
              2. The network connectivity<br>
              <br>
              In order to ensure that it is not the first one can you
              try and see which iptables rules are matched or disable
              the iptables?<br>
              <br>
              <br>
              <br>
              <br>
              <o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Regards,</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Kimi


                  Zhang</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">MP:


                  +86 186 0800 8182</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Call


                  me(NCS): <a moz-do-not-send="true"
                    href="sip:+86018608008182">sip:+86018608008182</a></span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <div style="border:none;border-top:solid #B5C4DF
                1.0pt;padding:3.0pt 0cm 0cm 0cm">
                <p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">
                    ext Gary Kotton [<a moz-do-not-send="true"
                      href="mailto:gkotton@redhat.com">mailto:gkotton@redhat.com</a>]
                    <br>
                    <b>Sent:</b> Sunday, April 28, 2013 3:01 PM<br>
                    <b>To:</b> Zhang, Kimi (NSN - CN/Cheng Du)<br>
                    <b>Cc:</b> <a moz-do-not-send="true"
                      href="mailto:rdo-list@redhat.com">rdo-list@redhat.com</a><br>
                    <b>Subject:</b> Re: [Rdo-list] [Grizzly] Network
                    problem with Quantum + Openvswitch + Vlan</span><o:p></o:p></p>
              </div>
            </div>
            <p class="MsoNormal"> <o:p></o:p></p>
            <p class="MsoNormal">On 04/28/2013 09:54 AM, Zhang, Kimi
              (NSN - CN/Cheng Du) wrote: <o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi,


                Gary</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Yes,


                I’m aware of that packstack does not support quantum
                yet.  The whole setup was installed manually.</span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">I
                did run quantum-server-setup and quantum-host-setup, I
                tried linuxbridge plugin too, it has no issue for VM to
                get IP address, but openvswitch has issues on this…</span><o:p></o:p></p>
            <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
              ok.<br>
              <br>
              if you configure and IP address manually on the VM are you
              able to ping the port of the DHCP agent?<br>
              <br>
              you can get the IP from quantum port-list<br>
              <br>
              <br>
              <br>
              <br>
              <br>
              <br>
              <o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Regards,</span><o:p></o:p></p>
              <p class="MsoNormal" style="text-autospace:none"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Kimi</span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
            <div>
              <div style="border:none;border-top:solid #B5C4DF
                1.0pt;padding:3.0pt 0cm 0cm 0cm">
                <p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">
                    <a moz-do-not-send="true"
                      href="mailto:rdo-list-bounces@redhat.com">rdo-list-bounces@redhat.com</a>
                    [<a moz-do-not-send="true"
                      href="mailto:rdo-list-bounces@redhat.com">mailto:rdo-list-bounces@redhat.com</a>]
                    <b>On Behalf Of </b>ext Gary Kotton<br>
                    <b>Sent:</b> Sunday, April 28, 2013 2:50 PM<br>
                    <b>To:</b> <a moz-do-not-send="true"
                      href="mailto:rdo-list@redhat.com">rdo-list@redhat.com</a><br>
                    <b>Subject:</b> Re: [Rdo-list] [Grizzly] Network
                    problem with Quantum + Openvswitch + Vlan</span><o:p></o:p></p>
              </div>
            </div>
            <p class="MsoNormal"> <o:p></o:p></p>
            <p class="MsoNormal">Hi Kimi,<br>
              Thanks for the mail. Please see the inline comments below.
              Please note that at the moment we do not have packstack
              support for Quantum so there is a little manual plumbing
              that needs to be done (not sure if you have done this
              already).<br>
              On the host where the quantum service is running you need
              to run quantum-server-setup and on the compute nodes you
              need to run quantum-host-setup (please note that the
              relevant keystone credentials need to be set too).<br>
              Thanks<br>
              Gary<br>
              <br>
              On 04/28/2013 09:38 AM, Zhang, Kimi (NSN - CN/Cheng Du)
              wrote: <o:p></o:p></p>
            <p class="MsoNormal">converted from rtf <o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">When


                  I start VM instance, the VM can’t get IP address.
                  Could someone help me on this ?</span><o:p></o:p></p>
            </div>
            <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
              I will try<br>
              <br>
              <br>
              <br>
              <br>
              <br>
              <o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">3
                  nodes Setup with RHEL 6.4 OS + rdo grizzly repository.</span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"
              style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:0cm;text-indent:-18.0pt;mso-list:l7


              level1 lfo2">
              <!--[if !supportLists]--><span
                style="font-size:10.0pt;font-family:Symbol"><span
                  style="mso-list:Ignore">·<span style="font:7.0pt
                    "Times New Roman"">         </span></span></span><!--[endif]--><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Controller


                node:</span><o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Services:


                  Keystone+Glance+Cinder+Quantum server + Nova services</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Network:


                  bond</span><span
                  style="font-size:11.0pt;font-family:宋体">0</span><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">(10.68.125.11


                  for O&M)</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"
              style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:0cm;text-indent:-18.0pt;mso-list:l8


              level1 lfo4">
              <!--[if !supportLists]--><span
                style="font-size:10.0pt;font-family:Symbol"><span
                  style="mso-list:Ignore">·<span style="font:7.0pt
                    "Times New Roman"">         </span></span></span><!--[endif]--><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Network


                node:</span><o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Services:


                  quantum-openvswitch</span><span
                  style="font-size:11.0pt;font-family:宋体">-</span><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">agent, 


                  quantum-l3-agent, quantum-dhcp-agent,
                  quantum-metadata-agent</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Network:


                  bond0(10.68.125.15 for O&M) , p3p1 for VM internal
                  network, p3p2 for external network</span><o:p></o:p></p>
            </div>
            <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
              Please note that RHEL currently does not support
              namespaces so there are a number of limitations. We are
              addressing this at the moment. If namespaces are not used
              then it is suggested that one does not run the DHCP agent
              and the L3 agent on the same host. The reason for this is
              that there is no network isolation.<br>
              <br>
              <br>
              <br>
              <br>
              <br>
              <br>
              <o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"
              style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:0cm;text-indent:-18.0pt;mso-list:l3


              level1 lfo6">
              <!--[if !supportLists]--><span
                style="font-size:10.0pt;font-family:Symbol"><span
                  style="mso-list:Ignore">·<span style="font:7.0pt
                    "Times New Roman"">         </span></span></span><!--[endif]--><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Compute


                node:</span><o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Services:


                  nove-compute and quantum-openvswitch-agent</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Network:


                  bond0(10.68.125.16 for O&M), p3p1 for VM internal
                  network</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"
              style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:0cm;text-indent:-18.0pt;mso-list:l5


              level1 lfo8">
              <!--[if !supportLists]--><span
                style="font-size:10.0pt;font-family:Symbol"><span
                  style="mso-list:Ignore">·<span style="font:7.0pt
                    "Times New Roman"">         </span></span></span><!--[endif]--><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Switch


                setup tagging for vlan 1000-2999 for p3p1 ports(VM
                network) of network and compute nodes.</span><o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"
              style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:0cm;text-indent:-18.0pt;mso-list:l0


              level1 lfo10">
              <!--[if !supportLists]--><span style="mso-list:Ignore">1.<span
                  style="font:7.0pt "Times New Roman"">      </span></span><!--[endif]--><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Quantum.conf:</span><o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[DEFAULT]</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">debug


                  = True</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">verbose


                  = True</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">lock_path


                  = $state_path/lock</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">bind_host


                  = 0.0.0.0</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">bind_port


                  = 9696</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">core_plugin


                  =
                  quantum.plugins.openvswitch.ovs_quantum_plugin.OVSQuantumPluginV2</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">api_paste_config


                  = api-paste.ini</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">rpc_backend


                  = quantum.openstack.common.rpc.impl_kombu</span><o:p></o:p></p>
            </div>
            <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
              Are you using rabbit or qpid?<br>
              <br>
              <br>
              <br>
              <br>
              <br>
              <br>
              <o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">control_exchange


                  = quantum</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">rabbit_host


                  = 10.68.125.11</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">notification_driver


                  = quantum.openstack.common.notifier.rpc_notifier</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">default_notification_level


                  = INFO</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">notification_topics


                  = notifications</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[QUOTAS]</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[DEFAULT_SERVICETYPE]</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[AGENT]</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">polling_interval


                  = 2</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">root_helper


                  = sudo quantum-rootwrap /etc/quantum/rootwrap.conf</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[keystone_authtoken]</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">auth_host


                  = 10.68.125.11</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">auth_port


                  = 35357</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">auth_protocol


                  = http</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">signing_dir


                  = /var/lib/quantum/keystone-signing</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">admin_tenant_name


                  = service</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">admin_user


                  = quantum</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">admin_password


                  = password</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"
              style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:0cm;text-indent:-18.0pt;mso-list:l1


              level1 lfo12">
              <!--[if !supportLists]--><span style="mso-list:Ignore">2.<span
                  style="font:7.0pt "Times New Roman"">      </span></span><!--[endif]--><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">ovs_quantum_plugin.ini</span><o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[DATABASE]</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">sql_connection


                  = <a moz-do-not-send="true"
                    href="mailto:mysql://quantum:quantum@10.68.125.11:3306/ovs_quantum">mysql://quantum:quantum@10.68.125.11:3306/ovs_quantum</a></span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">reconnect_interval


                  = 2</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[OVS]</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">tenant_network_type


                  = vlan</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">network_vlan_ranges


                  = physnet1:1000:2999</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">bridge_mappings


                  = physnet1:br-p3p1</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[AGENT]</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">polling_interval


                  = 2</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[SECURITYGROUP]</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"
              style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:0cm;text-indent:-18.0pt;mso-list:l2


              level1 lfo14">
              <!--[if !supportLists]--><span style="mso-list:Ignore">3.<span
                  style="font:7.0pt "Times New Roman"">      </span></span><!--[endif]--><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">nova.conf</span><o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[DEFAULT]</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">verbose=true</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">logdir


                  = /var/log/nova</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">state_path


                  = /var/lib/nova</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">lock_path


                  = /var/lib/nova/tmp</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">volumes_dir


                  = /etc/nova/volumes</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">dhcpbridge


                  = /usr/bin/nova-dhcpbridge</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">dhcpbridge_flagfile


                  = /etc/nova/nova.conf</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">force_dhcp_release


                  = True</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">injected_network_template


                  = /usr/share/nova/interfaces.template</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">libvirt_nonblocking


                  = True</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">libvirt_inject_partition


                  = -1</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">network_manager


                  = nova.network.manager.FlatDHCPManager</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">iscsi_helper


                  = tgtadm</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">compute_driver


                  = libvirt.LibvirtDriver</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">libvirt_type=kvm</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">libvirt_ovs_bridge=br-int</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">firewall_driver


                  = nova.virt.libvirt.firewall.IptablesFirewallDriver</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">manager=nova.conductor.manager.ConductorManager</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">rpc_backend


                  = nova.openstack.common.rpc.impl_kombu</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">rabbit_host


                  = 10.68.125.11</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">rootwrap_config


                  = /etc/nova/rootwrap.conf</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">use_deprecated_auth=false</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">auth_strategy=keystone</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">glance_api_servers=10.68.125.11:9292</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">image_service=nova.image.glance.GlanceImageService</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">novnc_enabled=true</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">novncproxy_base_url=<a
                    moz-do-not-send="true"
                    href="http://10.68.125.11:6080/vnc_auto.html">http://10.68.125.11:6080/vnc_auto.html</a></span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">novncproxy_port=6080</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">vncserver_proxyclient_address=10.68.125.16</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">vncserver_listen=0.0.0.0</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtHybridOVSBridgeDriver</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">libvirt_use_virtio_for_bridges=True</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">network_api_class=nova.network.quantumv2.api.API</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">quantum_url=<a
                    moz-do-not-send="true"
                    href="http://10.68.125.11:9696">http://10.68.125.11:9696</a></span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">quantum_auth_strategy=keystone</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">quantum_admin_tenant_name=service</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">quantum_admin_username=quantum</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">quantum_admin_password=password</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">quantum_admin_auth_url=<a
                    moz-do-not-send="true"
                    href="http://10.68.125.11:35357/v2.0">http://10.68.125.11:35357/v2.0</a></span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">linuxnet_interface_driver=nova.network.linux_net.LinuxOVSInterfaceDriver</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">libvirt_vif_type=ethernet</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">service_quantum_metadata_proxy


                  = True</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">quantum_metadata_proxy_shared_secret


                  = helloOpenStack</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">metadata_host


                  = 10.68.125.11</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">metadata_listen


                  = 0.0.0.0</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">metadata_listen_port


                  = 8775</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">[keystone_authtoken]</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">admin_tenant_name


                  = service</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">admin_user


                  = nova</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">admin_password


                  = password</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">auth_host


                  = 10.68.125.11</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">auth_port


                  = 35357</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">auth_protocol


                  = http</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">signing_dir


                  = /tmp/keystone-signing-nova</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"
              style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:0cm;text-indent:-18.0pt;mso-list:l6


              level1 lfo16">
              <!--[if !supportLists]--><span style="mso-list:Ignore">4.<span
                  style="font:7.0pt "Times New Roman"">      </span></span><!--[endif]--><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">ovs-vsctl


                show on network node:</span><o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">aeeb6cf7-271b-405a-aa17-1b95bcd9e301</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">   


                  Bridge "br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "phy-br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "phy-br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">               


                  type: internal</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">   


                  Bridge br-ex</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port br-ex</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface br-ex</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">               


                  type: internal</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "qg-a83c0abd-f4"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "qg-a83c0abd-f4"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">               


                  type: internal</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "p3p2"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "p3p2"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">   


                  Bridge br-int</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port br-int</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface br-int</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">               


                  type: internal</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "int-br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "int-br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "tap1f386a2a-12"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  tag: 1</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "tap1f386a2a-12"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">               


                  type: internal</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal" style="text-indent:9.0pt"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">ovs_version:


                  "1.9.0"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal" style="text-indent:9.0pt"><span
                  style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <p class="MsoNormal"
              style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:0cm;text-indent:-18.0pt;mso-list:l4


              level1 lfo18">
              <!--[if !supportLists]--><span style="mso-list:Ignore">5.<span
                  style="font:7.0pt "Times New Roman"">      </span></span><!--[endif]--><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">ovs-vsctl


                show on compute node:</span><o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">8d6c2637-ff69-4a2d-a7db-e4f181273bc0</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">   


                  Bridge "br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">               


                  type: internal</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "phy-br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "phy-br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">   


                  Bridge br-int</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "qvo56a4572c-dc"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  tag: 2</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "qvo56a4572c-dc"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port "int-br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface "int-br-p3p1"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">       


                  Port br-int</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">           


                  Interface br-int</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">               


                  type: internal</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal" style="text-indent:9.0pt"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">ovs_version:


                  "1.9.0"</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">On


                  compute node, I can see dhcp request packet from
                  tcpdump on qvo56a4572c-dc, but it seems the packet is
                  not forwarded out since I can’t see packet from
                  int-br-p3p1 on br-int or any port from br-p3p1. </span><o:p></o:p></p>
            </div>
            <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
              Any chance to get the DHCP and the L3 agent configuration
              files? Please check that use_namespaces = False in both of
              these files.<br>
              <br>
              Are there any log errors?<br>
              <br>
              <br>
              <br>
              <br>
              <br>
              <br>
              <o:p></o:p></p>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Thank


                  you!</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Regards,</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Kimi</span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <div>
              <p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
            </div>
            <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
              <br>
              <br>
              <br>
              <br>
              <br>
              <br>
              <o:p></o:p></p>
            <pre>_______________________________________________<o:p></o:p></pre>
            <pre>Rdo-list mailing list<o:p></o:p></pre>
            <pre><a moz-do-not-send="true" href="mailto:Rdo-list@redhat.com">Rdo-list@redhat.com</a><o:p></o:p></pre>
            <pre><a moz-do-not-send="true" href="https://www.redhat.com/mailman/listinfo/rdo-list">https://www.redhat.com/mailman/listinfo/rdo-list</a><o:p></o:p></pre>
            <p class="MsoNormal"> <o:p></o:p></p>
            <p class="MsoNormal"> <o:p></o:p></p>
            <p class="MsoNormal"> <o:p></o:p></p>
            <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
              <br>
              <br>
              <br>
              <br>
              <o:p></o:p></p>
            <pre>_______________________________________________<o:p></o:p></pre>
            <pre>Rdo-list mailing list<o:p></o:p></pre>
            <pre><a moz-do-not-send="true" href="mailto:Rdo-list@redhat.com">Rdo-list@redhat.com</a><o:p></o:p></pre>
            <pre><a moz-do-not-send="true" href="https://www.redhat.com/mailman/listinfo/rdo-list">https://www.redhat.com/mailman/listinfo/rdo-list</a><o:p></o:p></pre>
            <p class="MsoNormal"> <o:p></o:p></p>
            <p class="MsoNormal"><span style="font-family:宋体"> </span><o:p></o:p></p>
            <p class="MsoNormal"><span style="font-family:宋体"><o:p> </o:p></span></p>
          </div>
        </blockquote>
        <br>
        <br>
        <fieldset class="mimeAttachmentHeader"></fieldset>
        <br>
        <pre wrap="">_______________________________________________
Rdo-list mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:Rdo-list@redhat.com">Rdo-list@redhat.com</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="https://www.redhat.com/mailman/listinfo/rdo-list">https://www.redhat.com/mailman/listinfo/rdo-list</a>
</pre>
      </blockquote>
      <br>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Rdo-list mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Rdo-list@redhat.com">Rdo-list@redhat.com</a>
<a class="moz-txt-link-freetext" href="https://www.redhat.com/mailman/listinfo/rdo-list">https://www.redhat.com/mailman/listinfo/rdo-list</a>
</pre>
    </blockquote>
    <br>
  </body>
</html>