<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body smarttemplateinserted="true" bgcolor="#FFFFFF" text="#000000">
<div id="smartTemplate4-template">any particular reason not using
neutron api with port-create?<br>
any how can you add the output of lspci -tvn ?<br>
</div>
<br>
<div id="smartTemplate4-quoteHeader"><br>
<br>
<hr><br>
<b>From:</b> Chinmaya Dwibedy<br>
<b>Sent:</b> Tuesday, June 21, 2016 10:32AM<br>
<b>To:</b> Dotan, Alon<br>
<b>Cc:</b> Rdo-list<br>
<b>Subject:</b> Re: [rdo-list] Issue with assigning multiple VFs
to VM instance<br>
<br>
</div>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<div dir="ltr"><br>
<div>Hi Alon,</div>
<div><br>
</div>
<div>Thank you for your response.</div>
<div><br>
</div>
<div>I am using Nova flavor definition. <span
style="color:rgb(82,83,89);font-size:12pt;line-height:18.4px;background-color:rgb(247,246,243)"> But
when I launch an instance using this new flavor, it goes
into an error state</span></div>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px;color:rgb(82,83,89);background:rgb(247,246,243)"> </span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px;color:rgb(82,83,89);background:rgb(247,246,243)">nova
boot --flavor 4 --key_name oskey1 --image
bc859dc5-103b-428b-814f-d36e59009454 --nic
net-id=e2ca118d-1f25-47de-8524-bb2a2635c4be TEST</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px;color:rgb(82,83,89);background:rgb(247,246,243)"><br>
</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px;color:rgb(82,83,89);background:rgb(247,246,243)">Here
goes the output of nova-scheduler.log</span><span
style="font-size:12pt;line-height:18.4px"></span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px;color:rgb(82,83,89);background:rgb(247,246,243)"><br>
</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px">2016-06-16
07:55:34.636 171018 WARNING nova.scheduler.host_manager
[req-6189d3c8-5587-4350-8cd3-704fd35cf2ad
266f5859848e4f39b9725203dda5c3f2
4bc608763cee41d9a8df26d3ef919825 - - -] Host localhost has
more disk space than database expected (-141 GB > -271 GB)</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px">2016-06-16
07:55:34.637 171018 INFO nova.filters
[req-6189d3c8-5587-4350-8cd3-704fd35cf2ad
266f5859848e4f39b9725203dda5c3f2
4bc608763cee41d9a8df26d3ef919825 - - -] Filter
PciPassthroughFilter returned 0 hosts</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px">2016-06-16
07:55:34.638 171018 INFO nova.filters
[req-6189d3c8-5587-4350-8cd3-704fd35cf2ad
266f5859848e4f39b9725203dda5c3f2
4bc608763cee41d9a8df26d3ef919825 - - -] Filtering removed all
hosts for the request with instance ID
'4f68c680-5a17-4a38-a6df-5cdb6d76d75b'. Filter results:
['RamFilter: (start: 1, end: 1)', 'ComputeFilter: (start: 1,
end: 1)', 'AvailabilityZoneFilter: (start: 1, end: 1)',
'ComputeCapabilitiesFilter: (start: 1, end: 1)',
'ImagePropertiesFilter: (start: 1, end: 1)',
'PciPassthroughFilter: (start: 1, end: 0)']</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px">2016-06-16
07:56:14.743 171018 INFO nova.scheduler.host_manager
[req-64a8dc31-f2ab-4d93-8579-6b9f8210ece7 - - - - -]
Successfully synced instances from host 'localhost'.</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px">2016-06-16
07:58:17.748 171018 INFO nova.scheduler.host_manager
[req-152ac777-1f77-433d-8493-6cd86ab3e0fc - - - - -]
Successfully synced instances from host 'localhost'.</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px"> </span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px;color:rgb(82,83,89);background:rgb(247,246,243)"></span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px">Note that, If I set
the flavor as (#</span><span
style="font-size:16px;line-height:18.4px">nova flavor-key 4
set "pci_passthrough:alias"="QuickAssist:1"</span><span
style="font-size:12pt;line-height:18.4px">) , it assigns a
single VF to VM instance. Getting issue when I try to assign
multiple VFs per VM. </span><span
style="font-size:12pt;line-height:18.4px">Can you please
suggest , where I am wrong and the way to solve this ?</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px"><br>
</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px">Regards,</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px">Chinmaya</span></p>
<p class="MsoNormal" style="font-size:12.8px"><span
style="font-size:12pt;line-height:18.4px;color:rgb(82,83,89);background:rgb(247,246,243)"> </span></p>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Jun 21, 2016 at 9:21 AM, Dotan,
Alon <span dir="ltr"><<a moz-do-not-send="true"
href="mailto:alon.dotan@hpe.com" target="_blank">alon.dotan@hpe.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div link="blue" vlink="purple" lang="EN-US">
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Which
method you are using?</span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Neutron
sriov plugin? Nova (via flavor definition)? Neutron
without sriov plugin (which I think is the best)</span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Thanks,</span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span></p>
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">
<a moz-do-not-send="true"
href="mailto:rdo-list-bounces@redhat.com"
target="_blank">rdo-list-bounces@redhat.com</a>
[mailto:<a moz-do-not-send="true"
href="mailto:rdo-list-bounces@redhat.com"
target="_blank">rdo-list-bounces@redhat.com</a>]
<b>On Behalf Of </b>Chinmaya Dwibedy<br>
<b>Sent:</b> Monday, June 20, 2016 14:53<br>
<b>To:</b> <a moz-do-not-send="true"
href="mailto:rdo-list@redhat.com" target="_blank">rdo-list@redhat.com</a><br>
<b>Subject:</b> Re: [rdo-list] Issue with assigning
multiple VFs to VM instance</span></p>
<div>
<div class="h5">
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal">Hi ,</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Can anyone please suggest how
to assign multiple VF devices to
VM instance using open-stack openstack-mitaka release?
Thank you in advance for your time and support.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Regards,</p>
</div>
<div>
<p class="MsoNormal">Chinmaya</p>
</div>
</div>
<div>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal">On Thu, Jun 16, 2016 at 5:42
PM, Chinmaya Dwibedy <<a
moz-do-not-send="true"
href="mailto:ckdwibedy@gmail.com"
target="_blank"><a class="moz-txt-link-abbreviated" href="mailto:ckdwibedy@gmail.com">ckdwibedy@gmail.com</a></a>>
wrote:</p>
<blockquote style="border:none;border-left:solid
#cccccc 1.0pt;padding:0in 0in 0in
6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">Hi All,</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">I have installed
open-stack openstack-mitaka release on
CentO7 system . It has two Intel QAT
devices. There are 32 VF devices available
per QAT Device/DH895xCC device. </p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">[root@localhost
nova(keystone_admin)]# lspci -nn | grep 0435</p>
<p class="MsoNormal">83:00.0 Co-processor
[0b40]: Intel Corporation DH895XCC Series
QAT [8086:0435]</p>
<p class="MsoNormal">88:00.0 Co-processor
[0b40]: Intel Corporation DH895XCC Series
QAT [8086:0435]</p>
<p class="MsoNormal">[root@localhost
nova(keystone_admin)]# cat
/sys/bus/pci/devices/0000\:88\:00.0/sriov_numvfs</p>
<p class="MsoNormal">32</p>
<p class="MsoNormal">[root@localhost
nova(keystone_admin)]# cat
/sys/bus/pci/devices/0000\:83\:00.0/sriov_numvfs</p>
<p class="MsoNormal">32</p>
<p class="MsoNormal">[root@localhost
nova(keystone_admin)]#</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Changed the nova
configuration (as stated below) for exposing
VF ( via PCI-passthrough) to the instances.
</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">pci_alias = {"name":
"QuickAssist", "product_id": "0443",
"vendor_id": "8086", "device_type":
"type-VF"}</p>
<p class="MsoNormal">pci_passthrough_whitelist
=
[{"vendor_id":"8086","product_id":"0443"}}]</p>
<p class="MsoNormal">Restarted the nova
compute, nova API and nova scheduler service
</p>
<p class="MsoNormal">service
openstack-nova-compute restart;service
openstack-nova-api restart;systemctl restart
openstack-nova-scheduler;</p>
<p class="MsoNormal">scheduler_available_filters=nova.scheduler.filters.all_filters</p>
<p class="MsoNormal">scheduler_default_filters=RamFilter,ComputeFilter,AvailabilityZoneFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,PciPassthroughFilter</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Thereafter it shows all
the available VFs (64) in nova database upon
select * from pci_devices. Set the flavor
4 to allow passing two VFs to instances.</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">[root@localhost
nova(keystone_admin)]# nova flavor-show 4</p>
<p class="MsoNormal">+----------------------------+------------------------------------------------------------+</p>
<p class="MsoNormal">|
Property |
Value
|</p>
<p class="MsoNormal">+----------------------------+------------------------------------------------------------+</p>
<p class="MsoNormal">|
OS-FLV-DISABLED:disabled |
False
|</p>
<p class="MsoNormal">|
OS-FLV-EXT-DATA:ephemeral |
0
|</p>
<p class="MsoNormal">|
disk |
80
|</p>
<p class="MsoNormal">|
extra_specs |
{"pci_passthrough:alias": "QuickAssist:2"} |</p>
<p class="MsoNormal">|
id |
4
|</p>
<p class="MsoNormal">|
name |
m1.large
|</p>
<p class="MsoNormal">|
os-flavor-access:is_public |
True
|</p>
<p class="MsoNormal">|
ram |
8192
|</p>
<p class="MsoNormal">|
rxtx_factor |
1.0
|</p>
<p class="MsoNormal">|
swap
|
|</p>
<p class="MsoNormal">|
vcpus |
4
|</p>
<p class="MsoNormal">+----------------------------+------------------------------------------------------------+</p>
<p class="MsoNormal">[root@localhost
nova(keystone_admin)]#</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3"> Also
when I launch an instance using this new
flavor, it goes into an error state</span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3"> </span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">nova
boot --flavor 4 --key_name oskey1 --image
bc859dc5-103b-428b-814f-d36e59009454 --nic
net-id=e2ca118d-1f25-47de-8524-bb2a2635c4be TEST</span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3"> </span></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">Here
goes the output of nova-conductor.log</span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3"> </span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">2016-06-16
07:55:34.640 5094 WARNING
nova.scheduler.utils
[req-6189d3c8-5587-4350-8cd3-704fd35cf2ad
266f5859848e4f39b9725203dda5c3f2
4bc608763cee41d9a8df26d3ef919825 - - -]
Failed to compute_task_build_instances: No
valid host was found. There are not enough
hosts available.</span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">Traceback
(most recent call last):</span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3"> </span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">
File
"/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py",
line 150, in inner</span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">
return func(*args, **kwargs)</span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3"> </span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">
File
"/usr/lib/python2.7/site-packages/nova/scheduler/manager.py",
line 104, in select_destinations</span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">
dests =
self.driver.select_destinations(ctxt,
spec_obj)</span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3"> </span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">
File
"/usr/lib/python2.7/site-packages/nova/scheduler/filter_scheduler.py",
line 74, in select_destinations</span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">
raise exception.NoValidHost(reason=reason)</span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3"> </span></p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">NoValidHost:
No valid host was found. There are not
enough hosts available.</span></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">Here
goes the output of nova-compute.log</span></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">2016-06-16 07:57:32.502
170789 INFO nova.compute.resource_tracker
[req-4529a2a8-390f-4620-98b3-d3eb77e077a3 -
- - - -] Total usable vcpus: 36, total
allocated vcpus: 16</p>
<p class="MsoNormal">2016-06-16 07:57:32.502
170789 INFO nova.compute.resource_tracker
[req-4529a2a8-390f-4620-98b3-d3eb77e077a3 -
- - - -] Final resource view: name=localhost
phys_ram=128721MB used_ram=33280MB
phys_disk=49GB used_disk=320GB
total_vcpus=36 used_vcpus=16
pci_stats=[PciDevicePool(count=0,numa_node=0,product_id='10fb',tags={dev_type='type-PF'},vendor_id='8086'),
PciDevicePool(count=63,numa_node=1,product_id='0443',tags={dev_type='type-VF'},vendor_id='8086')]</p>
<p class="MsoNormal">2016-06-16 07:57:33.803
170789 INFO nova.compute.resource_tracker
[req-4529a2a8-390f-4620-98b3-d3eb77e077a3 -
- - - -] Compute_service record updated for
localhost:localhost</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"><span
style="color:#525359;background:#f7f6f3">Here
goes the output of nova-scheduler.log</span></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">2016-06-16 07:55:34.636
171018 WARNING nova.scheduler.host_manager
[req-6189d3c8-5587-4350-8cd3-704fd35cf2ad
266f5859848e4f39b9725203dda5c3f2
4bc608763cee41d9a8df26d3ef919825 - - -] Host
localhost has more disk space than database
expected (-141 GB > -271 GB)</p>
<p class="MsoNormal">2016-06-16 07:55:34.637
171018 INFO nova.filters
[req-6189d3c8-5587-4350-8cd3-704fd35cf2ad
266f5859848e4f39b9725203dda5c3f2
4bc608763cee41d9a8df26d3ef919825 - - -]
Filter PciPassthroughFilter returned 0 hosts</p>
<p class="MsoNormal">2016-06-16 07:55:34.638
171018 INFO nova.filters
[req-6189d3c8-5587-4350-8cd3-704fd35cf2ad
266f5859848e4f39b9725203dda5c3f2
4bc608763cee41d9a8df26d3ef919825 - - -]
Filtering removed all hosts for the request
with instance ID
'4f68c680-5a17-4a38-a6df-5cdb6d76d75b'.
Filter results: ['RamFilter: (start: 1, end:
1)', 'ComputeFilter: (start: 1, end: 1)',
'AvailabilityZoneFilter: (start: 1, end:
1)', 'ComputeCapabilitiesFilter: (start: 1,
end: 1)', 'ImagePropertiesFilter: (start: 1,
end: 1)', 'PciPassthroughFilter: (start: 1,
end: 0)']</p>
<p class="MsoNormal">2016-06-16 07:56:14.743
171018 INFO nova.scheduler.host_manager
[req-64a8dc31-f2ab-4d93-8579-6b9f8210ece7 -
- - - -] Successfully synced instances from
host 'localhost'.</p>
<p class="MsoNormal">2016-06-16 07:58:17.748
171018 INFO nova.scheduler.host_manager
[req-152ac777-1f77-433d-8493-6cd86ab3e0fc -
- - - -] Successfully synced instances from
host 'localhost'.</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Note that, If I set the
flavor as (#nova flavor-key 4 set
"pci_passthrough:alias"="QuickAssist:1") ,
it assigns a single VF to VM instance. I
think, multiple PFs can be assigned per VM.
Can anyone please suggest , where I am wrong
and the way to solve this ? Thank you in
advance for your support and help.</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Regards,</p>
<p class="MsoNormal">Chinmaya</p>
</div>
</blockquote>
</div>
<p class="MsoNormal"> </p>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
<br>
</body>
</html>