[rdo-users] [rdo-dev] Cinder NFS backend issue

[Cody]

Hi Tzach,

Thank you for getting back! I tested it again with
CinderNfsMountOptions: 'rw,sync,nosharecache' in Queens, but still to
no avail.

I also noticed that the file /etc/cinder/nfs_shares does not exist on
any controller, although in cinder.conf it has "#nfs_shares_config =
/etc/cinder/nfs_shares". I am not sure if this is normal for using NFS
with the containerized cinder service.

Thank you,
Cody


On Sun, Oct 7, 2018 at 5:03 AM Tzach Shefi <tshefi at redhat.com> wrote:
>
>
> Hey Cody,
>
> I recall hitting a related problem, when both Glance and Cinder use the same NFS server, while each service uses it's own share if both shares reside on same NFS server you may hit an selinux issue.
>
> The original bug I hit/reported, was closed EOL.
> https://bugzilla.redhat.com/show_bug.cgi?id=1491597
> Notice 4th comment, adding  nosharecache mount option helped me.
>
> I'll re-check this on queens as well maybe need to rebug it.
> Thanks
>
> Tzach
>
>
> On Sun, Oct 7, 2018 at 6:32 AM Cody <codeology.lab at gmail.com> wrote:
>>
>> Hi everyone,
>>
>> I have an issue with using TripleO (Queens) to setup an NFS backend for Cinder.
>>
>> My storage.yaml is as follows:
>>
>> parameter_defaults:
>>   CinderEnableIscsiBackend: false
>>   CinderEnableRbdBackend: false
>>   CinderEnableNfsBackend: true
>>   NovaEnableRbdBackend: false
>>   GlanceBackend: 'file'
>>
>>   CinderNfsMountOptions: 'rw,sync'
>>   CinderNfsServers: '192.168.24.1:/export/cinder'
>>
>>   GlanceNfsEnabled: true
>>   GlanceNfsShare: '192.168.24.1:/export/glance'
>>   GlanceNfsOptions: 'rw,sync,context=system_u:object_r:glance_var_lib_t:s0'
>>
>>   NovaNfsEnabled: true
>>   NovaNfsShare: '192.168.24.1:/export/nova'
>>   NovaNfsOptions: 'rw,sync,context=system_u:object_r:nfs_t:s0'
>>
>> I used the undercloud node as an NFS server for testing purposes. Iptables is set accordingly. The /etc/exportfs on the NFS server is as follows:
>>
>> /export/nova 192.168.24.0/24(rw,no_root_squash)
>> /export/glance 192.168.24.0/24(rw,no_root_squash)
>> /export/cinder 192.168.24.0/24(rw,no_root_squash)
>>
>> All three folders are set to chmod 777. Nova and Glance work as expected. Only Cinder remains problematic. I can try to upload volumes from overcloud, but nothing would show up in the cinder folder. Also Horizon gives errors like unable to retrieve volume and volume snapshots. Did I miss something here? I do plan to use Ceph later, but I wish to use NFS for now to test migration and failover. Any helps would be appreciated. Thank you!
>>
>> Best regards,
>> Cody
>>
>>
>>
>> _______________________________________________
>> dev mailing list
>> dev at lists.rdoproject.org
>> http://lists.rdoproject.org/mailman/listinfo/dev
>>
>> To unsubscribe: dev-unsubscribe at lists.rdoproject.org
>
>
>
> --
>
> Tzach Shefi
>
> Senior Quality Engineer, RHCSA
>
> Red Hat
>
> tshefi at redaht.com    M: +972-54-4701080     IM: tshefi