<html><head><style type='text/css'>p { margin: 0; }</style></head><body><div style='font-family: times new roman,new york,times,serif; font-size: 12pt; color: #000000'><div style="font-family: Helvetica; font-size: 13px;">I would like to follow up on this matter. As I have followed the leads of Max(thanks) in this issue since having the same idea of building an active/active cluster with OMNIOS but with Proxmox instead.</div><div style="font-family: Helvetica; font-size: 13px;"><br></div><div style="font-family: Helvetica; font-size: 13px;">I am not shure yet - if we are following ghosts here. But ESXi and Netapp make such a „transparent“ failover without any problems. So I guess we are missing something here with ZFS.</div><div style="font-family: Helvetica; font-size: 13px;"><br></div><div style="font-family: Helvetica; font-size: 13px;">I did some further digging and found some other things - which I think haven’t been discussed here - yet. And I would like to throw them in discussion.</div><div style="font-family: Helvetica; font-size: 13px;"><br></div><div style="font-family: Helvetica; font-size: 13px;">INODE-Number:</div><div style="font-family: Helvetica; font-size: 13px;">btw - I checked this, as it was mentioned somewhere. The inode stayed the same. </div><div style="font-family: Helvetica; font-size: 13px;"><br></div><div style="font-family: Helvetica; font-size: 13px;">FSID:</div><div style="font-family: Helvetica; font-size: 13px;">I found this article: http://ben.timby.com/?p=109</div><div style="font-family: Helvetica; font-size: 13px;"><br></div><div style="font-family: Helvetica; font-size: 13px;">"The first is that when you export a file system via NFS, a unique fsid is generated for that file system. The client machines that mount the exported file system use this id to generate handles to directories/files. This fsid is generated using the major/minor of the device being exported. This is a problem for me, as the device being exported is a DRBD volume with LVM on top of it. This means that when the LVM OCF RA fails over the LVM volgroup, the major/minor will change. In fact, the first device on my system had a minor of 4. This was true of both nodes. If a resource migrates, it receives the minor 4, as the existing volgroup already occupies 4. This means that the fsid will change for the exported file system and all client file handles are stale after failover.“</div><div style="font-family: Helvetica; font-size: 13px;"><br></div><div style="font-family: Helvetica; font-size: 13px;"><div>to make it short - I was not able to set the fsid with the sharenfs property.</div><div>"cannot be set to invalid options<font face="Menlo">“</font></div></div><div style="font-family: Helvetica; font-size: 13px;"><br></div><div style="font-family: Helvetica; font-size: 13px;">So after further digging I found those articles:</div><div style="font-family: Helvetica; font-size: 13px;">https://github.com/zfsonlinux/zfs/issues/570</div><div style="font-family: Helvetica; font-size: 13px;">and this ..</div><div style="font-family: Helvetica; font-size: 13px;">https://github.com/zfsonlinux/zfs/commit/d2e032ca9cd62fd0e80cdce30c6d1c40421bf754</div><div style="font-family: Helvetica; font-size: 13px;"><br></div><div style="font-family: Helvetica; font-size: 13px;">They ask the that property should be enabled in ZFS source code. That just sounds somehow promising.</div><div style="font-family: Helvetica; font-size: 13px;"><br></div><div style="font-family: Helvetica; font-size: 13px;">Can this be added to sharenfs ?</div><div style="font-family: Helvetica; font-size: 13px;"><br></div><div style="font-family: Helvetica; font-size: 13px;">RMTAB:</div><div style="font-family: Helvetica; font-size: 13px;"><span style="font-family: Menlo; font-size: 11px;">/etc/rmtab.</span></div><div style="font-family: Helvetica; font-size: 13px;"><span style="font-family: Menlo; font-size: 11px;"><br></span></div><div style="font-family: Helvetica; font-size: 13px;"><span style="font-family: Menlo; font-size: 11px;">from man:</span></div><div style="font-family: Helvetica; font-size: 13px;"><div dir="ltr" data-angle="0" data-font-name="g_font_7_0" data-canvas-width="40.00000190734863">rmtab contains a table of filesystems that are remotely mounted by NFS clients. This file is maintained by mountd (1M), the mount daemon. The data in this file should be obtained only from mountd (1M) using the MOUNTPROC_DUMP remote procedure call. The file contains a line of information for each remotely mounted filesystem. There are number of lines of the form:</div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994">hostname: fsname</div></div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;"><br></div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;">I checked the file on my install and the entries where there after the first switch. I did not try to inject lines here with the failover script. Need to solve FSID first.</div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;"><br></div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;"><b>Summery:</b></div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;"><b>FSID</b></div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;">to make „transparent“ failover with NFS working we need the FSID property in the sharenfs. (Well - I just assume that this will bring us forward.)</div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;"><br></div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;">Asking the omnios team: Can this be added ?</div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;"><br></div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;"><b>/etc/rmtab:</b></div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;">holds the client and mounted fs. Needs to be tested then as next issue.</div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;"><br></div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;">Thanks for reading and posting feedback on this</div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;">—> Dave</div><div dir="ltr" data-angle="0" data-font-name="g_font_8_0" data-canvas-width="53.099999999999994" style="font-family: Helvetica; font-size: 13px;"><br></div><div><span name="x"></span><br></div></div>
<br><body><html><br/><br/><div style="font-family: arial,helvetica,sans-serif;font-size: 9pt; color: #000000"><span style="fontfamily: arial,helvetica,sans-serif;">--- Disclaimer: ---</span></div><div style="font-family: arial,helvetica,sans-serif;font-size: 9pt; color: #000000"><span style="font-family: arial,helvetica,sans-serif;">This email and contents is for use only by the intended recipient. If you are not the individual or entity to whom it is addressed, you are hereby formally notified that any use, copying or distribution of this email and attachments, in whole or in part, is strictly prohibited. If you have received this email in error, please notify the sender and delete the message and attachment(s) from your system. Any views, opinions or information, expressed or contained in this email, are those of the sender and not necessarily reflect those of ESPROS Photonics AG. To help protect our environment, please avoid printing out this information unnecessarily.
</span></div></body></html>
<br></body></html>