<html> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> </head> <body dir="auto"> <div>zilstat showed all zeros. </div> <div id="AppleMailSignature"><br> </div> <div id="AppleMailSignature">In fact I emailed Richard Elling about it to be sure that I was using it properly.</div> <div id="AppleMailSignature"><br> </div> <div id="AppleMailSignature">iostat, prstat, & arcstat stayed very busy the whole time though.</div> <div id="AppleMailSignature"><br> </div> <div id="AppleMailSignature">Ill pay more attention nexttime.<br> <br> <span style="font-size: 13pt;">John Barfield</span></div> <div><br> On Mar 29, 2017, at 1:22 AM, Knut Erik Sørvik <<a href="mailto:kes@teknograd.no">kes@teknograd.no</a>> wrote:<br> <br> </div> <blockquote type="cite"> <div> <div>Hi</div> <div><br> </div> <div>I've had similar things happen, and in our case I think this might be related:</div> <div><br> </div> <div><a href="https://github.com/openzfs/openzfs/pull/214">https://github.com/openzfs/openzfs/pull/214</a></div> <div><br> </div> <div>A simple zpool iostat on the pool, with a frequent update, showed that the write column were all zeroes for an extended time, causing the clients to believe the storage was gone.</div> <div><br> </div> <div> <div>kes <div><br> </div> </div> </div> <div><br> Den 28. mar. 2017 kl. 23.54 skrev John Barfield <<a href="mailto:john.barfield@bissinc.com">john.barfield@bissinc.com</a>>:<br> <br> </div> <blockquote type="cite"> <div> <meta name="Title" content=""> <meta name="Keywords" content=""> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style></style> <div class="WordSection1"> <p class="MsoNormal" style="text-indent:.5in"><span style="font-size:11.0pt">Greetings!<o:p></o:p></span></p> <p class="MsoNormal" style="text-indent:.5in"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal" style="text-indent:.5in"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal" style="text-indent:.5in"><span style="font-size:11.0pt">I have an issue with ZFS/NFS on OmniOS where copying or deleting large files causes the SAN to lockup and requires that we reboot it sometimes to recover. One customer was trying to copy a 400GB file and another tried to delete a 4TB vmdk from a vmware NFS vstore. In both situations the issue is reproducible and in both situations I cannot seem to find anything crazy happening on either of the boxes. This doesn’t mean anything though because I’m limited in my kstat/dtrace knowledge for troubleshooting this type of behavior on illumos. <o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt">If there is an illumOS bug I’m missing or something that jumps out at ya please let me know…of if you need more detailed information I can detail both customer locations hardware, software, and operating conditions upon request. <o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt">The VMware customer is running on r151016 and the other customer is running on the latest release. <o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><u><span style="font-size:11.0pt">NFSv3 Only Clients<o:p></o:p></span></u></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt">OS:<o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt">ESXi 5.5<o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><u><span style="font-size:11.0pt">All 64bit Linux Clients<o:p></o:p></span></u></p> <p class="MsoNormal"><span style="font-size:11.0pt">CentOS 5,6,&7<o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt">Some Older Debian 7 Boxes<o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt">I should also note that the VMware customer experiences this same issue on two different SAN’s that are very different in hardware configurations. <o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt">The one common thread is that they are all Sun Servers. X4170 M2, X4270 M2, x4540<o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt">This thread is being posted to both the illumos email list and the omnios email list as well. <o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt">I’m looking, I guess, for a methodology to follow to trace this down and determine if it’s a bug or a misconfiguration either on the client or in ZFS or in the NFS server. <o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt">I can get someone access if so desired. <o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt">Have a great day!<o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Times New Roman"">John Barfield<o:p></o:p></span></b></p> <p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Times New Roman"">Engineering and Stuff <o:p></o:p></span></b></p> <p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Times New Roman""><o:p> </o:p></span></b></p> <p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Times New Roman";color:#767171">M: +1 (214) 425-0783 O: +1 (214) 506-8354 <o:p></o:p></span></p> <p class="MsoNormal"><span style="font-family:"Times New Roman""><a href="mailto:john.barfield@bissinc.com"><span style="color:#0563C1">john.barfield@bissinc.com</span></a><o:p></o:p></span></p> <p class="MsoNormal"><b><span style="font-family:"Times New Roman""><o:p> </o:p></span></b></p> <p class="MsoNormal"><b><span style="font-family:"Times New Roman""><image001.png></span></b><b><span style="font-family:"Times New Roman""><o:p></o:p></span></b></p> <p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Times New Roman";color:#767171">4925 Greenville Ave, Ste 900<o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Times New Roman";color:#767171">Dallas, TX 75206<o:p></o:p></span></p> <p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Times New Roman""><o:p> </o:p></span></b></p> <p class="MsoNormal"><u><span style="font-size:11.0pt;font-family:"Times New Roman";color:#767171">For Support Requests:<o:p></o:p></span></u></p> <p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Times New Roman""><a href="https://url12.mailanyone.net/v1/?m=1csz4e-00085p-3G&i=57e1b682&c=9IlDjjPpk-5UCrCMFk6HSjMe2nUi5cI3kwNmKHpQpR9kuxm7fU-b_hC5P0WeTyBGrDz0zay6r2YYrImrvUikzW2dywbVvROrkwpR2S9sd89tBkKu_N60XPp9f1g8jpM5mcVhpU0WQHse1GpHuHUsFy4410p5FJ4QxX2I9bHqDdLuWhguJDTCpBYBI-w8hs5XEnvzQWtR19ud-QDucXKPmw_v5b47JftMIzAYoDY2JXA"><span style="color:#0563C1">http://support.bissinc.com</span></a> or <a href="mailto:support@bissinc.com"><span style="color:#0563C1">support@bissinc.com</span></a><o:p></o:p></span></p> <p class="MsoNormal"><span style="font-family:"Times New Roman""><o:p> </o:p></span></p> <p class="MsoNormal"><span style="font-family:"Times New Roman"">Follow us on Twitter for Network Status & Updates! <o:p></o:p></span></p> <p class="MsoNormal"><span style="font-family:"Times New Roman""><o:p> </o:p></span></p> <p class="MsoNormal"><a href="https://url12.mailanyone.net/v1/?m=1csz4e-00085p-3G&i=57e1b682&c=Oost5JgpPBN1Zl_l5wMwGG464L9v13c1IIli6CSlLHKKgRmK3NNtCgg7AiwNB6_-CxXM4D7vwvp9JwZRk5wldseR6wBniGTVUxLaJDPRdW-FADOVCD-Cxk8sY-PcmC5r_usv0LRVfVLQ3jfedqEGaCVEID6UGIr7sRdoxG_EXVGjRqq4b4iK0SarW3fHfayNz5x06aW9LbenkcGoORjej4Vp4F97E0Rxs7UyU21NN8I"><span style="font-family:"Times New Roman";color:windowtext;text-decoration:none"><image002.gif></span></a><span style="font-family:"Times New Roman""> </span><span style="font-size:11.0pt"><o:p></o:p></span></p> <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p> </div> </div> </blockquote> <blockquote type="cite"> <div><span>_______________________________________________</span><br> <span>OmniOS-discuss mailing list</span><br> <span><a href="mailto:OmniOS-discuss@lists.omniti.com">OmniOS-discuss@lists.omniti.com</a></span><br> <span><a href="http://lists.omniti.com/mailman/listinfo/omnios-discuss">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a></span><br> </div> </blockquote> </div> </blockquote> </body> </html>