<html><body><div style="font-family: times new roman, new york, times, serif; font-size: 10pt; color: #000000"><div>Hey all,</div><div><br></div><div>Had a repeat of this again, looks like its repeatable only when i pound the SMB Service a lot (had uploads/downloads from multiple boxes at the same time) (WIFI Mac Client downloading 5 different things [Large video files]) Had some uploading going on from two different servers and video streaming to an XBMC box. </div><div><br></div><div>I am no good at troubleshooting these things, i am hoping someone could help me out i have attached the panic again. </div><div><br></div><div>I use to do this all the time on the older versions of the software (using latest stable) and never hit this issue. I am wondering if an SMB Code change might be making this occur. </div><div><br></div><div>If needed i can get you the dump file to help with the troubleshooting as i dont know MDB all that well any help would greatly be appreciated, it does seem whatever is causing this it requires that i pound the SMB Service a lot and then it becomes easily reproducible. </div><div><br></div><div>FMDUMP Info</div><div><p class="p1">nvlist version: 0</p><p class="p1"> version = 0x0</p><p class="p1"> class = list.suspect</p><p class="p1"> uuid = 331b57b0-7aa4-e892-b710-ae1c59c6fe6a</p><p class="p1"> code = SUNOS-8000-KL</p><p class="p1"> diag-time = 1399776957 591111</p><p class="p1"> de = fmd:///module/software-diagnosis</p><p class="p1"> fault-list-sz = 0x1</p><p class="p1"> fault-list = (array of embedded nvlists)</p><p class="p1"> (start fault-list[0])</p><p class="p1"> nvlist version: 0</p><p class="p1"> version = 0x0</p><p class="p1"> class = defect.sunos.kernel.panic</p><p class="p1"> certainty = 0x64</p><p class="p1"> asru = sw:///:path=/var/crash/unknown/.331b57b0-7aa4-e892-b710-ae1c59c6fe6a</p><p class="p1"> resource = sw:///:path=/var/crash/unknown/.331b57b0-7aa4-e892-b710-ae1c59c6fe6a</p><p class="p1"> savecore-succcess = 1</p><p class="p1"> dump-dir = /var/crash/unknown</p><p class="p1"> dump-files = vmdump.0</p><p class="p1"> os-instance-uuid = 331b57b0-7aa4-e892-b710-ae1c59c6fe6a</p><p class="p1"> panicstr = BAD TRAP: type=e (#pf Page fault) rp=ffffff0011a03450 addr=ffffff03197b10c8</p><p class="p1"> panicstack = unix:real_mode_stop_cpu_stage2_end+9de3 () | unix:trap+db3 () | unix:cmntrap+e6 () | smbsrv:smb_fsop_lookup+118 () | smbsrv:smb_common_rename+d9 () | smbsrv:smb_trans2_rename+136 () | smbsrv:smb_set_rename_info+b8 () | smbsrv:smb_set_fileinfo+ed () | smbsrv:smb_set_by_fid+b0 () | smbsrv:smb_com_trans2_set_file_information+58 () | smbsrv:smb_trans2_dispatch+313 () | smbsrv:smb_com_transaction2+1a7 () | smbsrv:smb_dispatch_request+662 () | smbsrv:smb_session_worker+a0 () | genunix:taskq_d_thread+b7 () | unix:thread_start+8 () | </p><p class="p1"> crashtime = 1399776856</p><p class="p1"> panic-time = Sat May 10 20:54:16 2014 MDT</p><p class="p1"> (end fault-list[0])</p><p class="p2"><br></p><p class="p1"> fault-status = 0x1</p><p class="p1"> severity = Major</p><p class="p1"> __ttl = 0x1</p><p class="p1"> __<span style="font-size: 10pt;">tod = 0x536ee6bd 0x241b4d28</span></p></div><div><br></div><div><br></div><div>Here is the ::Stack</div><div><br></div><div><p class="p1">smb_fsop_lookup+0x118(ffffff03197b0990, ffffff02dbfca018, 0, ffffff03197b0db8, ffffff02da252970, ffffff03197b0ea8)</p><p class="p1">smb_common_rename+0xd9(ffffff03197b0990, ffffff03197b0bc8, ffffff03197b0db8)</p><p class="p1">smb_trans2_rename+0x136(ffffff03197b0990, ffffff02e60c9ca0, ffffff02dc90b628, 1)</p><p class="p1">smb_set_rename_info+0xb8(ffffff03197b0990, ffffff0011a03840)</p><p class="p1">smb_set_fileinfo+0xed(ffffff03197b0990, ffffff0011a03840)</p><p class="p1">smb_set_by_fid+0xb0(ffffff03197b0990, ffffff030f2ff400, 3f2)</p><p class="p1">smb_com_trans2_set_file_information+0x58(ffffff03197b0990, ffffff030f2ff400)</p><p class="p1">smb_trans2_dispatch+0x313(ffffff03197b0990, ffffff030f2ff400)</p><p class="p1">smb_com_transaction2+0x1a7(ffffff03197b0990)</p><p class="p1">smb_dispatch_request+0x662(ffffff03197b0990)</p><p class="p1">smb_session_worker+0xa0(ffffff03197b0990)</p><p class="p1">taskq_d_thread+0xb7(ffffff0331430760)</p><p class="p1">thread_start+8()</p></div><div><br></div><div><br></div><div><span name="x"></span><p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" data-mce-style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;"><span style="color: #1f497d;" data-mce-style="color: #1f497d;"></span></p><p style="font-family: 'Times New Roman'; font-size: medium;" data-mce-style="font-family: 'Times New Roman'; font-size: medium;"><span size="2" face="Arial, Helvetica, sans-serif" color="#717074" style="color: #717074; font-family: Arial, Helvetica, sans-serif; font-size: small;" data-mce-style="color: #717074; font-family: Arial, Helvetica, sans-serif; font-size: small;"><strong>Matt Mabis</strong><br><em><br></em></span></p><span name="x"></span><br></div><hr id="zwchr"><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><b>From: </b>"Matthew Mabis" <mmabis@vmware.com><br><b>To: </b>"Gordon Ross" <gordon.ross@nexenta.com><br><b>Cc: </b>developer@lists.illumos.org, "omnios-discuss" <omnios-discuss@lists.omniti.com><br><b>Sent: </b>Wednesday, May 7, 2014 8:01:55 AM<br><b>Subject: </b>Re: [OmniOS-discuss] [developer] Kernel Panic - Possibly SMB?<br><div><br></div><div style="font-family: times new roman, new york, times, serif; font-size: 10pt; color: #000000" data-mce-style="font-family: times new roman, new york, times, serif; font-size: 10pt; color: #000000;"><div>I haven't been able to reproduce this issue, I believe a NC Replication (From Different Pools on the Same Host) was going on while SMB was being actively used. </div><div><br></div><div>How would i look at the "<span style="font-family: Times; background-color: #fdfdfd;" data-mce-style="font-family: Times; background-color: #fdfdfd;">In particular, look at the smb_xa_t it's working on, and the param+data buffers. Are they all there?" Any help would be greatly appreciated! </span></div><div><br></div><div><span></span><p style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" data-mce-style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;"><br></p><p style="font-family: 'Times New Roman'; font-size: medium;" data-mce-style="font-family: 'Times New Roman'; font-size: medium;"><span style="color: #717074; font-family: Arial, Helvetica, sans-serif; font-size: small;" data-mce-style="color: #717074; font-family: Arial, Helvetica, sans-serif; font-size: small;"><strong>Matt Mabis</strong><br><em><br></em></span></p><span></span><br></div><hr id="zwchr"><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><b>From: </b>"Gordon Ross" <gordon.ross@nexenta.com><br><b>To: </b>"Matthew Mabis" <mmabis@vmware.com><br><b>Cc: </b>developer@lists.illumos.org, "omnios-discuss" <omnios-discuss@lists.omniti.com><br><b>Sent: </b>Tuesday, May 6, 2014 9:07:23 AM<br><b>Subject: </b>Re: [developer] Kernel Panic - Possibly SMB?<br><div><br></div><div dir="ltr">Is this reproducible? Can you show any more detail about the data structure being operated on when it panic's?<div>In particular, look at the smb_xa_t it's working on, and the param+data buffers. Are they all there?</div><div><br></div><div>This is just a guess, but I suspect you may have stumbled upon an instance of the bug fixed here:</div><div><a href="https://urldefense.proofpoint.com/v1/url?u=https://github.com/Nexenta/illumos-nexenta/commit/803bd0af2c4842f440c58a8ab2c7b52f4171145d&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=yqgQ6LhGnfWMd79QvLrmWsnr%2FlpWj5c0oy4MpT8%2Bgik%3D%0A&m=pPmQWwIFT9FD1yq%2B2VrO%2BvqlsfU%2B9kIY4Jx%2FcnFE0dg%3D%0A&s=84e6bd74e68a2a9c75f15e5bcc203609e4d8a5a2aa7b2aeaee91edfc91c39109" target="_blank" data-mce-href="https://urldefense.proofpoint.com/v1/url?u=https://github.com/Nexenta/illumos-nexenta/commit/803bd0af2c4842f440c58a8ab2c7b52f4171145d&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=yqgQ6LhGnfWMd79QvLrmWsnr%2FlpWj5c0oy4MpT8%2Bgik%3D%0A&m=pPmQWwIFT9FD1yq%2B2VrO%2BvqlsfU%2B9kIY4Jx%2FcnFE0dg%3D%0A&s=84e6bd74e68a2a9c75f15e5bcc203609e4d8a5a2aa7b2aeaee91edfc91c39109">https://github.com/Nexenta/illumos-nexenta/commit/803bd0af2c4842f440c58a8ab2c7b52f4171145d</a><br></div><div><br></div><div>Gordon</div></div><div class="gmail_extra"><br><div><br></div><div class="gmail_quote">On Sun, May 4, 2014 at 7:22 PM, Matthew Mabis <span dir="ltr"><<a href="mailto:mmabis@vmware.com" target="_blank" data-mce-href="mailto:mmabis@vmware.com">mmabis@vmware.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex" data-mce-style="margin: 0 0 0 .8ex; border-left: 1px #ccc solid; padding-left: 1ex;"><div><div style="font-family:times new roman,new york,times,serif;font-size:10pt;color:#000000" data-mce-style="font-family: times new roman,new york,times,serif; font-size: 10pt; color: #000000;"><div><p>Hey all wondering if someone could help me figure out what just happened, i had a kernel panic that i dont understand what caused it based on what i see in the stack it might have been SMB, if you need more like the dump file itself let me know! Any help would greatly be appreciated! </p><p><br></p><p><br></p><p>root@destiny:~# fmdump -Vp -u ae3350e8-17d5-4701-ecc6-b46fbaf1d04b |more</p><p>TIME UUID SUNW-MSG-ID</p><p>May 04 2014 17:16:03.161236000 ae3350e8-17d5-4701-ecc6-b46fbaf1d04b SUNOS-8000-KL</p><p><br></p><p> TIME CLASS ENA</p><p> May 04 17:16:03.1244 ireport.os.sunos.panic.dump_available 0x0000000000000000</p><p> May 04 17:15:23.3085 ireport.os.sunos.panic.dump_pending_on_device 0x0000000000000000</p><p><br></p><p>nvlist version: 0</p><p> version = 0x0</p><p> class = list.suspect</p><p> uuid = ae3350e8-17d5-4701-ecc6-b46fbaf1d04b</p><p> code = SUNOS-8000-KL</p><p> diag-time = 1399245363 130378</p><p> de = fmd:///module/software-diagnosis</p><p> fault-list-sz = 0x1</p><p> fault-list = (array of embedded nvlists)</p><p> (start fault-list[0])</p><p> nvlist version: 0</p><p> version = 0x0</p><p> class = defect.sunos.kernel.panic</p><p> certainty = 0x64</p><p> asru = sw:///:path=/var/crash/unknown/.ae3350e8-17d5-4701-ecc6-b46fbaf1d04b</p><p> resource = sw:///:path=/var/crash/unknown/.ae3350e8-17d5-4701-ecc6-b46fbaf1d04b</p><p> savecore-succcess = 1</p><p> dump-dir = /var/crash/unknown</p><p> dump-files = vmdump.0</p><p> os-instance-uuid = ae3350e8-17d5-4701-ecc6-b46fbaf1d04b</p><p> panicstr = BAD TRAP: type=e (#pf Page fault) rp=ffffff001e907450 addr=ffffff05ce4c90d8</p><p> panicstack = unix:real_mode_stop_cpu_stage2_end+9de3 () | unix:trap+db3 () | unix:cmntrap+e6 () | smbsrv:smb_fsop_lookup+118 () | smbsrv:smb_common_rename+d9 () | smbsrv:smb_tr</p><p>ans2_rename+136 () | smbsrv:smb_set_rename_info+b8 () | smbsrv:smb_set_fileinfo+ed () | smbsrv:smb_set_by_fid+b0 () | smbsrv:smb_com_trans2_set_file_information+58 () | smbsrv:smb_trans2_dispa</p><p>tch+313 () | smbsrv:smb_com_transaction2+1a7 () | smbsrv:smb_dispatch_request+662 () | smbsrv:smb_session_worker+a0 () | genunix:taskq_d_thread+b7 () | unix:thread_start+8 () | </p><p> crashtime = 1399244984</p><p> panic-time = Sun May 4 17:09:44 2014 MDT</p><p> (end fault-list[0])</p><p><span style="font-size:10pt" data-mce-style="font-size: 10pt;"> severity = Major</span></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p><p><br></p></div><div><p> __ttl = 0x1</p><p> __tod = 0x5366ca33 0x99c4420</p><p><br></p></div><div><span></span><p style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif" data-mce-style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri,sans-serif;"><br></p><p style="font-family:'Times New Roman';font-size:medium" data-mce-style="font-family: 'Times New Roman'; font-size: medium;"><span style="color:#717074;font-family:Arial,Helvetica,sans-serif;font-size:small" data-mce-style="color: #717074; font-family: Arial,Helvetica,sans-serif; font-size: small;"><strong>Matt Mabis</strong></span></p><p><br></p></div></div><div style="width:auto;margin:0;padding:5px;background-color:#fff;clear:both;border-top:1px solid #ccc" data-mce-style="width: auto; margin: 0; padding: 5px; background-color: #fff; clear: both; border-top: 1px solid #ccc;"><table bgcolor="#ffffff" border="0" cellpadding="0" cellspacing="0" style="background-color:#fff" width="100%" class="mceItemTable" data-mce-style="background-color: #fff;"><tbody><tr><td><span style="font-family: helvetica, sans-serif; color: #333333; font-size: xx-small;" data-mce-style="font-family: helvetica, sans-serif; color: #333333; font-size: xx-small;"> <strong>illumos-developer</strong> | <a href="https://urldefense.proofpoint.com/v1/url?u=https://www.listbox.com/member/archive/182179/%3Dnow&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=yqgQ6LhGnfWMd79QvLrmWsnr%2FlpWj5c0oy4MpT8%2Bgik%3D%0A&m=pPmQWwIFT9FD1yq%2B2VrO%2BvqlsfU%2B9kIY4Jx%2FcnFE0dg%3D%0A&s=e1feb28fe976d4750e39182a09cf509da34c77de41c94c421e9c91442ed6a3e3" style="text-decoration:none;color:#669933;border-bottom:1px solid #444444" title="Go to archives for illumos-developer" target="_blank" data-mce-href="https://urldefense.proofpoint.com/v1/url?u=https://www.listbox.com/member/archive/182179/%3Dnow&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=yqgQ6LhGnfWMd79QvLrmWsnr%2FlpWj5c0oy4MpT8%2Bgik%3D%0A&m=pPmQWwIFT9FD1yq%2B2VrO%2BvqlsfU%2B9kIY4Jx%2FcnFE0dg%3D%0A&s=e1feb28fe976d4750e39182a09cf509da34c77de41c94c421e9c91442ed6a3e3" data-mce-style="text-decoration: none; color: #669933; border-bottom: 1px solid #444444;">Archives</a> <a href="https://urldefense.proofpoint.com/v1/url?u=https://www.listbox.com/member/archive/rss/182179/21175074-7782178a&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=yqgQ6LhGnfWMd79QvLrmWsnr%2FlpWj5c0oy4MpT8%2Bgik%3D%0A&m=pPmQWwIFT9FD1yq%2B2VrO%2BvqlsfU%2B9kIY4Jx%2FcnFE0dg%3D%0A&s=8a75ca232dff900c80f6ca5c3dfd72bcaaecdc9d1ec05891ac3fc4185e3781c4" style="text-decoration:none;color:#669933" title="RSS feed for illumos-developer" target="_blank" data-mce-href="https://urldefense.proofpoint.com/v1/url?u=https://www.listbox.com/member/archive/rss/182179/21175074-7782178a&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=yqgQ6LhGnfWMd79QvLrmWsnr%2FlpWj5c0oy4MpT8%2Bgik%3D%0A&m=pPmQWwIFT9FD1yq%2B2VrO%2BvqlsfU%2B9kIY4Jx%2FcnFE0dg%3D%0A&s=8a75ca232dff900c80f6ca5c3dfd72bcaaecdc9d1ec05891ac3fc4185e3781c4" data-mce-style="text-decoration: none; color: #669933;"><img border="0" src="http://postlink.www.listbox.com/1709060/833487e62783d55fe81f119fb93ef644/21175074/4e47ca0d.jpg?uri=aHR0cHM6Ly93d3cubGlzdGJveC5jb20vaW1hZ2VzL2ZlZWQtaWNvbi0xMHgxMC5qcGc"></a> | <a href="https://urldefense.proofpoint.com/v1/url?u=https://www.listbox.com/member/?member_id%3D21175074%26id_secret%3D21175074-3254433f&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=yqgQ6LhGnfWMd79QvLrmWsnr%2FlpWj5c0oy4MpT8%2Bgik%3D%0A&m=pPmQWwIFT9FD1yq%2B2VrO%2BvqlsfU%2B9kIY4Jx%2FcnFE0dg%3D%0A&s=0a4599750905d8dee25f6e53143c971c3a7c2e2f26009ca7accf245886e04461" style="text-decoration:none;color:#669933;border-bottom:1px solid #444444" title="" target="_blank" data-mce-href="https://urldefense.proofpoint.com/v1/url?u=https://www.listbox.com/member/?member_id%3D21175074%26id_secret%3D21175074-3254433f&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=yqgQ6LhGnfWMd79QvLrmWsnr%2FlpWj5c0oy4MpT8%2Bgik%3D%0A&m=pPmQWwIFT9FD1yq%2B2VrO%2BvqlsfU%2B9kIY4Jx%2FcnFE0dg%3D%0A&s=0a4599750905d8dee25f6e53143c971c3a7c2e2f26009ca7accf245886e04461" data-mce-style="text-decoration: none; color: #669933; border-bottom: 1px solid #444444;">Modify</a> Your Subscription</span></td><td align="right" valign="top"><a href="https://urldefense.proofpoint.com/v1/url?u=http://www.listbox.com&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=yqgQ6LhGnfWMd79QvLrmWsnr%2FlpWj5c0oy4MpT8%2Bgik%3D%0A&m=pPmQWwIFT9FD1yq%2B2VrO%2BvqlsfU%2B9kIY4Jx%2FcnFE0dg%3D%0A&s=54dfb2984b27fbf3f7954416a47ed088332b2f6f6c1577ec59af1a030cd97c63" style="border-bottom:none" target="_blank" data-mce-href="https://urldefense.proofpoint.com/v1/url?u=http://www.listbox.com&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=yqgQ6LhGnfWMd79QvLrmWsnr%2FlpWj5c0oy4MpT8%2Bgik%3D%0A&m=pPmQWwIFT9FD1yq%2B2VrO%2BvqlsfU%2B9kIY4Jx%2FcnFE0dg%3D%0A&s=54dfb2984b27fbf3f7954416a47ed088332b2f6f6c1577ec59af1a030cd97c63" data-mce-style="border-bottom: none;"> <img border="0" title="Powered by Listbox" src="http://postlink.www.listbox.com/1709061/3379085af0f1cf7fc3708f04b4471ae2/21175074/4e47ca0d.png?uri=aHR0cHM6Ly93d3cubGlzdGJveC5jb20vaW1hZ2VzL2xpc3Rib3gtbG9nby1zbWFsbC5wbmc"></a></td></tr></tbody></table></div></div></blockquote></div><br></div></div><div><br></div></div><br>_______________________________________________<br>OmniOS-discuss mailing list<br>OmniOS-discuss@lists.omniti.com<br>https://urldefense.proofpoint.com/v1/url?u=http://lists.omniti.com/mailman/listinfo/omnios-discuss&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=yqgQ6LhGnfWMd79QvLrmWsnr%2FlpWj5c0oy4MpT8%2Bgik%3D%0A&m=kP68dpV0mRMFNohpnv8r%2FJF7j4%2FzOwVtv5SSakIqIiQ%3D%0A&s=3be7b320dd64a6f1a310ade277f3028203e77cef9da0e743852773f97be078c2<br></div><div><br></div></div></body></html>