<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">I will look to do this. The shared storage is on SATA disks, so maybe? Although they are new. I hope they are fine. :)<div class=""><br class=""></div><div class="">I don’t see anything about mpt in /var/adm/messages, no.</div><div class=""><br class=""></div><div class="">-brian<br class=""><div class=""><br class=""><div><blockquote type="cite" class=""><div class="">On Jan 12, 2016, at 11:16 PM, John Barfield <<a href="mailto:john.barfield@bissinc.com" class="">john.barfield@bissinc.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><div class="">My input may or may not be valid but Im going to throw it out there anyway :)</div><div class=""><br class=""></div><div class="">do you have any Mpt disconnect errors in /var/adm/messages?</div><div class=""><br class=""></div><div class="">Also do you have smartmontools installed?</div><div class=""><br class=""></div><div class="">I ran into similiar issues just booting a sunfire x4540 recently off of OmniOS live, i/o would just hang while probing device nodes.</div><div class=""><br class=""></div><div class="">I found the drive that was acting up and pulled it.</div><div class=""><br class=""></div><div class="">All of a sudden everything miraculously worked amazing.</div><div class=""><br class=""></div><div class="">I compiled smartmontools after I got it to boot and found 10 drives out of 48 with bad sectors in prefail state.</div><div class=""><br class=""></div><div class="">I dont know if this happens with SAS drives or not but Im using SATA and saw this was a common issue in old opensolaris threads.<br class=""><br class="">-barfield<br class=""><br class=""><div class="x_acompli_signature">Sent from<span class="Apple-converted-space"> </span><a href="https://aka.ms/qtex0l" class="">Outlook Mobile</a></div><br class=""></div><br class=""><br class=""><br class=""><div class="x_gmail_quote">On Tue, Jan 12, 2016 at 8:08 PM -0800, "Brian Hechinger"<span class="Apple-converted-space"> </span><span dir="ltr" class=""><<a href="mailto:wonko@4amlunch.net" target="_blank" class="">wonko@4amlunch.net</a>></span><span class="Apple-converted-space"> </span>wrote:<br class=""><br class=""></div></div><font size="2" style="font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-size: 10pt;" class=""><div class="PlainText">In the meantime I’ve removed the SLOG and L2ARC just in case. I don’t think that’s it though. At least will have some sort of data point to work with here. :)<br class=""><br class="">-brian<br class=""><br class="">> On Jan 12, 2016, at 10:55 PM, Brian Hechinger <<a href="mailto:wonko@4amlunch.net" class="">wonko@4amlunch.net</a>> wrote:<br class="">><span class="Apple-converted-space"> </span><br class="">> Ok, it has happened.<br class="">><span class="Apple-converted-space"> </span><br class="">> Checking this here, the pool seems to be fine. I can read and write files.<br class="">><span class="Apple-converted-space"> </span><br class="">> except ‘zpool status’ is now currently hanging. I can still read/write from the pool, however.<br class="">><span class="Apple-converted-space"> </span><br class="">> I can telnet to port 3260, but restarting target services has hung.<br class="">><span class="Apple-converted-space"> </span><br class="">> root@basket1:/tank/Share# svcs -a | grep stmf<br class="">> online         Jan_05   svc:/system/stmf:default<br class="">> root@basket1:/tank/Share# svcs -a | grep target<br class="">> disabled       Jan_05   svc:/system/fcoe_target:default<br class="">> online         Jan_05   svc:/network/iscsi/target:default<br class="">> online         Jan_05   svc:/system/ibsrp/target:default<br class="">> root@basket1:/tank/Share# svcadm restart /system/ibsrp/target<br class="">> root@basket1:/tank/Share# svcadm restart /network/iscsi/target<br class="">> root@basket1:/tank/Share# svcadm restart /system/stmf<br class="">> root@basket1:/tank/Share# svcs -a | grep target<br class="">> disabled       Jan_05   svc:/system/fcoe_target:default<br class="">> online*        22:43:03 svc:/system/ibsrp/target:default<br class="">> online*        22:43:13 svc:/network/iscsi/target:default<br class="">> root@basket1:/tank/Share# svcs -a | grep stmf<br class="">> online*        22:43:18 svc:/system/stmf:default<br class="">> root@basket1:/tank/Share#<br class="">><span class="Apple-converted-space"> </span><br class="">> I’m doing a crash dump reboot. I’ll post the output somewhere.<br class="">><span class="Apple-converted-space"> </span><br class="">> The output of echo '$<threadlist' | mdb -k is attached.<br class="">><span class="Apple-converted-space"> </span><br class="">> <threadlist.out><br class="">><span class="Apple-converted-space"> </span><br class="">>> On Jan 8, 2016, at 3:11 PM, Matej Zerovnik <<a href="mailto:matej@zunaj.si" class="">matej@zunaj.si</a>> wrote:<br class="">>><span class="Apple-converted-space"> </span><br class="">>> Is the pool usable during comstar hang?<br class="">>> Can you write and read from the pool (test both, in my case, when pool froze, I wasn’t able to write to the pool, but I could read).<br class="">>><span class="Apple-converted-space"> </span><br class="">>> Again, this might not be connected with Comstar, but in my case, Comstar and pool hang were exchanging.<br class="">>><span class="Apple-converted-space"> </span><br class="">>> Matej<br class="">>><span class="Apple-converted-space"> </span><br class="">>>> On 08 Jan 2016, at 20:11, Brian Hechinger <<a href="mailto:wonko@4amlunch.net" class="">wonko@4amlunch.net</a>> wrote:<br class="">>>><span class="Apple-converted-space"> </span><br class="">>>> Yeah, I’m using the 1068E to boot from (this has been supported since before Illumos) but that doesn’t have anything accessed by COMSTAR.<br class="">>>><span class="Apple-converted-space"> </span><br class="">>>> It’s the ICH10R SATA that hosts the disks that COMSTAR shares out space from.<br class="">>>><span class="Apple-converted-space"> </span><br class="">>>> -brian<br class="">>>><span class="Apple-converted-space"> </span><br class="">>>>> On Jan 8, 2016, at 1:31 PM, Richard Jahnel <<a href="mailto:rjahnel@ellipseinc.com" class="">rjahnel@ellipseinc.com</a>> wrote:<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> First off, love SuperMicro good choice IMHO.<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> This board has two on board controllers.<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> LSI SAS1068E (not 100% sure there are working illumos drivers for this one)<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> And<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> Intel ICH10R SATA (So I'm guessing your using this one.)<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> -----Original Message-----<br class="">>>>> From: OmniOS-discuss [<a href="mailto:omnios-discuss-bounces@lists.omniti.com" class="">mailto:omnios-discuss-bounces@lists.omniti.com</a>] On Behalf Of Brian Hechinger<br class="">>>>> Sent: Friday, January 08, 2016 12:16 PM<br class="">>>>> To: Matej Zerovnik <<a href="mailto:matej@zunaj.si" class="">matej@zunaj.si</a>><br class="">>>>> Cc: omnios-discuss <<a href="mailto:omnios-discuss@lists.omniti.com" class="">omnios-discuss@lists.omniti.com</a>><br class="">>>>> Subject: Re: [OmniOS-discuss] [discuss] COMSTAR hanging<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>>> Which controller exactly do you have?<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> Whatever ACHI stuff is built into the motherboard. Motherboard is X8DTL-3F.<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>>> Do you know firmware version?<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> I’m assuming this is linked to the BIOS version?<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>>> Which hard drives?<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> Hitachi-HUA723030ALA640-MKAOAA50-2.73TB<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>>> It might not tell much, but it’s good to have as much information as possible.<br class="">>>>>><span class="Apple-converted-space"> </span><br class="">>>>>> When comstar hangs, can you telnet to the iSCSI port?<br class="">>>>>> What does svcs says, is the service running?<br class="">>>>>> What happens in you try to restart it?<br class="">>>>>> How do you restart it?<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> I’ll try all these things next time.<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>>> In my case, svcs reported service running, but when I tried to telnet, there was no connection as well as there was no listening port opened when checking with 'netstat -an'. If I tried to restart target and stmf service, but stmf service got stucked in online* state and would not start. Reboot was the only solution in my case, but as I said, latest 014 release is working OK (but then again, load got reduced).<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> All good info. Thanks!<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> -brian<br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>>><span class="Apple-converted-space"> </span><br class="">>>>>> Matej<br class="">>>>>><span class="Apple-converted-space"> </span><br class="">>>>>>> On 08 Jan 2016, at 17:50, Dave Pooser <<a href="mailto:dave-oo@pooserville.com" class="">dave-oo@pooserville.com</a>> wrote:<br class="">>>>>>><span class="Apple-converted-space"> </span><br class="">>>>>>>>> On Jan 8, 2016, at 11:22 AM, Brian Hechinger <<a href="mailto:wonko@4amlunch.net" class="">wonko@4amlunch.net</a>> wrote:<br class="">>>>>>>>><span class="Apple-converted-space"> </span><br class="">>>>>>>>> No, ZFS raid10<br class="">>>>>>>><span class="Apple-converted-space"> </span><br class="">>>>>>>> Saw the HW-RAID term, and got concerned.  That's what, raidz2 in ZFS-ese?<br class="">>>>>>><span class="Apple-converted-space"> </span><br class="">>>>>>> It's a zpool with multiple mirror vdevs.<br class="">>>>>>><span class="Apple-converted-space"> </span><br class="">>>>>>> --<span class="Apple-converted-space"> </span><br class="">>>>>>> Dave Pooser<br class="">>>>>>> Cat-Herder-in-Chief, <a href="http://pooserville.com" class="">Pooserville.com</a><br class="">>>>>>><span class="Apple-converted-space"> </span><br class="">>>>>>><span class="Apple-converted-space"> </span><br class="">>>>>>> _______________________________________________<br class="">>>>>>> OmniOS-discuss mailing list<br class="">>>>>>> <a href="mailto:OmniOS-discuss@lists.omniti.com" class="">OmniOS-discuss@lists.omniti.com</a><br class="">>>>>>><span class="Apple-converted-space"> </span><a href="http://lists.omniti.com/mailman/listinfo/omnios-discuss" class="">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a><br class="">>>>>><span class="Apple-converted-space"> </span><br class="">>>>>> _______________________________________________<br class="">>>>>> OmniOS-discuss mailing list<br class="">>>>>> <a href="mailto:OmniOS-discuss@lists.omniti.com" class="">OmniOS-discuss@lists.omniti.com</a><br class="">>>>>><span class="Apple-converted-space"> </span><a href="http://lists.omniti.com/mailman/listinfo/omnios-discuss" class="">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a><br class="">>>>><span class="Apple-converted-space"> </span><br class="">>>>> _______________________________________________<br class="">>>>> OmniOS-discuss mailing list<br class="">>>>> <a href="mailto:OmniOS-discuss@lists.omniti.com" class="">OmniOS-discuss@lists.omniti.com</a><br class="">>>>><span class="Apple-converted-space"> </span><a href="http://lists.omniti.com/mailman/listinfo/omnios-discuss" class="">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a><br class="">>>><span class="Apple-converted-space"> </span><br class="">>><span class="Apple-converted-space"> </span><br class="">><span class="Apple-converted-space"> </span><br class=""><br class=""><br class=""><br class="">-------------------------------------------<br class="">illumos-discuss<br class="">Archives:<span class="Apple-converted-space"> </span><a href="https://www.listbox.com/member/archive/182180/=now" class="">https://www.listbox.com/member/archive/182180/=now</a><br class="">RSS Feed:<span class="Apple-converted-space"> </span><a href="https://www.listbox.com/member/archive/rss/182180/26677440-40b316d8" class="">https://www.listbox.com/member/archive/rss/182180/26677440-40b316d8</a><br class="">Modify Your Subscription:<span class="Apple-converted-space"> </span><a href="https://www.listbox.com/member/?member_id=26677440&id_secret=26677440-8fd7f4fe" class="">https://www.listbox.com/member/?member_id=26677440&id_secret=26677440-8fd7f4fe</a><br class="">Powered by Listbox:<span class="Apple-converted-space"> </span><a href="http://www.listbox.com/" class="">http://www.listbox.com</a><br class=""></div></span></font><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">_______________________________________________</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">OmniOS-discuss mailing list</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><a href="mailto:OmniOS-discuss@lists.omniti.com" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">OmniOS-discuss@lists.omniti.com</a><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><a href="http://lists.omniti.com/mailman/listinfo/omnios-discuss" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a></div></blockquote></div><br class=""></div></div></body></html>