<div> </div> -----Rune Tipsmark <rt@steait.net> skrev: -----<div class="iNotesHistory" style="padding-left:5px;"><div style="padding-right:0px;padding-left:5px;border-left:solid black 2px;">Till: Johan Kragsterman <johan.kragsterman@capvert.se> Från: Rune Tipsmark <rt@steait.net> Datum: 2015-03-07 17:14 Kopia: 'Nate Smith' <nsmith@careyweb.com>, 'Richard Elling' <richard.elling@richardelling.com>, "omnios-discuss@lists.omniti.com" <omnios-discuss@lists.omniti.com> Ärende: RE: Re: [OmniOS-discuss] QLE2652 I/O Disconnect. Heat Sinks? <div>ok, so HP has a riser and the FC cards are sitting in the riser. SM has no riser and all cards are inserted directly onto motherboard. Also I just remembered... when I had the Infiniband ConnectX2 installed in the SM it would not reboot and I always had to reset it via IPMI. The more I think about it the more I lean towards SM having an issue... and Dell uses essentially SM so same same. br, Rune So, not a PCI bridge issue, then. The contrary, in fact. It works with the bridge, but not without....So that's obviously not the problem. But good to get it sorted....</div><div> </div><div>Johan ________________________________________ From: Johan Kragsterman <johan.kragsterman@capvert.se> Sent: Saturday, March 7, 2015 4:24 PM To: Rune Tipsmark Cc: 'Nate Smith'; 'Richard Elling'; omnios-discuss@lists.omniti.com Subject: Ang: Re: [OmniOS-discuss] QLE2652 I/O Disconnect. Heat Sinks? -----"OmniOS-discuss" <omnios-discuss-bounces@lists.omniti.com> skrev: ----- Till: "'Nate Smith'" <nsmith@careyweb.com>, "'Richard Elling'" <richard.elling@richardelling.com> Från: Rune Tipsmark Sänt av: "OmniOS-discuss" Datum: 2015-03-07 04:06 Kopia: "omnios-discuss@lists.omniti.com" <omnios-discuss@lists.omniti.com> Ärende: Re: [OmniOS-discuss] QLE2652 I/O Disconnect. Heat Sinks? No idea to be honest, even if there is its scary if it can cause these kinds of problems… Br, Rune You don't know wether these systems got risers or not? That can't be difficult to find out: Are the HBA's located directly in PCIe slots on the system board, or are they instead located in riser boards that sits in the PCIe slots? It would be very interesting to find out.... If Richards theory is correct, you got HBA's sitting in risers on the Supermicro, but on the HP you got the HBA's directly in the PCIe slots on the system board. Rgrds Johan From: OmniOS-discuss [<a href="mailto:omnios-discuss-bounces@lists.omniti.com">mailto:omnios-discuss-bounces@lists.omniti.com</a>] On Behalf Of Nate Smith Sent: Friday, March 06, 2015 8:57 AM To: 'Richard Elling' Cc: omnios-discuss@lists.omniti.com Subject: Re: [OmniOS-discuss] QLE2652 I/O Disconnect. Heat Sinks? Yeah, there is on R720s, I think. What about on the Supermicro and HP servers? From: Richard Elling [<a href="mailto:richard.elling@richardelling.com">mailto:richard.elling@richardelling.com</a>] Sent: Friday, March 06, 2015 11:39 AM To: Nate Smith Cc: omnios-discuss@lists.omniti.com Subject: Re: [OmniOS-discuss] QLE2652 I/O Disconnect. Heat Sinks? On Mar 5, 2015, at 6:00 AM, Nate Smith <nsmith@careyweb.com> wrote: I’ve had this problem for a while, and I have no way to diagnose what is going on, but occasionally when system IO gets high (I’ve seen it happen especially on backups), I will lose connectivity with my Fibre Channel cards which serve up fibre channel LUNS to a VM cluster. All hell breaks loose, and then connectivity gets restored. I don’t get an error that it’s dropped, at least not on the Omnios system, but I get notice when it’s restored (which makes no sense). I’m wondering if the cards are just overheating, and if heat sinks with a fan would help on the io chip. Is there a PCI bridge in the data path? These can often be found on mezzanine or riser cards. -- richard Mar 5 01:55:01 newstorm fct: [ID 132490 kern.notice] NOTICE: qlt2,0 LINK UP, portid 20000, topology Fabric Pt-to-Pt,speed 8G Mar 5 01:56:26 newstorm fct: [ID 132490 kern.notice] NOTICE: qlt0,0 LINK UP, portid 20100, topology Fabric Pt-to-Pt,speed 8G Mar 5 02:00:13 newstorm last message repeated 1 time Mar 5 02:00:15 newstorm fct: [ID 132490 kern.notice] NOTICE: qlt3,0 LINK UP, portid 10000, topology Fabric Pt-to-Pt,speed 8G Mar 5 02:00:15 newstorm fct: [ID 132490 kern.notice] NOTICE: qlt2,0 LINK UP, portid 20000, topology Fabric Pt-to-Pt,speed 8G Mar 5 02:00:18 newstorm fct: [ID 132490 kern.notice] NOTICE: qlt1,0 LINK UP, portid 10100, topology Fabric Pt-to-Pt,speed 8G _______________________________________________ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com <a href="http://lists.omniti.com/mailman/listinfo/omnios-discuss">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a> _______________________________________________ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com <a href="http://lists.omniti.com/mailman/listinfo/omnios-discuss">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a> </div></div></div><div></div>