<div dir="ltr"><div><div><div><div><div><div><div><div><div><div>Hi!<br><br></div>I'm having issues with multipathing, and i cant seem to figure out what is wrong. <br><br></div>The setup is a Supermicro 24 disk-box with 3 controllers (1 pcs internal SAS2308, two 9207i-cards, same firmware on all units), identified as follows:<br>
<br>Num Ctlr FW Ver NVDATA x86-BIOS PCI Addr<br>----------------------------------------------------------------------------<br><br>0 SAS2308_2(D1) 18.00.00.00 11.00.00.05 07.33.00.00 00:01:00:00<br>
1 SAS2308_2(D1) 18.00.00.00 11.00.00.05 07.33.00.00 00:02:00:00<br>2 SAS2308_2(D1) 18.00.00.00 11.00.00.05 07.33.00.00 00:03:00:00<br><br></div>The machine has 12 ST4000NM0023 (seagate 4TB DP) disks in it and a couple or bootdisks. The controllers are connected via 2 cables per controller to the backplane/expander. I've Installed latest stable omnios on it.<br>
<br></div>Excerpt from dmesg:<br><br>[...]<br><br>genunix: [ID 936769 <a href="http://kern.info">kern.info</a>] mpt_sas2 is /pci@0,0/pci8086,e06@2,2/pci1000,3020@0<br>scsi: [ID 583861 <a href="http://kern.info">kern.info</a>] mpt_sas7 at mpt_sas2: scsi-iport 4<br>
genunix: [ID 936769 <a href="http://kern.info">kern.info</a>] mpt_sas7 is /pci@0,0/pci8086,e06@2,2/pci1000,3020@0/iport@4<br>genunix: [ID 408114 <a href="http://kern.info">kern.info</a>] /pci@0,0/pci8086,e06@2,2/pci1000,3020@0/iport@4 (mpt_sas7) online<br>
scsi: [ID 583861 <a href="http://kern.info">kern.info</a>] sd11 at scsi_vhci0: unit-address g5000c50057c1fce3: conf f_sym<br>genunix: [ID 936769 <a href="http://kern.info">kern.info</a>] sd11 is /scsi_vhci/disk@g5000c50057c1fce3<br>
genunix: [ID 408114 <a href="http://kern.info">kern.info</a>] /scsi_vhci/disk@g5000c50057c1fce3 (sd11) online<br>genunix: [ID 483743 <a href="http://kern.info">kern.info</a>] /scsi_vhci/disk@g5000c50057c1fce3 (sd11) multipath status: degraded: path 4 mpt_sas15/disk@w5000c50057c1fce1,0 is online<br>
scsi: [ID 583861 <a href="http://kern.info">kern.info</a>] mpt_sas11 at mpt_sas1: scsi-iport 2<br>genunix: [ID 936769 <a href="http://kern.info">kern.info</a>] mpt_sas11 is /pci@0,0/pci8086,e04@2/pci1000,3020@0/iport@2<br>
genunix: [ID 408114 <a href="http://kern.info">kern.info</a>] /pci@0,0/pci8086,e04@2/pci1000,3020@0/iport@2 (mpt_sas11) online<br>scsi: [ID 583861 <a href="http://kern.info">kern.info</a>] sd2 at scsi_vhci0: unit-address g5000c50057ca74bb: conf f_sym<br>
genunix: [ID 936769 <a href="http://kern.info">kern.info</a>] sd2 is /scsi_vhci/disk@g5000c50057ca74bb<br>genunix: [ID 408114 <a href="http://kern.info">kern.info</a>] /scsi_vhci/disk@g5000c50057ca74bb (sd2) online<br><br>
[...]<br><br></div>Excerpt from mpathadm:<br><br># mpathadm list lu<br> /dev/rdsk/c1t5000C5006C0BF63Fd0s2<br> Total Path Count: 1<br> Operational Path Count: 1<br> /dev/rdsk/c1t5000C5006C0B29C7d0s2<br>
Total Path Count: 1<br> Operational Path Count: 1<br> /dev/rdsk/c1t5000C50057C1F5BFd0s2<br> Total Path Count: 1<br><br>[...]<br><br><br></div>Excerpt from format:<br><br>
# format<br>Searching for disks...done<br><br><br>AVAILABLE DISK SELECTIONS:<br> 0. c1t5000C5006C0B29C7d0 <SEAGATE-ST3300657SS-0008 cyl 36469 alt 2 hd 255 sec 63><br> /scsi_vhci/disk@g5000c5006c0b29c7<br>
1. c1t5000C5006C0BF63Fd0 <SEAGATE-ST3300657SS-0008 cyl 36469 alt 2 hd 255 sec 63><br> /scsi_vhci/disk@g5000c5006c0bf63f<br> 2. c1t5000C50057C1F5BFd0 <SEAGATE-ST4000NM0023-0003-3.64TB><br>
/scsi_vhci/disk@g5000c50057c1f5bf<br> 3. c1t5000C50057C1FCE3d0 <SEAGATE-ST4000NM0023-0003-3.64TB><br> /scsi_vhci/disk@g5000c50057c1fce3<br><br>[...]<br><br></div>If i set mpxio-disable="yes"; in mpt_sas.conf the error above obviously dissapears and also i can see the 'real' device/controller id's when issuing the format command. <br>
<br></div>If things were working correctly i assume i would see a total path count of 2 per disk, and the multipath status wouldn't be set as degraded in the log? What am i doing wrong? I've asked google and since they dont know the answer to the question i'd thought i'd try a post here ;)<br>
<br></div>Thanks in advance for any help,<br><br></div>Martin<br></div>