[OmniOS-discuss] Performance Issues

[Matt Weiss]

I am having some major performance issues and cannot figure out why.

All-in-one box sharing storage with NFS
 From Veaam (another vm on same box) I am getting 55 MB/s backup 
speeds.  Everything has vmware tools 5.5 installed and shows up as a 10 
Gbit adapter.
Veeam says my bottleneck is source (which would be the omnios vm)

I have a 2nd box setup with freenas on a smaller supermicro with similar 
specs but with an expander backplane and WD Red drives.
I can write to that at 156 MB/s

In general, the system just seems way slower than it should be, not just 
from veeam.  iostats on the zpool don't seem to be really hitting things 
all that hard.

What can I do to narrow this down?


SPECS and info:

Supermicro SC846A-R900B (Direct Attach, 6 SFF 8087)
Supermicro X9DR7-LN4F-JBOD
14x  Seagate 4TB Constellation ES.3 3.5" 7200RPM SAS ST4000NM0023
2x   Intel Xeon E5-2620V2 2.1GHZ 15MB DDR3 Up to 1866MHZ 6C
256 GB ram 16 Axiom Memory Solutions 16GB DDR3-1600 ECC Rdimm-
1 STEC Zues RAM 6 GB SAS 8 GB
2 x LSI 9207-8I plus onboard motherboard lsi
10 Gbit ethernet via Intel TX540

All 6 SFF connections from the 2308 lsi's are hooked up to the 6 
connections on the backplane of the supermicro case.

Here is my zpool info:

zpool status tank
   pool: tank
  state: ONLINE
   scan: scrub repaired 0 in 16h54m with 0 errors on Tue Feb  4 11:54:24 
2014
config:

         NAME                       STATE     READ WRITE CKSUM
         tank                       ONLINE       0     0     0
           mirror-1                 ONLINE       0     0     0
             c4t5000C5005702158Fd0  ONLINE       0     0     0
             c4t5000C500570880CBd0  ONLINE       0     0     0
           mirror-2                 ONLINE       0     0     0
             c4t5000C500572792B3d0  ONLINE       0     0     0
             c4t5000C5005731D42Bd0  ONLINE       0     0     0
           mirror-3                 ONLINE       0     0     0
             c4t5000C5005731DA97d0  ONLINE       0     0     0
             c4t5000C5005731DBD3d0  ONLINE       0     0     0
           mirror-4                 ONLINE       0     0     0
             c4t5000C5005731DEFBd0  ONLINE       0     0     0
             c4t5000C5005731DF4Fd0  ONLINE       0     0     0
           mirror-5                 ONLINE       0     0     0
             c4t5000C5005731F03Fd0  ONLINE       0     0     0
             c4t5000C500573209EBd0  ONLINE       0     0     0
           mirror-6                 ONLINE       0     0     0
             c4t5000C50057320E5Bd0  ONLINE       0     0     0
             c4t5000C50057321177d0  ONLINE       0     0     0
           mirror-7                 ONLINE       0     0     0
             c4t5000C5005732F953d0  ONLINE       0     0     0
             c4t5000C50057330B27d0  ONLINE       0     0     0
         logs
           c6t5000A72A3008DF19d0    ONLINE       0     0     0
         cache
           c4t50025388A01D572Cd0    ONLINE       0     0     0
         spares
           c4t5000C500570212AFd0    AVAIL

errors: No known data errors

logs: zuesram
cache: samsung 840 evo (just added yesterday)


uname -a
SunOS omnios.kcgo.com 5.11 omnios-b281e50 i86pc i386 i86pc



This is currently a napp-it all in one box.

Vmware 5.1 sharing a OmniOS vmbox with
8 cpu
64 GB ram All reserved