[OmniOS-discuss] Mellanox Infiniband 2x 10Gbps MHEL-CF128-TC

[Chris Nagele]

We've used the X520's for a while on a very active NFS production
environment. They work extremely well. We now have a 10G switch, but
used cross over SFP+ cables for almost a year.

Our primary use is NFS. We did some performance testing and noticed a
big difference when tuning the following settings (like Thibault said)
in the /kernel/drv/ixgbe.conf file for the 10 GbE driver:

default_mtu=9000;
intr_throttling=1; (or 0)

The last one (intro_throttling) made a big difference in lowering
latency, but to be honest, I read that it can have some side affects
as well.

Chris

On Sat, Aug 17, 2013 at 9:58 PM, Thibault VINCENT
<thibault.vincent at smartjog.com> wrote:
>> So you have these working on OmniOS without any issues? Did you have
>> to install any particular drivers?
>
> Yes, it works great out of the box. The only setting you can think of
> with the ixgbe driver is to deactivate the interrupt throttling but
> that's only interesting when receiving lots of packets per second (small
> packets you won't see much on a storage with few clients, more likely
> when doing routing or LB stuff).
>
> Like I said we don't have a super long experience of X520 and OmniOS
> but all lab tests were done with these adapters and servers have been
> benchmarked for days on NFS and iSCSI load. It's satisfying and will
> go into production.
>
> --
> Thibault VINCENT - Infrastructure Engineer
> SmartJog | T: +33 1 5868 6238
> 27 Blvd Hippolyte Marquès, 94200 Ivry-sur-Seine, France
> www.smartjog.com | a TDF Group company
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss