<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Hi all. I've been transitioning a file server to OmniOS for many reasons (abandoning zfsonlinux). But I seem to have one last issue I'd like to resolve. It seems to be running into a performance issue with samba. I'm not using the built in zfs smb sharing because I need more flexibility in our environment than it offers such as sharing subfolders, shadow copies, etc.<div class=""><br class=""></div><div class="">I'm running the latest LTS version of Omni on a well equipped server with 2x Xeon E5-2630 v2 @ 2.60GHz, 128G ECC ram with dual intel 10g NICs, and two dual LSI 6G SAS cards. The zpool has 8 x raidz2s that have 10 4TB drives in each totaling 290TB. Disk performance is not an issue.</div><div class=""><br class=""></div><div class="">I've compiled samba 4.2.1 and netatalk from source, got winbind working nicely with our AD environment. Samba is even happily kerberized. Everything authenticates and functions correctly. But, while netatalk gives me line speed performance (120-150MB/s on a gigabit workstation), samba won't budge above 40-60MB/s (same speeds using MacOS and Windows 7,8,2012 clients).</div><div class=""><br class=""></div><div class="">Using the same hardware on CentOS 7 with zfsonlinux, samba gives me just about the same throughput as netatalk. In linux, I could tune it with socket options giving it a bigger buffer and it made a big difference. But using the same options on Omni doesn't seem to have any significant affect (actually seems to slow it down a bit).</div><div class=""><br class=""></div><div class=""><div class="">In smb.conf on both OSs:</div><div class=""><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>socket options = TCP_NODELAY IPTOS_LOWDELAY SO_SNDBUF=2097152 SO_RCVBUF=2097152</div></div></div><div class=""><br class=""></div><div class="">In CentOS7 in sysctl.conf:</div><div class=""><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">net.ipv4.tcp_rmem = 10000000 10000000 10000000</div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">net.ipv4.tcp_wmem = 10000000 10000000 10000000</div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">net.ipv4.tcp_mem = 10000000 10000000 10000000</div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">net.ipv4.tcp_sack = 0</div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">net.core.rmem_max = 524287</div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">net.core.wmem_max = 524287</div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">net.core.rmem_default = 524287</div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">net.core.wmem_default = 524287</div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">net.core.optmem_max = 524287</div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">net.core.netdev_max_backlog = 300000</div></div><div class=""><br class=""></div><div class="">And then in Omni, I've set these ip properties</div><div class=""><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">root@store3:# ipadm show-prop</div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class=""><div style="margin: 0px;" class="">PROTO PROPERTY PERM CURRENT PERSISTENT DEFAULT POSSIBLE</div><div class="">tcp max_buf rw 16777216 16777216 1048576 8192-1073741824</div></div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">tcp recv_buf rw 16777216 16777216 128000 2048-16777216</div><div style="margin: 0px; font-size: 13px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);" class="">tcp send_buf rw 16777216 16777216 49152 4096-16777216</div></div><div class=""><br class=""></div><div class="">I just can't get samba on Omni to go any faster than 60MB/s. I've tried adjusting those buffers, removing the socket options in smb.conf altogether, but, to no avail.</div><div class=""><br class=""></div><div class="">Anyone else out there running samba on Omni and getting faster throughput? Anyone have any ideas of how I could get more throughput with samba?</div><div class=""><br class=""></div><div class="">Thanks,</div><div class=""><br class=""></div><div class="">Michael</div></body></html>