<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Hi Chris,<div><br><div><div>On Aug 6, 2012, at 9:07 AM, Chris Nagele wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div>Hi Eric,<br><br>Richard had me run:<br><br>truss -dD ping -s 10.135.1.11<br><br>From this result I can't seem to find anything useful. The longest<br>time is taken at the top:<br><br>0.0556 0.0000 write(1, "\n", 1) = 1<br> 0.9975 0.9419 Received signal #14, SIGALRM, in pollsys() [caught]<br></div></blockquote><div><br></div><div>It is already over by now. Look for the difference between the first sendto(3, ...) and </div><div>recvmsg(3,...) something like:</div><div><br></div><div> 0.0210 0.0013 write(1, " P I N G 1 9 2 . 1 6 8".., 34) = 34</div><div> 0.0212 0.0002 sendto(3, "\b\0F6 ^\r1F\0\0 U1F P".., 64, 32768, 0x0806BD88, 16) = 64</div><div> 0.0214 0.0002 sigaction(SIGALRM, 0x08047BA0, 0x08047C20) = 0</div><div> 0.0215 0.0001 lwp_sigmask(SIG_SETMASK, 0x00000000, 0x00000000, 0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]</div><div> 0.0216 0.0001 alarm(1) = 0</div><div> 0.0220 0.0004 pollsys(0x08047AA0, 1, 0x00000000, 0x00000000) = 1</div><div> 0.0222 0.0002 recvmsg(3, 0x08047C10, 32768) = 84</div><div><br></div><div> -- richard</div><div><br></div><blockquote type="cite"><div> 0.9976 0.0001 pollsys(0x08047B50, 1, 0x00000000, 0x00000000) Err#4 EINTR<br> 0.9976 0.0000 lwp_sigmask(SIG_SETMASK, 0x00002000, 0x00000000,<br>0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]<br> 0.9976 0.0000 sendto(3, "\b\0 AA3068A\001 lE51F P".., 64, 32768,<br>0x0807BA90, 16) = 64<br> 0.9977 0.0001 alarm(1) = 0<br> 0.9977 0.0000 setcontext(0x08047660)<br> 0.9978 0.0001 pollsys(0x08047B50, 1, 0x00000000, 0x00000000) = 1<br> 0.9978 0.0000 recvmsg(3, 0x08047CD0, 32768) = 84<br> 0.9978 0.0000 lwp_sigmask(SIG_SETMASK, 0x00002000, 0x00000000,<br>0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]<br> 0.9978 0.0000 lwp_sigmask(SIG_SETMASK, 0x00000000, 0x00000000,</div></blockquote><blockquote type="cite"><div>0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]<br>64 bytes from 10.135.1.11: 0.9979 0.0001 write(1, " 6 4 b y t<br>e s f r o".., 27) = 27<br>icmp_seq=1. 0.9979 0.0000 write(1, " i c m p _ s e q = 1 . ",<br>12) = 12<br>time=0.225 ms 0.9980 0.0001 write(1, " t i m e = 0 . 2 2 5 m"..,<br>13) = 13<br><br>Looking at snoop, I see the following:<br><br> 18.34001 10.135.1.10 -> debian-host length: 98 ICMP Echo request<br>(ID: 1780 Sequence number: 5)<br> 18.34019 debian-host -> 10.135.1.10 length: 98 ICMP Echo reply<br>(ID: 1780 Sequence number: 5)<br> 18.34641 debian-host -> * length: 60 ARP C Who is<br>10.135.1.10, 10.135.1.10 ?<br> 18.34643 10.135.1.10 -> debian-host length: 42 ARP R<br>10.135.1.10, 10.135.1.10 is 90:e2:ba:f:ce:ec<br> 19.34000 10.135.1.10 -> debian-host length: 98 ICMP Echo request<br>(ID: 1780 Sequence number: 6)<br> 19.34018 debian-host -> 10.135.1.10 length: 98 ICMP Echo reply<br>(ID: 1780 Sequence number: 6)<br> 20.33998 10.135.1.10 -> debian-host length: 98 ICMP Echo request<br>(ID: 1780 Sequence number: 7)<br> 20.34015 debian-host -> 10.135.1.10 length: 98 ICMP Echo reply<br>(ID: 1780 Sequence number: 7)<br><br>Which all looks pretty normal as well. I might give superping.d a try<br>as well (<a href="http://www.c0t0d0s0.org/archives/7479-Dont-misuse-ping!.html">http://www.c0t0d0s0.org/archives/7479-Dont-misuse-ping!.html</a>).<br><br>Let me know if you have any other ideas.<br><br>Thanks,<br>Chris<br><br><br>On Mon, Aug 6, 2012 at 10:06 AM, Eric Sproul <<a href="mailto:esproul@omniti.com">esproul@omniti.com</a>> wrote:<br><blockquote type="cite">On Sun, Aug 5, 2012 at 8:07 PM, Chris Nagele <<a href="mailto:nagele@wildbit.com">nagele@wildbit.com</a>> wrote:<br></blockquote><blockquote type="cite"><blockquote type="cite">For some reason though, ping times from OmniOS to Debian are still<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">much slower, above 0.2ms. I know it is nit picking, but we invested in<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">10g for lower latency, so I am trying to get the most out of it. From<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Debian to OmniOS I get about 0.08ms still.<br></blockquote></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hi Chris,<br></blockquote><blockquote type="cite">It'd be great to see some tcpdumps of this traffic. The most curious<br></blockquote><blockquote type="cite">thing to me is that you see differences in RTT between Debian and<br></blockquote><blockquote type="cite">OmniOS systems just by switching sender and receiver. Perhaps there's<br></blockquote><blockquote type="cite">something about the payload of a typical ping packet between the<br></blockquote><blockquote type="cite">systems.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Eric<br></blockquote><blockquote type="cite">_______________________________________________<br></blockquote><blockquote type="cite">OmniOS-discuss mailing list<br></blockquote><blockquote type="cite"><a href="mailto:OmniOS-discuss@lists.omniti.com">OmniOS-discuss@lists.omniti.com</a><br></blockquote><blockquote type="cite"><a href="http://lists.omniti.com/mailman/listinfo/omnios-discuss">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a><br></blockquote>_______________________________________________<br>OmniOS-discuss mailing list<br><a href="mailto:OmniOS-discuss@lists.omniti.com">OmniOS-discuss@lists.omniti.com</a><br>http://lists.omniti.com/mailman/listinfo/omnios-discuss<br></div></blockquote></div><br><div apple-content-edited="true"> <div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">--</div><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">ZFS Performance and Training</div><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><a href="mailto:Richard.Elling@RichardElling.com">Richard.Elling@RichardElling.com</a><br>+1-760-896-4422<br><br><br></div></span></div></span></div> </div> <br></div></body></html>