<html><head></head><body>Have you tried running iperf?<br><br><div class="gmail_quote">On September 23, 2015 4:06:53 PM CEST, "Martin Truhlář" <martin.truhlar@archcon.cz> wrote:<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<pre class="k9mail">Hi Hanno<br /><br />Thank you for your advice, unfortunatelly on dpool is ashift already set to 12 without any impact on performance.<br /><br />Martin<br /><br />dpool:<br /> version: 5000<br /> name: 'dpool'<br /> state: 0<br /> txg: 423442<br /> pool_guid: 8301756920046328435<br /> hostid: 390978448<br /> hostname: 'archnas'<br /> vdev_children: 6<br /> vdev_tree:<br /> type: 'root'<br /> id: 0<br /> guid: 8301756920046328435<br /> create_txg: 4<br /> children[0]:<br /> type: 'mirror'<br /> id: 0<br /> guid: 1196673952777635344<br /> metaslab_array: 34<br /> metaslab_shift: 33<br /> ashift: 12<br /> asize: 1000191557632<br /> is_log: 0<br /> create_txg: 4<br /> children[0]:<br /> type: 'disk'<br /> id: 0<br /> guid: 8124964091934866578<br />
path: '/dev/dsk/c1t50014EE00400FA16d0s0'<br /> devid: 'id1,sd@n50014ee00400fa16/a'<br /> phys_path: '/scsi_vhci/disk@g50014ee00400fa16:a'<br /> whole_disk: 1<br /> DTL: 490<br /> create_txg: 4<br /> children[1]:<br /> type: 'disk'<br /> id: 1<br /> guid: 9348868466535755709<br /> path: '/dev/dsk/c1t50014EE2B40F14DBd0s0'<br /> devid: 'id1,sd@n50014ee2b40f14db/a'<br /> phys_path: '/scsi_vhci/disk@g50014ee2b40f14db:a'<br /> whole_disk: 1<br /> DTL: 489<br /> create_txg: 4<br /> children[1]:<br /> type: 'mirror'<br /> id: 1<br /> guid: 9943497592636049032<br /> metaslab_array: 38<br /> metaslab_shift: 33<br /> ashift: 12<br /> asize: 1000191557632<br /> is_log: 0<br
/> create_txg: 34<br /> children[0]:<br /> type: 'disk'<br /> id: 0<br /> guid: 2705367364579591435<br /> path: '/dev/dsk/c1t50014EE05950B131d0s0'<br /> devid: 'id1,sd@n50014ee05950b131/a'<br /> phys_path: '/scsi_vhci/disk@g50014ee05950b131:a'<br /> whole_disk: 1<br /> DTL: 488<br /> create_txg: 34<br /> children[1]:<br /> type: 'disk'<br /> id: 1<br /> guid: 5412107877453931054<br /> path: '/dev/dsk/c1t50014EE2B5E5A6B8d0s0'<br /> devid: 'id1,sd@n50014ee2b5e5a6b8/a'<br /> phys_path: '/scsi_vhci/disk@g50014ee2b5e5a6b8:a'<br /> whole_disk: 1<br /> DTL: 487<br /> create_txg: 34<br /> children[2]:<br /> type: 'mirror'<br /> id: 2<br /> guid:
4337686502023930092<br /> whole_disk: 0<br /> metaslab_array: 40<br /> metaslab_shift: 33<br /> ashift: 12<br /> asize: 1000191557632<br /> is_log: 0<br /> create_txg: 65<br /> children[0]:<br /> type: 'disk'<br /> id: 0<br /> guid: 12065653943105190290<br /> path: '/dev/dsk/c1t50014EE05958C51Bd0s0'<br /> devid: 'id1,sd@n50014ee05958c51b/a'<br /> phys_path: '/scsi_vhci/disk@g50014ee05958c51b:a'<br /> whole_disk: 1<br /> DTL: 486<br /> create_txg: 65<br /> children[1]:<br /> type: 'disk'<br /> id: 1<br /> guid: 7956964322079560255<br /> path: '/dev/dsk/c1t50014EE0595617ACd0s0'<br /> devid: 'id1,sd@n50014ee0595617ac/a'<br /> phys_path:
'/scsi_vhci/disk@g50014ee0595617ac:a'<br /> whole_disk: 1<br /> DTL: 482<br /> create_txg: 65<br /> children[3]:<br /> type: 'mirror'<br /> id: 3<br /> guid: 13515811785015942389<br /> metaslab_array: 43<br /> metaslab_shift: 33<br /> ashift: 12<br /> asize: 1000191557632<br /> is_log: 0<br /> create_txg: 119<br /> children[0]:<br /> type: 'disk'<br /> id: 0<br /> guid: 2010958773514461606<br /> path: '/dev/dsk/c1t50014EE0AEAE7540d0s0'<br /> devid: 'id1,sd@n50014ee0aeae7540/a'<br /> phys_path: '/scsi_vhci/disk@g50014ee0aeae7540:a'<br /> whole_disk: 1<br /> DTL: 484<br /> create_txg: 119<br /> children[1]:<br /> type: 'disk'<br /> id: 1<br />
guid: 6920452460884353416<br /> path: '/dev/dsk/c1t50014EE0AEAE9B65d0s0'<br /> devid: 'id1,sd@n50014ee0aeae9b65/a'<br /> phys_path: '/scsi_vhci/disk@g50014ee0aeae9b65:a'<br /> whole_disk: 1<br /> DTL: 491<br /> create_txg: 119<br /> children[4]:<br /> type: 'mirror'<br /> id: 4<br /> guid: 13450996153705674574<br /> metaslab_array: 45<br /> metaslab_shift: 30<br /> ashift: 9<br /> asize: 120020795392<br /> is_log: 1<br /> create_txg: 172<br /> children[0]:<br /> type: 'disk'<br /> id: 0<br /> guid: 642840549260709901<br /> path: '/dev/dsk/c1t55CD2E404B88ABE1d0s0'<br /> devid: 'id1,sd@n55cd2e404b88abe1/a'<br /> phys_path: '/scsi_vhci/disk@g55cd2e404b88abe1:a'<br />
whole_disk: 1<br /> DTL: 494<br /> create_txg: 172<br /> children[1]:<br /> type: 'disk'<br /> id: 1<br /> guid: 17473204952243782915<br /> path: '/dev/dsk/c1t55CD2E404B88E4CFd0s0'<br /> devid: 'id1,sd@n55cd2e404b88e4cf/a'<br /> phys_path: '/scsi_vhci/disk@g55cd2e404b88e4cf:a'<br /> whole_disk: 1<br /> DTL: 493<br /> create_txg: 172<br /> children[5]:<br /> type: 'mirror'<br /> id: 5<br /> guid: 6461803899340698053<br /> metaslab_array: 520<br /> metaslab_shift: 33<br /> ashift: 12<br /> asize: 1000191557632<br /> is_log: 0<br /> create_txg: 422833<br /> children[0]:<br /> type: 'disk'<br /> id: 0<br /> guid: 15790186799979059305<br />
path: '/dev/dsk/c1t50014EE0AEABB8E7d0s0'<br /> devid: 'id1,sd@n50014ee0aeabb8e7/a'<br /> phys_path: '/scsi_vhci/disk@g50014ee0aeabb8e7:a'<br /> whole_disk: 1<br /> create_txg: 422833<br /> children[1]:<br /> type: 'disk'<br /> id: 1<br /> guid: 3033691275784652782<br /> path: '/dev/dsk/c1t50014EE0AEB44327d0s0'<br /> devid: 'id1,sd@n50014ee0aeb44327/a'<br /> phys_path: '/scsi_vhci/disk@g50014ee0aeb44327:a'<br /> whole_disk: 1<br /> create_txg: 422833<br /> features_for_read:<br /> com.delphix:hole_birth<br /> com.delphix:embedded_data<br /><br /><br />-----Original Message-----<br />From: Hanno Hirschberger [mailto:hannohirschberger@googlemail.com] <br />Sent: Wednesday, September 23, 2015 2:43 PM<br />To: omnios-discuss@lists.omniti.com<br />Subject: Re: [OmniOS-discuss] iSCSI
poor write performance<br /><br />Hi Martin,<br /><br />On 23.09.2015 10:51, Martin Truhlář wrote:<br /><blockquote class="gmail_quote" style="margin: 0pt 0pt 1ex 0.8ex; border-left: 1px solid #729fcf; padding-left: 1ex;"> Tests revealed, that problem is somewhere in disk array itself.<br /></blockquote><br />are you familiar with the ashift problem on 4k drives? My best guess would be that the 1 TB WD drives are emulating a block size of 512 bytes while using 4k sectors internally. OmniOS is using a ashift value of 9 then to align the data efficiently (on 512 byte sectors!). This slows the whole pool down - I had the same problem before. The ashift value has to be 12 on 4k drives!<br /><br />Try the command 'zdb' to gather the values for your drives. Look for<br />'ashift: 9' oder 'ashift: 12'.<br /><br />Regards,<br /><br />Hanno<br /><hr /><br />OmniOS-discuss mailing list<br />OmniOS-discuss@lists.omniti.com<br /><a
href="http://lists.omniti.com/mailman/listinfo/omnios-discuss">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a><br /><hr /><br />OmniOS-discuss mailing list<br />OmniOS-discuss@lists.omniti.com<br /><a href="http://lists.omniti.com/mailman/listinfo/omnios-discuss">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a><br /></pre></blockquote></div><br>
-- <br>
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
<br>
----
This mail was virus scanned and spam checked before delivery.
This mail is also DKIM signed. See header dkim-signature.
<br>
</body></html>