<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">2016-03-05 0:01 GMT+08:00 Freddie Cash <span dir="ltr"><<a href="mailto:fjwcash@gmail.com" target="_blank">fjwcash@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><p dir="ltr"><span>On Mar 4, 2016 2:05 AM, "Fred Liu" <<a href="mailto:fred.fliu@gmail.com" target="_blank">fred.fliu@gmail.com</a>> wrote:<br>> 2016-03-04 13:47 GMT+08:00 Freddie Cash <<a href="mailto:fjwcash@gmail.com" target="_blank">fjwcash@gmail.com</a>>:<br>
>><br>
>> Currently, I just use a simple coordinate system. Columns are letters, rows are numbers.<br>
>></span><span class="" style="white-space:pre"> </span>"<a href="mailto:smartos-discuss@lists.smartos.org">smartos-discuss@lists.smartos.org</a>" <<a href="mailto:smartos-discuss@lists.smartos.org">smartos-discuss@lists.smartos.org</a>>、</p><p dir="ltr">developer <<a href="mailto:developer@open-zfs.org">developer@open-zfs.org</a>>、</p><p dir="ltr">illumos-developer <<a href="mailto:developer@lists.illumos.org">developer@lists.illumos.org</a>>、</p><p dir="ltr">omnios-discuss <<a href="mailto:omnios-discuss@lists.omniti.com">omnios-discuss@lists.omniti.com</a>>、</p><p dir="ltr">Discussion list for OpenIndiana <<a href="mailto:openindiana-discuss@openindiana.org">openindiana-discuss@openindiana.org</a>>、</p><p dir="ltr">illumos-zfs <<a href="mailto:zfs@lists.illumos.org">zfs@lists.illumos.org</a>>、</p><p dir="ltr">"<a href="mailto:zfs-discuss@list.zfsonlinux.org">zfs-discuss@list.zfsonlinux.org</a>" <<a href="mailto:zfs-discuss@list.zfsonlinux.org">zfs-discuss@list.zfsonlinux.org</a>>、</p><p dir="ltr">"freebsd-fs@FreeBSD.org" <<a href="mailto:freebsd-fs@freebsd.org">freebsd-fs@freebsd.org</a>>、</p><p dir="ltr">"<a href="mailto:zfs-devel@freebsd.org">zfs-devel@freebsd.org</a>" <<a href="mailto:zfs-devel@freebsd.org">zfs-devel@freebsd.org</a>></p><p dir="ltr"><span>
>> Each disk is partitioned using GPT with the first (only) partition starting at 1 MB and covering the whole disk, and labelled with the column/row where it is located (disk-a1, disk-g6, disk-p3, etc).<br>
><br>
> [Fred]: So you manually pull off all the drives one by one to locate them? <br><br></span></p><p dir="ltr"></p><div style="font-family:'courier new',monospace;display:inline">When putting the system together for the first time, I insert each disk one at a time, wait for it to be detected, partition it, then label it based on physical location. Then do the next one. It's just part of the normal server build process, whether it has 2 drives, 20 drives, or 200 drives.</div><br><p></p><p dir="ltr"></p><div style="font-family:'courier new',monospace;display:inline">We build all our own servers from off-the-shelf parts; we don't buy anything pre-built from any of the large OEMs.</div></div></blockquote><div><br></div><div>[Fred]: Gotcha!</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><p></p><p dir="ltr"><span>>> The pool is created using the GPT labels, so the label shows in "zpool list" output.<br>
><br>
> [Fred]: What will the output look like? <br><br></span></p><div style="font-family:'courier new',monospace;display:inline">From our smaller backups server, with just 24 drive bays:</div><p></p><p dir="ltr"><font face="courier new, monospace">$ zpool status storage</font></p><div style="display:inline"><p dir="ltr"><font face="courier new, monospace"> pool: storage</font></p><p dir="ltr"><font face="courier new, monospace"> state: ONLINE</font></p><p dir="ltr"><font face="courier new, monospace">status: Some supported features are not enabled on the pool. The pool can</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>still be used, but some features are unavailable.</font></p><p dir="ltr"><font face="courier new, monospace">action: Enable all features using 'zpool upgrade'. Once this is done,</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>the pool may no longer be accessible by software that does not support</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>the features. See zpool-features(7) for details.</font></p><p dir="ltr"><font face="courier new, monospace"> scan: scrub canceled on Wed Feb 17 12:02:20 2016</font></p><p dir="ltr"><font face="courier new, monospace">config:</font></p><p dir="ltr"><font face="courier new, monospace"><br></font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>NAME STATE READ WRITE CKSUM</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>storage ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> raidz2-0 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a2 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a3 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a4 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a5 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a6 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> raidz2-1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b2 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b3 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b4 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b5 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b6 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> raidz2-2 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c2 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c3 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c4 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c5 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c6 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> raidz2-3 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d2 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d3 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d4 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d5 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d6 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>cache</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/cache0 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/cache1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><br></font></p><p dir="ltr"><font face="courier new, monospace">errors: No known data errors</font></p><div><br></div><div>The 90-bay systems look the same, just that the letters go all the way to p (so disk-p1 through disk-p6). And there's one vdev that uses 3 drives from each chassis (7x 6-disk vdev only uses 42 drives of the 45-bay chassis, so there's lots of spares if using a single chassis; using two chassis, there's enough drives to add an extra 6-disk vdev).</div></div></div></blockquote><div><br></div><div>[Fred]: It looks like the gpt label shown in "zpool status" only works in FreeBSD/FreeNAS. Are you using FreeBSD/FreeNAS? I can't find the similar possibilities in Illumos/Linux.</div><div><br></div><div>Thanks,</div><div><br></div><div>Fred </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div style="display:inline"><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p></div><p dir="ltr"></p><br><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p></div><div bgcolor="#ffffff" style="width:auto;margin:0px;padding:5px;clear:both;border-top-width:1px;border-top-style:solid;border-top-color:rgb(204,204,204);background-color:rgb(255,255,255)"><table bgcolor="#ffffff" border="0" cellpadding="0" cellspacing="0" style="background-color:rgb(255,255,255)" width="100%"><tbody><tr><td><font color="#333333" size="1" style="font-family:helvetica,sans-serif">
<strong>illumos-zfs</strong> | <a href="https://www.listbox.com/member/archive/182191/=now" style="text-decoration:none;color:rgb(102,153,51);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(68,68,68)" title="Go to archives for illumos-zfs" target="_blank">Archives</a>
<a border="0" href="https://www.listbox.com/member/archive/rss/182191/22147814-d504851f" style="text-decoration:none;color:rgb(102,153,51)" title="RSS feed for illumos-zfs" target="_blank"><img border="0" src="http://postlink.www.listbox.com/2073738/833487e62783d55fe81f119fb93ef644/22147814/cdaed36a.jpg?uri=aHR0cHM6Ly93d3cubGlzdGJveC5jb20vaW1hZ2VzL2ZlZWQtaWNvbi0xMHgxMC5qcGc"></a>
| <a href="https://www.listbox.com/member/?member_id=22147814&id_secret=22147814-a72bcb8a" style="text-decoration:none;color:rgb(102,153,51);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(68,68,68)" title="" target="_blank">Modify</a>
Your Subscription</font></td><td align="right" valign="top"><a href="http://www.listbox.com" style="border-bottom-style:none" target="_blank">
<img border="0" src="http://postlink.www.listbox.com/2073739/3379085af0f1cf7fc3708f04b4471ae2/22147814/cdaed36a.png?uri=aHR0cHM6Ly93d3cubGlzdGJveC5jb20vaW1hZ2VzL2xpc3Rib3gtbG9nby1zbWFsbC5wbmc" title="Powered by Listbox"></a></td></tr></tbody></table></div></blockquote></div><br></div></div>