<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman",serif;
        color:black;}
a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:#0563C1;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {mso-style-priority:99;
        color:#954F72;
        text-decoration:underline;}
tt
        {mso-style-priority:99;
        font-family:"Courier New";}
p.msonormal0, li.msonormal0, div.msonormal0
        {mso-style-name:msonormal;
        mso-margin-top-alt:auto;
        margin-right:0in;
        mso-margin-bottom-alt:auto;
        margin-left:0in;
        font-size:12.0pt;
        font-family:"Times New Roman",serif;
        color:black;}
span.EmailStyle19
        {mso-style-type:personal-reply;
        font-family:"Calibri",sans-serif;
        color:windowtext;}
.MsoChpDefault
        {mso-style-type:export-only;
        font-size:10.0pt;}
@page WordSection1
        {size:8.5in 11.0in;
        margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
        {page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="white" lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">Yes, this issue has been lurking around since they made the arcs compressible. I really wish they would revert that change. There have been at least 3 illumos
 issues filed for this and two fixes attempted. So far it still persist. For now I have my cache drives removed from my production pools.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext"> OmniOS-discuss [mailto:omnios-discuss-bounces@lists.omniti.com]
<b>On Behalf Of </b>Richard Skelton<br>
<b>Sent:</b> Friday, September 1, 2017 6:04 PM<br>
<b>To:</b> omniOS-discuss <omnios-discuss@lists.omniti.com><br>
<b>Subject:</b> [OmniOS-discuss] ZFS cache device allocation a free seem strange on my OmniOS r151022 system.<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><tt><span style="font-size:10.0pt">Hi,</span></tt><span style="font-size:10.0pt;font-family:"Courier New""><br>
<tt>The cache allocation a free seem strange on my OmniOS r151022 system.</tt><br>
<tt>The cache device is an Intel SSD DC P3700 Series 800GB, 1/2 Height PCIe 3.0, 20nm, MLC</tt><br>
<tt>root@omnios:/scratch# zpool list -v scratch</tt><br>
<tt>NAME                         SIZE  ALLOC   FREE  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT</tt><br>
<tt>scratch                     2.66T  1.94T   738G         -    17%    72%  1.00x  ONLINE  -</tt><br>
<tt>  mirror                     544G   395G   149G         -    16%    72%</tt><br>
<tt>    c7t5000CCA018309809d0       -      -      -         -      -      -</tt><br>
<tt>    c18t5000CCA038718395d0      -      -      -         -      -      -</tt><br>
<tt>  mirror                     544G   396G   148G         -    15%    72%</tt><br>
<tt>    c14t5000CCA038710745d0      -      -      -         -      -      -</tt><br>
<tt>    c11t5000CCA038721F5Dd0      -      -      -         -      -      -</tt><br>
<tt>  mirror                     544G   396G   148G         -    18%    72%</tt><br>
<tt>    c12t5000CCA03871048Dd0      -      -      -         -      -      -</tt><br>
<tt>    c13t5000CCA0387102E1d0      -      -      -         -      -      -</tt><br>
<tt>  mirror                     544G   398G   146G         -    19%    73%</tt><br>
<tt>    c15t5000CCA03871058Dd0      -      -      -         -      -      -</tt><br>
<tt>    c16t5000CCA0387224EDd0      -      -      -         -      -      -</tt><br>
<tt>  mirror                     544G   396G   148G         -    17%    72%</tt><br>
<tt>    c17t5000CCA038717F65d0      -      -      -         -      -      -</tt><br>
<tt>    c10t5000CCA038717AC9d0      -      -      -         -      -      -</tt><br>
<tt>log                             -      -      -         -      -      -</tt><br>
<tt>  c6t0d0                    3.84G      0  3.84G         -     0%     0%</tt><br>
<tt>cache                           -      -      -         -      -      -</tt><br>
<tt>  c3t1d0                     745G  <b>1.07T  16.0E         -     0%   147%</b></tt><br>
<tt>spare                           -      -      -         -      -      -</tt><br>
<tt>  c9t5000CCA038717B2Dd0         -      -      -         -      -      -</tt><br>
<tt>  c8t5000CCA0387104B1d0         -      -      -         -      -      -</tt><br>
<tt>root@omnios:/scratch# format </dev/null</tt><br>
<tt>Searching for disks...done</tt><br>
<br>
<br>
<tt>AVAILABLE DISK SELECTIONS:</tt><br>
<tt>       0. c2t4d0 <Samsung-SSD 850 PRO 256GB-EXM02B6Q-238.47GB></tt><br>
<tt>          /pci@0,0/pci8086,35c5@1f,2/disk@4,0</tt><br>
<tt>       1. c2t5d0 <Samsung-SSD 850 PRO 256GB-EXM02B6Q-238.47GB></tt><br>
<tt>          /pci@0,0/pci8086,35c5@1f,2/disk@5,0</tt><br>
<tt>       2. c3t1d0 <INTEL-SSDPEDMD800G4-8DV10171-745.21GB></tt><br>
<tt>          /pci@75,0/pci8086,6f0a@3,2/pci8086,3702@0/blkdev@1,0</tt><br>
<tt>       3. c6t0d0 <DDRDRIVE-X1-0078-3.87GB></tt><br>
<tt>          /pci@75,0/pci8086,6f06@2,2/pci19e3,81@0/sd@0,0</tt><br>
<br>
<br>
<tt>Cheers</tt><br>
<tt>Richard</tt></span><o:p></o:p></p>
</div>
</body>
</html>