<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style></style></head><body lang=EN-GB link=blue vlink=purple><div class=WordSection1><o:p> </o:p><o:p> </o:p><div style='border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt'><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'>From: Chavdar Ivanov [mailto:ci4@outlook.com] Sent: 13 November 2013 16:15 To: 'Peter Tribble'; 'Tobias Oetiker' Cc: omnios-discuss@lists.omniti.com Subject: RE: [OmniOS-discuss] zfs and small files<o:p></o:p></div></div><o:p> </o:p><o:p> </o:p><o:p> </o:p><div style='border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt'><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'>From: OmniOS-discuss [<a href="mailto:omnios-discuss-bounces@lists.omniti.com">mailto:omnios-discuss-bounces@lists.omniti.com</a>] On Behalf Of Peter Tribble Sent: 13 November 2013 15:36 To: Tobias Oetiker Cc: <a href="mailto:omnios-discuss@lists.omniti.com">omnios-discuss@lists.omniti.com</a> Subject: Re: [OmniOS-discuss] zfs and small files<o:p></o:p></div></div><o:p> </o:p><div><div><div>On Wed, Nov 13, 2013 at 2:46 PM, Tobias Oetiker <<a href="mailto:tobi@oetiker.ch" target="_blank">tobi@oetiker.ch</a>> wrote:<o:p></o:p><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt'>Hi Peter, Today Peter Tribble wrote: > On Wed, Nov 13, 2013 at 1:59 PM, Tobias Oetiker <<a href="mailto:tobi@oetiker.ch">tobi@oetiker.ch</a>> wrote: > > > We have this customer who loves to put tons of files into single > > directories. The other day he found that removing a directory with > > 7k files from raidz2 pool (with ssd log device) took about 10 > > minutes ... > > > > is this to be expected, or should this be faster on a properly > > configured system ? > > > > That's a tiny number of files. Ought to be essentially instant. > I routinely have up to a million files in a directory. That can take > a few minutes to delete, but I don't have any SSDs at all on > those systems. > > This isn't being done over NFS, is it? That can dramatically slow > operations like this, even with a log. nope it is local ... are you running this on raidz2 ?<o:p></o:p></blockquote><div><o:p> </o:p></div><div>Yes. On old X4540s. Deletion of a directory with 7k files in it<o:p></o:p></div><div>takes about 0.3s<o:p></o:p>[ci] <o:p></o:p>It will take about 0.3s IIF you have snapshots of the ZFS. It will take looooong time if this is the only snapshot of the system. <o:p></o:p><o:p> </o:p>Chavdar<o:p></o:p>[ci] <o:p></o:p>(my usual “method” of deleting many files on a system without a snapshot is to create one, delete them as required, then remove the snapshot at a convenient time – at the end of the day or so… <o:p></o:p>CI<o:p></o:p><o:p> </o:p></div><div> <o:p></o:p></div></div>-- -Peter Tribble <a href="http://www.petertribble.co.uk/">http://www.petertribble.co.uk/</a> - <a href="http://ptribble.blogspot.com/">http://ptribble.blogspot.com/</a> <o:p></o:p></div></div></div></div></div></body></html>