[perl-python] a program to delete duplicate files

[Terry Hancock]

On Thursday 10 March 2005 11:02 am, Christos "TZOTZIOY" Georgiou wrote:
> On Wed, 9 Mar 2005 16:13:20 -0600, rumours say that Terry Hancock
> <hancock at anansispaceworks.com> might have written:
> 
> >For anyone interested in responding to the above, a starting
> >place might be this maintenance script I wrote for my own use.  I don't
> >think it exactly matches the spec, but it addresses the problem.  I wrote
> >this to clean up a large tree of image files once.  The exact behavior
> >described requires the '--exec="ls %s"' option as mentioned in the help.
> 
> The drawback of this method is that you have to read everything.  For example,
> if you have ten files less than 100KiB each and one file more than 2 GiB in
> size, there is no need to read the 2 GiB file, is there?
> 
> If it's a one-shot attempt, I guess it won't mind a lot.
> 
> On POSIX filesystems, one has also to avoid comparing files having same (st_dev,
> st_inum), because you know that they are the same file.

Two good points, but hey, it ran fast enough for me.  ;-)

Cheers,
Terry

-- 
--
Terry Hancock ( hancock at anansispaceworks.com )
Anansi Spaceworks  http://www.anansispaceworks.com