HP3000-L Archives

July 2002, Week 2

HP3000-L@RAVEN.UTC.EDU
Options: Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
Re: Deduping files (wait a minute)
From:
Jeff Woods <[log in to unmask]>
Reply To:
Jeff Woods <[log in to unmask]>
Date:
Sat, 13 Jul 2002 11:48:06 -0700
Content-Type:
text/plain
Parts/Attachments:
text/plain (26 lines) 
At  02:42 PM 7/12/2002, Jeff Kell wrote:
>If you just want to remove the duplicates, it's easier:
>
>shell/ix> cat OLDFILE NEWFILE|sort|uniq>NODUPE

Since sort can take a list of files to sort as arguments, that's a wasted
use of cat.  And sort also has the -u option which removes duplicate keys,
so that's a wasted use of uniq; use:

sort -u FILE [FILE2 ...] >NODUPE

>You can specify keys for both sort and uniq, and you can trim out the keys
>beforehand with cut (among others).

The flexibility of sort, uniq, cut, grep, find, sed, and similar tools is a
big part of what makes the unix shells so powerful.

--
Jeff Woods
[log in to unmask]
[log in to unmask]
Quintessential School Systems

* To join/leave the list, search archives, change list settings, *
* etc., please visit http://raven.utc.edu/archives/hp3000-l.html *

ATOM RSS1 RSS2