HP3000-L Archives

November 2004, Week 1

HP3000-L@RAVEN.UTC.EDU
Options: Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
Re: Removing duplicate lines from file
From:
Lars Appel <[log in to unmask]>
Reply To:
Lars Appel <[log in to unmask]>
Date:
Tue, 2 Nov 2004 21:30:30 +0100
Content-Type:
text/plain
Parts/Attachments:
text/plain (18 lines) 
Nigel,

I typically use something like /bin/sort with the -u option:

  :xeq /bin/sort -u < OLDFILE > NEWFILE

If the file is already sorted, /bin/uniq might be sufficient.

Notice that the Posix tools seem to run faster when the input
file is a bytestream file, so that the file system layer does
not have to add the bytestream emulation layer. So it might
help to use /bin/tobyte -at before the sort or uniq invocation.

Lars.

* To join/leave the list, search archives, change list settings, *
* etc., please visit http://raven.utc.edu/archives/hp3000-l.html *

ATOM RSS1 RSS2