Perl or Suprtool can do this easily.  You could probably do it with SORT
and some CI stuff, but that would probably be my least favorite choice (and
probably the least efficient).  Surptool would be the best choice (because
it has a built-in function to do just this).

John Testa
SLPS Homewood
708-647-4346
[log in to unmask]



                      Nigel Skeet
                      <[log in to unmask]        To:       [log in to unmask]
                      OM>                      cc:
                      Sent by: HP-3000         Subject:  [HP3000-L] Removing duplicate lines from file
                      Systems
                      Discussion
                      <[log in to unmask]
                      TC.EDU>


                      11/02/2004 05:58
                      AM
                      Please respond to
                      Nigel Skeet






Hi all,

Brain isn't in gear today. What's the easiest way of removing duplicate
lines from a standard ASCII file ? File is sorted but looks like.

Line 1
Line 1
Line 2
Line 3
Line 4
Line 4

etc..... But I want to remove any duplicate lines.

Can't think this morning unless I knock something up in JCL to read the
input of each line then read the next line compare the 2 and if different
post to another file....

TIA

Nige...

* To join/leave the list, search archives, change list settings, *
* etc., please visit http://raven.utc.edu/archives/hp3000-l.html *

* To join/leave the list, search archives, change list settings, *
* etc., please visit http://raven.utc.edu/archives/hp3000-l.html *