The DFSORT program can easily remove duplicate records from your file. This can either be done as a stand alone process where the file remains the same except for the removal of duplicate entries or it can be done in addition to any sort processing that is required.
To remove duplicate records all you need to do is to specify the following in your sort parameter records.
If this entry is the only sort parameter then the only action will be to remove duplicate records from the file. If sort parameters are also included then the sort will be performed first and then duplicate records will be dropped.
This article written by Stephen Chapman, Felgall Pty Ltd.