I have used gawk for similar applications. Since it processes files
sequentially, it can handle very large files. The only significant limits
are the speed of processing and, if the gawk script needs to maintain large
amounts of information in memory, the available memory.

But, to give you specific advice, I'd need more information:

1) What is the form of the file names?
2) What is the output: One long file, or is there one output file per input
file?
2a) If the output is one long file, do the input files need to be processed
in a particular order? What is that order?
3) What is the internal structure of the input files?
4) What type of transformation is required?

--Albert

Albert Bickford

----- Original Message -----





This message has been scanned for viruses by the VEI Internet
Automatic Email Spam and Virus Scanner, and is believed to be free of spam or
viruses.
Please report spam to spamtrap@.... If you would like 98.9 % spam blocked
from your
E-mail then go to VEI Internet for details. Anti-spam/Anti-virus is FREE with
every account.


http://www.vei.net/
mailtospamtrap@...

[Non-text portions of this message have been removed]