LinuxSA Mailing list archives

  From: Vladimir V. Bashkirtsev <mega@konectanet.com.au>
  To  : LinuxSA <linuxsa@linuxsa.org.au>
  Date: Wed, 31 Jan 2001 00:58:08 +1030

diff and VERY BIG files

Hi all!

I getting multigig gz archives with text files coming to system everyday.
They almost the same but some lines removed, some added... I have BIG DB and
contents of DB must be sychronized with these files. Not good idea to check
whole DB against newly arrived file everyday because it takes too long. So I
came to idea that using diff on these files and then importing these diffs
to DB will work better. I skipped part of piping gunzip to diff and just
tried to run diff on two big files. No matter what sort of options I pass to
diff but I get "diff: memory exhausted" all the time. Now I have workaround
for my problem but it still interesting is there way to use diff on BIG
files?

Vladimir


-- 
LinuxSA WWW: http://www.linuxsa.org.au/  IRC: #linuxsa on irc.linux.org.au
To unsubscribe from the LinuxSA list:
  mail linuxsa-request@linuxsa.org.au with "unsubscribe" as the subject