LinuxSA Mailing list archives

  From: Scott Frase <frases@hotmail.com>
  To  : <mega@konectanet.com.au>
        < linuxsa@linuxsa.org.au>
  Date: Tue, 30 Jan 2001 21:46:28

Re: diff and VERY BIG files

My experience with diff and big files is this.

In addition to having an appropriate amount of disk for any output files 
created by diff, you need to have at least 2.5 times as much free disk space 
available in /tmp as your original files to allow diff to execute properly.

2.5 * (file1 + file2)

For example, if you are diff'ing two 100MB file, you should have 500MB free 
in the filesystem that holds /tmp.

See if that helps.
scott

>From: "Vladimir V. Bashkirtsev" <mega@konectanet.com.au>
>To: "LinuxSA" <linuxsa@linuxsa.org.au>
>Subject: diff and VERY BIG files
>Date: Wed, 31 Jan 2001 00:58:08 +1030
>
>Hi all!
>
>I getting multigig gz archives with text files coming to system everyday.
>They almost the same but some lines removed, some added... I have BIG DB 
>and
>contents of DB must be sychronized with these files. Not good idea to check
>whole DB against newly arrived file everyday because it takes too long. So 
>I
>came to idea that using diff on these files and then importing these diffs
>to DB will work better. I skipped part of piping gunzip to diff and just
>tried to run diff on two big files. No matter what sort of options I pass 
>to
>diff but I get "diff: memory exhausted" all the time. Now I have workaround
>for my problem but it still interesting is there way to use diff on BIG
>files?
>
>Vladimir
>
>
>--
>LinuxSA WWW: http://www.linuxsa.org.au/  IRC: #linuxsa on irc.linux.org.au
>To unsubscribe from the LinuxSA list:
>   mail linuxsa-request@linuxsa.org.au with "unsubscribe" as the subject
>

_________________________________________________________________
Get your FREE download of MSN Explorer at http://explorer.msn.com

-- 
LinuxSA WWW: http://www.linuxsa.org.au/  IRC: #linuxsa on irc.linux.org.au
To unsubscribe from the LinuxSA list:
  mail linuxsa-request@linuxsa.org.au with "unsubscribe" as the subject