wget

[Michael Cohen]

On Thu, Oct 12, 2006 at 11:08:48AM +0200, Raymond Orchison wrote:
> Hi All,
> 
> Does anyone know how to stop a wget from been run on an apache web
> server. I want to prevent remote users from sucking down my entire site.

Raymond,
  It depends why do you want to stop people from downloading your entire site?
  Is it because you dont want them to have it? or do you not want them to
  saturate your link?

  If its the former, then forget it - anything on the web is publically
  published. You cant stop people from crawling your site.

  If its the later, you can use throttling based on IP address, perhaps through
  a layer 7 switch or squid or qos routing rules. This will slow them down to
  an acceptable level so as to be fair to other users.

  Michael.