Web Development

Web site development tips & tricks

 tags  RSS

24.7.2022 14:06:39

A special file system structure made with intention of breaking bad bots

It is made in the way that causes the bot to browse recursive symlink structure slowing it down in the process where it's left preocuppied with that and that takes long enough before it can traverse the other content of the site. An example file structure is shown below, the directory containing such items must be excluded using robots.txt and link must not be shown to regular visitors and proper bots (hidden, witdth/height with value of 0, nofollow tag, etc)

description.txt  
files/description.txt  
files/misc/description.txt  
files/misc/readme.txt  
files/misc/test -> ../..
files/readme.txt  
readme.txt  
secret/description.txt  
secret/less/description.txt  
secret/less/readme.txt  
secret/less/stuff -> ../more
secret/more -> ..
secret/readme.txt  
secret/test.c  
secret/test.exe


reposted by raumfahrtagentur
 

Timeline speed: 1.00 posts per hour

 

You have reached the end...

THE END

login