PDA

View Full Version : reading your logs


KennyZ
12-04-2006, 02:43 PM
Ok, so this is probably really bad... Ive been doing/learning SEO for this company for
about a year now and I have never looked at a log before... in my life.

Well, today I opened one up and saw the reason why I have never looked at one before...
I cant tell what I am looking at!!

How can you tell when your page is spidered and by who???
_________________________________________________________________


Free bets (http://www.betbonus.co.uk)
Famous quotes (http://famous-quotes.ws)

Twey
12-04-2006, 05:40 PM
Log file formats vary from system to system (and webserver to webserver), but for each entry you should see a user-agent string, such as:Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko)Legitimate bots tend to have very obvious user-agent strings, such as:Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/)