Printer Friendly Version
Email this thread to a friend
|
MSN dropping pages out the index (In: MSN Search Engine)
Featured Web Site Template |
|
There are 0 guests and 2 members in the forums right now.
Reflects user activity within the last 5 minutes
|
|
| Member |
Message |
underthecovers
Joined: Nov 13, 2002
# Posts: 209
|
Posted: 2005-Apr-05 06:22
Hi
here is an extract from my logs
everything after the poker.htm is invalid
any ideas as to why MSN BOT is doing this
how do I trace the source ?
I can find no other user agents just the msn bot so no other bot or surfer is following these invalid URL's
Regards
Chris
65.54.188.149 - - [05/Apr/2005:12:41:01 +0930] "GET /poker.htm/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/bugs.htm HTTP/1.0" 200 13650 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)"
65.54.188.149 - - [05/Apr/2005:12:41:50 +0930] "GET /poker.htm/opp/opp/opp/opp/opp/opp/cgi-bin/opp/opp/opp/opp/opp/opp/opp/opp/opp/custcare.htm HTTP/1.0" 200 13666 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)"
65.54.188.149 - - [05/Apr/2005:12:41:55 +0930] "GET /poker.htm/opp/opp/opp/opp/opp/opp/cgi-bin/opp/opp/opp/opp/opp/opp/opp/opp/opp/howtoplay.htm HTTP/1.0" 200 13667 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)"
65.54.188.149 - - [05/Apr/2005:12:41:58 +0930] "GET /poker.htm/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/bugs.htm HTTP/1.0" 200 13646 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)"
65.54.188.149 - - [05/Apr/2005:12:42:02 +0930] "GET /poker.htm/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/custcare.htm HTTP/1.0" 200 13650 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)"
65.54.188.149 - - [05/Apr/2005:12:45:03 +0930] "GET /poker.htm/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/opp/howtoplay.htm HTTP/1.0" 200 13651 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)"
|
 |
OAC
Staff
Joined: Jan 25, 2001
# Posts: 6805
|
Posted: 2005-Apr-05 07:28
Wow - I have never seen anything like that. And each log record mentions 2 pages.
|
|
underthecovers
Joined: Nov 13, 2002
# Posts: 209
|
Posted: 2005-Apr-07 01:07
It seems no one else has either.
I must admit to being impressed with MSN's response
within 2 hours they got back to me requesting more info, and then again to say they will continue the search today.
I believe their database has some bad entries in it but because all the above urls actually resolve to a valid page they are not flushed from the database
The bot does not show where the page was linked from so I am unable to resolve the source, I'll just have to wait and see what they come up with
|
|
OAC
Staff
Joined: Jan 25, 2001
# Posts: 6805
|
Posted: 2005-Apr-07 06:12
Excellent that they responded so quickly. Please let us know the outcome because it's got me stumped.
|
|
You are not permitted to post messages in this forum or topic, because of one or more of the following reasons:
- You have not yet logged in, or registered properly as a member
- You are a member, but no longer have posting rights.
- This is a private forum, for which you do not have permissions.
If you are a recent member, it's possible that you simply have not yet confirmed your account. Please
check your email for a message entitled 'JimWorld Forums: Confirm Your Account' and follow the instructions
contained within.
If you cannot find this message, click here to Re-Send it.
|
If you are still experiencing problem, please read the
Login Assistance
Article for some advice on what may be causing your login not to work properly.
|
Switch to Advanced Editor and ...
Create a New Topic
or Reply to this Thread
|
|
Inbox
