Printer Friendly Version
Email this thread to a friend
|
Featured Web Site Template |
|
Reflects user activity within the last 5 minutes
|
|
| Member |
Message |
moroz
Joined: Oct 30, 2008
# Posts: 3
|
Posted: 2008-Oct-31 03:59
i've spent some time searching a solution to the following problem, but i'm still unsure how to correct the situation (any help would be appreciated):
a yahoo search lists my site as mysite.com/index.html while google lists it as mysite.com/
my root file is index.html file, with all subdirectories containing an index.html file as well.
how do i get the yahoo listing (as well as any other search directories to list my site without the trailing index.html?
i've experimented with the robots.txt file but can't seem to get the desired result, and read a bit about .htaccess files, but i'm not sure if that would do the trick either.
using google's "Analyze robots.txt" tool i've tried the following:
User-agent: *
Disallow: /*index*.html
no luck. any file name other than index seems to work with the above settings. is it even possible to block access to mysite.com/index.html without blocking access to mysite.com/ ?
someone please point me in the right direction.
anyone have any idea why yahoo seems to be the only search engine causing me this problem?
|
 |
g1smd
Staff
Joined: Jul 28, 2002
# Posts: 10465
|
Posted: 2008-Oct-31 10:13
In your .htaccess file:
|
|
mj1256
Staff
Joined: Jun 05, 2006
# Posts: 983
|
Posted: 2008-Oct-31 14:30
I may be missing something here, but what is the negative effect from this?
also
Check all of your links on your site and make sure there is not one with the index.html on it.
|
|
g1smd
Staff
Joined: Jul 28, 2002
# Posts: 10465
|
Posted: 2008-Oct-31 20:29
Simply, / and /index.html are two different URLs for the same content.
|
|
mj1256
Staff
Joined: Jun 05, 2006
# Posts: 983
|
Posted: 2008-Oct-31 23:38
that i knew, so it runs a duplication risk
|
|
moroz
Joined: Oct 30, 2008
# Posts: 3
|
Posted: 2008-Nov-01 18:10
thank you for your reply g1smd. will the htaccess code you provided prevent yahoo from indexing the /index.html version of my homepage? i'm new to this and have never manipulated an htaccess file before. i'd like to understand what is going on in the code so i can figure out how it works and what it does exactly. is there anywhere you can recommend that will provide an introduction adequate to help me understand/decipher what is going on in your coding?
any idea why yahoo chooses to index that page as opposed to the / version that google and others seem to do?
i imagine that since many sites make use of an index.html file as the primary html file in their root directory this issue must be common, but i haven't been able to find much information on the matter, which leads me to believe that maybe i'm doing something which is specifically causing this. if it's a design or structural issue, i'd happily fix it - as i said, i'm new to this. any thoughts?
and thank you again for your help.
|
|
g1smd
Staff
Joined: Jul 28, 2002
# Posts: 10465
|
Posted: 2008-Nov-01 19:17
They choose it because someone somewhere links to that version, and they just followed the link.
The redirect works for several names. See the # comment line above the code.
|
|
moroz
Joined: Oct 30, 2008
# Posts: 3
|
Posted: 2008-Nov-01 19:50
so all i have to do is replace the "www.example.com" with the url for my site and i'll be set?
|
|
g1smd
Staff
Joined: Jul 28, 2002
# Posts: 10465
|
Posted: 2008-Nov-01 19:58
Yep.
Also change the ¦ pipe ¦ symbol to be the real pipe symbol (the real one will not show up in the forum).
|
|
You are not permitted to post messages in this forum or topic, because of one or more of the following reasons:
- You have not yet logged in, or registered properly as a member
- You are a member, but no longer have posting rights.
- This is a private forum, for which you do not have permissions.
If you are a recent member, it's possible that you simply have not yet confirmed your account. Please
check your email for a message entitled 'JimWorld Forums: Confirm Your Account' and follow the instructions
contained within.
If you cannot find this message, click here to Re-Send it.
|
If you are still experiencing problem, please read the
Login Assistance
Article for some advice on what may be causing your login not to work properly.
|
Switch to Advanced Editor and ...
Create a New Topic
or Reply to this Thread
|
|
Inbox
