Printer Friendly Version Print this thread
Email this thread to a friend eMail this thread to a friend
  • page rank 3 and page rank 5 for sale (In: I Want to Sell My Website)
  • Redirection of a page (In: Coding & Databases - PHP, ASP, Perl, etc.)
  • Featured Web Site Template

    Hundreds More at Free Site Templates.com!

    Web Site Partners
    Sponsored Links
    Jet City Software
     
    Whos Here ?
    Reflects user activity within the last 5 minutes
    Moderator(s): g1smd, Logan
    Forum Index · Search Engine Forums · Optimizing Your Website for the Search Engines · Google · How much of a page does Googlebot crawl?
    Member Message

    Cheery Ragdoll
    Joined: Oct 30, 2003
    # Posts: 79

    View the profile for Cheery Ragdoll Send Cheery Ragdoll a private message

    Posted: 2003-Oct-31 03:20
    Edit Message Delete Message Reply to this message

    Hi,

    I was just wondering if Googlebot crawls the whole page or if it stops after a certain number of bytes?

    If it does stop crawling after a certain number of bytes (say 40,000) if I have an image at the top of my page that is 40,000 bytes in file size, will Google on ly use that useless information in my ranking and not use any of my keywords in text below?

    Any info would be appreciated.

    Cheers!smile



    atozcom
    Joined: Eons Ago
    # Posts: 544

    View the profile for atozcom Send atozcom a private message

    Posted: 2003-Oct-31 03:30
    Edit Message Delete Message Reply to this message

    It suppose to crawl the entire page. Anyway, it suppose to...

    Google would have no idea and do not determine if any information is useless or not. Useful or Useless info is not part of the Google algorithsm. It determines if your text is relevant to the keyword search.

    The "weight" of text, whatever it is, decreases as it locate further down on the page.



    Forever
    Joined: Jun 05, 2002
    # Posts: 143

    View the profile for Forever Send Forever a private message

    Posted: 2003-Oct-31 03:54
    Edit Message Delete Message Reply to this message

    Actually I believe I read somewhere, maybe even on google itself, about it reading the first 100k. Or it may have been pointing to that that, about pages not being more than 100k. Either way, 100k



    Cheery Ragdoll
    Joined: Oct 30, 2003
    # Posts: 79

    View the profile for Cheery Ragdoll Send Cheery Ragdoll a private message

    Posted: 2003-Oct-31 03:57
    Edit Message Delete Message Reply to this message

    Thats what I thought, Forever. If it only reads a certain amount of the page, then those with large images at the top will not get a good ranking even though they may have great keyword density and relevancy, along with great link popularity. But all of that is not helpful since the Googlebot may not reach it all to get that info.

    i am just trying to figure out if this is the case.



    Forever
    Joined: Jun 05, 2002
    # Posts: 143

    View the profile for Forever Send Forever a private message

    Posted: 2003-Oct-31 04:00
    Edit Message Delete Message Reply to this message

    I might be incorrect here, but I dont think images count, as the crawler looks at it strictly text based. If you have large images anyway, you should find a way to reduce the size, ulead photo imact is great for this, we use this for all our pictures, and they dont affect the image quality at all.



    Cheery Ragdoll
    Joined: Oct 30, 2003
    # Posts: 79

    View the profile for Cheery Ragdoll Send Cheery Ragdoll a private message

    Posted: 2003-Oct-31 04:03
    Edit Message Delete Message Reply to this message

    I actually thnk you might be right about it only crawling text, Forever.

    One other question, do you know what the optimum keyword density should roughly be?




    Forever
    Joined: Jun 05, 2002
    # Posts: 143

    View the profile for Forever Send Forever a private message

    Posted: 2003-Oct-31 04:04
    Edit Message Delete Message Reply to this message

    Honestly, I have seen it different for differ keywords. I would do a dendity check on say top 10 in the keywords you are looking for and find a nice happy medium.



    chad
    Joined: Nov 20, 2003
    # Posts: 199

    View the profile for chad Send chad a private message

    Posted: 2003-Oct-31 10:55
    Edit Message Delete Message Reply to this message

    Well I have a few sites some with ridiculously sized pages like 300-500Kb & 500+ links (NOT including images obviously, just html) and they all seem to get crawled without any probs and the pages linked from them do too. So listening to other people saying about 100kb pages being the maximum, i guess i must just be lucky!



    JustMe
    Joined: Oct 30, 2003
    # Posts: 12

    View the profile for JustMe Send JustMe a private message

    Posted: 2003-Oct-31 15:55
    Edit Message Delete Message Reply to this message

    Search for your pages on Google and
    you will notice that it mentiones
    page size as about 100k...rest is
    ignored...



    Mike-Levin.com
    Joined: Sep 27, 2000
    # Posts: 1988

    View the profile for Mike-Levin.com Send Mike-Levin.com a private message

    Posted: 2003-Nov-24 04:01
    Edit Message Delete Message Reply to this message

    I just ran an experiment. Google cut off at 102,507 bytes. It's a nice measure to keep their spider speedy and limit link lists.

    This means if you're keeping bookmarks or link lists, you should limit it to about 250 links. That is a VERY ROUGH estimate. It will vary based on content.



    g1smd
    Staff
    Joined: Jul 28, 2002
    # Posts: 10465

    View the profile for g1smd Send g1smd a private message

    Posted: 2003-Nov-24 19:30
    Edit Message Delete Message Reply to this message

    >> If it does stop crawling after a certain number of bytes (say 40,000) if I have an image at the top of my page that is 40,000 bytes in file size, will Google on ly use that useless information in my ranking and not use any of my keywords in text below? <<

    Images are in separate files so would not be crawled. It therefore makes sense to also get all your CSS and javascript out into external files too.



    Cheery Ragdoll
    Joined: Oct 30, 2003
    # Posts: 79

    View the profile for Cheery Ragdoll Send Cheery Ragdoll a private message

    Posted: 2003-Nov-25 03:04
    Edit Message Delete Message Reply to this message

    Thanks g1smd! You have just hit the nail on the head for me! I have been looking at the page as a whole, not just the .html file which is all they spider. Everything is so much clearer now (As it should have been ages ago, heheheh).

    And thankyou everyone else!:D



    Cheery Ragdoll
    Joined: Oct 30, 2003
    # Posts: 79

    View the profile for Cheery Ragdoll Send Cheery Ragdoll a private message

    Posted: 2003-Nov-25 03:12
    Edit Message Delete Message Reply to this message

    Actually, would any of you guys be able to have a look at my website (see profile) and let me know how I have gone in terms of optimizing it? I dont have any links coming from outside of my site, but I am working on it.

    Any thoughts?

    If it was not appropriate to ask this question in this thread, I apologize.

    Cheers smile



    HORSE
    Joined: Mar 04, 2002
    # Posts: 72

    View the profile for HORSE Send HORSE a private message

    Posted: 2003-Dec-05 19:02
    Edit Message Delete Message Reply to this message

    Hi Cheery Ragdoll
    one thing for sure, the spider will have to stop sometime. But it can be for any reason. It has a set amount of algo to read, the spider could stop because of broken code, link etc...
    If you want the whole page to be spidered, it good but make all the most important keywords, terms at the first paragraph and add some relevant search terms at the bottom but dont have too high hopes.

    I have a basic search term that only a few aim for then i have not added a space between words so when you type in lochalshhotels my site is no1 and the search term is at the bottom of page.
    i also come up for 'edinburghhotels' in google at no 18 at that is a 49k page and the search term is at the bottom of page.

    Hope my reply helps and no confuse you!


    Forum Index · Search Engine Forums · Optimizing Your Website for the Search Engines · Google · How much of a page does Googlebot crawl?
    You are not permitted to post messages in this forum or topic, because of one or more of the following reasons:
    1. You have not yet logged in, or registered properly as a member
    2. You are a member, but no longer have posting rights.
    3. This is a private forum, for which you do not have permissions.

    If you are a recent member, it's possible that you simply have not yet confirmed your account. Please check your email for a message entitled 'JimWorld Forums: Confirm Your Account' and follow the instructions contained within.

    If you cannot find this message, click here to Re-Send it.

    If you are still experiencing problem, please read the Login Assistance Article for some advice on what may be causing your login not to work properly.

    Switch to Advanced Editor and ... Create a New Topic or Reply to this Thread

    New posts Forum is locked
    © 1995  ·  iWeb, Inc  ·  DBA JimWorld Productions