SitePoint Sponsor

User Tag List

Results 1 to 17 of 17
  1. #1
    SitePoint Addict drbones's Avatar
    Join Date
    Nov 2001
    Posts
    313
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    When is the next spider for google?

    Anybody know when google is supposed to spider next? I really want to see if my page ranking has gone up at all!
    Thanks
    Ryan
    *WRITERS* Create How To Guides and articles and get
    75% of the MONEY it makes via Adsense forever!

    Sign up Now! <- $100 Top Poster Contest

  2. #2
    SitePoint Wizard iTec's Avatar
    Join Date
    May 2001
    Location
    Sydney, Australia
    Posts
    2,243
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    from memory it should be within about the next week, starts on something like the 28th from memory

  3. #3
    Not a post-script error?!! guysmy's Avatar
    Join Date
    Sep 2001
    Location
    Underneath the Earth w/ Krom (Canada)
    Posts
    787
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    I've been waiting for Google to spider my site. You now have to submit to them through Dmoz...
    Why the change?

    My .com has been around for over a month and it seems like it's taking forever to get spidered.

    Most of my traffic is coming from msn...

    With only a few hits from looksmart, aol, netscape, and altavista. <----Strange --what's the deal with that??

    Hopefully traffic will pick up one day.

  4. #4
    Level 8 Chinese guy Archbob's Avatar
    Join Date
    Sep 2001
    Location
    Somewhere in this vast universe
    Posts
    3,741
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    ABout like 2 weeks they update once, me thinks.

  5. #5
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    you don't have to submit to google via DMOZ.

    http://www.google.com/addurl.html

    Google usually updates once a month, at the beginning of the month they will spider you, and then they will publish that information when they spider you next.

    So soon they should publish the information from their last crawl a few weeks ago.

    They have been trying to increase their rate though, so it could come early. Also some sites they spider more than others if they detect frequently updating information.
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums

  6. #6
    Not a post-script error?!! guysmy's Avatar
    Join Date
    Sep 2001
    Location
    Underneath the Earth w/ Krom (Canada)
    Posts
    787
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Originally posted by aspen
    Also some sites they spider more than others if they detect frequently updating information.
    Great tidbit, thanks aspen. I guess Google just changed their layout a bit. That add url just isn't as obvious anymore--->they are probably trying to avoid getting all those "FREE STUFF 4 U Super-Duper Home Page" type-sites that moronic people run.

    I've heard Googlebot has been moving extremely quick...no complaints.

    -OH YEAH-

    Can Googlebot spider windows that open via javascript??

    itech said spiders can't read java, but suggested I turn off the java in IE (6) and check if I can still get to these pages...

    So I went into Internet Options--Advanced--and disabled the java GIT compiler. I COULD get to the java popups after doing so.

    So hopefully these pages get spidered.

    EXCITEMENT! Everyone is now...---->
    Last edited by guysmy; Nov 22, 2001 at 10:24.

  7. #7
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Java and Javascript are related in name only. To turn off javascript in IE you turn off active scripting, and not Java.

    Java is a compiled language that is used client side only to run applets, mini programs.

    Javascript is a client side scripting language used for DHTML type applications, like your popup window. Javascript is only called Javascript for marketing purposes (though there are some syntax similarities... moreso because both languages have the same parents).

    And no, spiders do not follow Java or Javascript. Anything in either will be ignored.
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums

  8. #8
    Not a post-script error?!! guysmy's Avatar
    Join Date
    Sep 2001
    Location
    Underneath the Earth w/ Krom (Canada)
    Posts
    787
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Pity, I may have to completely rethink my site design for v3.0. That's missed traffic. The philosophy that every page should be an entry point is a good one.

    Most people that are heavy into graphics neglect these kind of things in favor of a sites "look" and "feel", and although that is my area, I don't want to do the same. It's just trendy stuff --like heading a html doc something like --

    0(^_^)0 JEROMEY.COM

    The popups are helpful for navigation, (the way I set them up) and they look quite cool, but that's a serious drawback to using them.

    --

    That's not the first time I've mixed up Java and Javascript, but I think it's the last.

  9. #9
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    If you're using JAvascript in any way for navigation you need to include <noscript> sections for search engines.

    Anything place between <noscript> tags will only show up to browsers with javascript disabled, like spiders. So right below your nifty Javascript driven menu include those tags with standard links.
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums

  10. #10
    SitePoint Evangelist
    Join Date
    Oct 2001
    Location
    Texas
    Posts
    598
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    what exactly does the noscript tag do??

  11. #11
    Rent A Cop Dan
    Join Date
    Jul 2001
    Location
    Madison, WI
    Posts
    799
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Originally posted by Wbmstr84
    what exactly does the noscript tag do??
    It tells browsers and spiders what to display/ read instead of the javascript if they can not read JavaScript.

    example. if I had a site that used a javascript navigational bar, I would want to have a noscript section for those people with old browsers that don't have javascript enabled or available. This makes it so everyone can access the site's navagational bar.

    Hopefully that makes since and I answered your question.

    Keep it Real,
    Dan

  12. #12
    Not a post-script error?!! guysmy's Avatar
    Join Date
    Sep 2001
    Location
    Underneath the Earth w/ Krom (Canada)
    Posts
    787
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    My new site has been in Google search results since...YESTERDAY. (Nov 26)

    I also noticed they updated my other site...so I guess that date is official then.

  13. #13
    Rent A Cop Dan
    Join Date
    Jul 2001
    Location
    Madison, WI
    Posts
    799
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Originally posted by guysmy
    My new site has been in Google search results since...YESTERDAY. (Nov 26)

    I also noticed they updated my other site...so I guess that date is official then.
    Yuppy it all started on Nov. 25th and finished on the 26th I believe.

    Keep it Real,
    Dan

  14. #14
    SitePoint Evangelist
    Join Date
    Oct 2001
    Location
    Texas
    Posts
    598
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Thanks i get it now.. i just didn't get how it was worded earlier.

  15. #15
    SitePoint Addict tempyyyst's Avatar
    Join Date
    Nov 2001
    Location
    Kent, UK
    Posts
    286
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Google and META refresh

    Does Googlebot follow a Meta refresh?

  16. #16
    SitePoint Wizard iTec's Avatar
    Join Date
    May 2001
    Location
    Sydney, Australia
    Posts
    2,243
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Re: Google and META refresh

    Originally posted by tempyyyst
    Does Googlebot follow a Meta refresh?
    yes, however i think they rank sites that use meta refreshes lower (im not 100% positive on that)

  17. #17
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Google will follow a meta refresh but it won't be tricked by it.

    It will use the content from the final page to list to the initial page, and it will also know if the page is duplicated somewhere, it will only treat it as one listing.
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •