SitePoint Sponsor

User Tag List

Results 1 to 3 of 3
  1. #1
    SitePoint Enthusiast
    Join Date
    Mar 2001
    Location
    Manchester, England
    Posts
    48
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Have i been spidered?

    Found this in my weblogs:

    spider-wk083.proxy.aol.com

    Is this AOL spidering my site? If it is how long will it be till i'm in the listing?

  2. #2
    SitePoint Zealot
    Join Date
    Dec 2001
    Location
    USA
    Posts
    106
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    It is the AOL proxy. This is what shows up when people use the AOL broswer.

  3. #3
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,939
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    No its not.

    AOL does spider sites. They use DMOZ data but they spider sites to make up their own rankings for that data.

    If its a visitor from AOL it will say cache.aol or something similar.
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •