SitePoint Sponsor

User Tag List

Results 1 to 2 of 2
  1. #1
    SitePoint Zealot Paul_M's Avatar
    Join Date
    Mar 2001
    Location
    London
    Posts
    160
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    MSIECrawler... what is it??

    Hi all....

    For the last 2 days i have had someone access my ENTIRE site at one go using this user agent MSIECrawler.

    I think what they are doing this downloading my whole site so that they can use it offline.

    I wanted to know more about the MSIECrawler....
    and will they be able to access my content properly if my site has dynamically generated content using PHP and a MySQL Db??? Will the PHP scripts work?

    Any info is greatly appreciated

    Paul

  2. #2
    Kat's Meow Senior ******* WebKat's Avatar
    Join Date
    Jul 1999
    Location
    California USA
    Posts
    1,071
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    MSIECrawler is a robot, spider, crawler & seach engine spider/bot

    To find out more about MSIE Crawler {and other similar programs} check out:

    Search Engine Watch
    {Search engine spiders are used by search engines to index web sites for their databases};

    MSIECrawler @SimplytheBest & Search engine spiders @SimplytheBest; and

    Search engine robots

    Other SP Members may know just how powerful & accessible they can be to your web site's content.....WebKat
    Dlynn :: SitePoint Senior Advisor ::
    PawPrint Designs by WebKat
    "Dogs come when they're called; Cats take a message and get back to you later." ~ Mary Bly


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •