SitePoint Sponsor

User Tag List

Results 1 to 6 of 6
  1. #1
    SitePoint Addict
    Join Date
    Jun 2008
    Posts
    279
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Prevent Scraping

    Hiya,

    Am a correct in saying: "Every website by default can be scraped"?
    ...How do you prevent your website from being scraped?

  2. #2
    SitePoint Wizard bronze trophy
    Join Date
    Jul 2008
    Posts
    5,757
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    You can't really prevent it. You can only try it make it harder.

    Remember, if you want users to still be able to actually use your website, thier computer needs to be able to understand and read it And if thier computer can read it...

  3. #3
    SitePoint Wizard
    Join Date
    Mar 2008
    Posts
    1,149
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    The best you can do is detect if a client is issuing too many requests in a time period, and force a CAPTCHA to verify that the user is not a bot.

    But if it's a one time thing, then there's nothing that you can do.

  4. #4
    SitePoint Guru
    Join Date
    Jun 2006
    Posts
    638
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Best "any scraping" thing I seen, was a site that would server fake data once it detects you scraping it.

  5. #5
    SitePoint Wizard frank1's Avatar
    Join Date
    Oct 2005
    Posts
    1,392
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    lol....
    i am not scraper...but in one site i saw that they have 3 fake data in a lottery results ...to aviod scrape...
    which is crime...
    i think some body should file a case against them....if it really matched some name who has bought ticket...he will faint...lol

  6. #6
    SitePoint Addict
    Join Date
    Jun 2008
    Posts
    279
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    - OK. Thanks for all your help everyone.
    That one thing I hate about the internet, information pictures etc can be scraped/stolen. Especially after you have spent hours putting the content together.


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •