SitePoint Sponsor

User Tag List

Results 1 to 4 of 4

Thread: content grabber

  1. #1
    SitePoint Addict
    Join Date
    Sep 2000
    Location
    Ontario, Canada
    Posts
    320
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    content grabber

    I've been using a content grabber to get daily updated mortgage closings from a financial website. It seems that they have somehow blocked out this functionality from their site. I was just wondering how this is possible and if there is any way of getting around it other than getting a new data source.

    I am showing a link to the company on the website "data courtesty of ...." so people know where the data is coming from.

    I tried the content grabber on other sites to ensure that its working correctly and it all looks good. Just doesn't work on some sites.

    Any ideas are appreciated.
    Jason Dulberg
    Extreme MTB
    http://extreme.nas.net

  2. #2
    SitePoint Enthusiast drisley's Avatar
    Join Date
    Jun 2001
    Location
    Florida
    Posts
    99
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    They can block it using .htaccess files under Apache. I don't know what software they use, though.

    I'm not aware of a way to get around it. But, quite frankly, you should ask them before doing that anyway.
    David Risley
    Web Developer, Web Publisher, Blogger, Tech Dude
    PC Mechanic | WebbyOnline

  3. #3
    Victory shall be mine tubedogg's Avatar
    Join Date
    Mar 2001
    Location
    Medina, OH
    Posts
    440
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    If they went so far as to block it, they probably don't want you doing it. Why would you continue to do this against their wishes?

    Try asking them if you could work out a contract to allow this. It would require paying them something probably but at least you'd be doing it with a clean conscience.
    Kevin

  4. #4
    SitePoint Addict
    Join Date
    Sep 2000
    Location
    Ontario, Canada
    Posts
    320
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    I totally agree with you guys... its trying to explain it to my client that's the problem. He has the idea that if it works on one site, why can't it work on others.

    Thanks.
    Jason Dulberg
    Extreme MTB
    http://extreme.nas.net


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •