SitePoint Sponsor

User Tag List

Results 1 to 13 of 13
  1. #1
    SitePoint Evangelist kashaziz's Avatar
    Join Date
    Feb 2001
    Location
    PK
    Posts
    460
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Bot to do price comaparisions / site scanning

    I dont know whether this is the right place to post this quesiton or not but what i need is something that can scan other web sites and do price comparisons - for example, buy.com use a bot that scan amazom.com's site for prices and they automatically reduce their price from what they get on amazon

    i will appreciate if i can get a freebie / code or hints about how to do this

  2. #2
    SitePoint Wizard creole's Avatar
    Join Date
    Oct 2000
    Location
    Nashvegas Baby!
    Posts
    7,845
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Adobe Certified Coldfusion MX 7 Developer
    Adobe Certified Advanced Coldfusion MX Developer
    My Blog (new) | My Family | My Freelance | My Recipes

  3. #3
    SitePoint Evangelist kashaziz's Avatar
    Join Date
    Feb 2001
    Location
    PK
    Posts
    460
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    yes but i am interested in having some sort of script to integrate with my web site

  4. #4
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    To make a script that can do this you need a good grasp of parsing and regular expressions. Furthermore it would require very sophisticated software as every site is different.
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums

  5. #5
    SitePoint Evangelist kashaziz's Avatar
    Join Date
    Feb 2001
    Location
    PK
    Posts
    460
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    well i am deeply interested. I know a bit PHP and java and am working with CF and ASP for some time. I will appreciate if somebody can guide me how to do the trick.

    I have checked out pricefarmer.com and i think i want this functionality but they are limited with book and i am interested in consumer products.


  6. #6
    SitePoint Wizard creole's Avatar
    Join Date
    Oct 2000
    Location
    Nashvegas Baby!
    Posts
    7,845
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Originally posted by kashaziz
    yes but i am interested in having some sort of script to integrate with my web site
    Did you go to www.Booksamillion.com? They integrate PriceFarmer with their website. Take a look here:
    http://www.booksamillion.com/ncom/bo...sbn=0312253419

    Look at the very bottom right of the book cover. See the text link that says "Compare Prices"?
    Adobe Certified Coldfusion MX 7 Developer
    Adobe Certified Advanced Coldfusion MX Developer
    My Blog (new) | My Family | My Freelance | My Recipes

  7. #7
    SitePoint Evangelist kashaziz's Avatar
    Join Date
    Feb 2001
    Location
    PK
    Posts
    460
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    yes i checked that out but the thing is pricefarmer.com works only with books and it receives ISBN and works on it but if your are talking about general consumer products then how can u handle this?

  8. #8
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    A parsing script is unique to the site it is parsing, since no 2 sites are alike the script has to be able to recognize what site it is in, what type of page it is at on that site, and then know the exact layout of that type of page so that it can parse to the correct information.

    Now with sites that use XML this is a little easier because there is usually an identifiable marker around what you want, but each site will still be different.

    I would consider complicated parsing scripts/robots to be pretty advanced and generally I would say that if you have to ask how to do it you don't have the skills to do it.
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums

  9. #9
    SitePoint Evangelist kashaziz's Avatar
    Join Date
    Feb 2001
    Location
    PK
    Posts
    460
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    well may be you are right about the skills but skills could be learnt - so i am keen to do this and appreciate all help if available

  10. #10
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Start with learning alot about regular expressions, and then perhaps find a parsing script a see if you can understand the source code.
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums

  11. #11
    SitePoint Evangelist kashaziz's Avatar
    Join Date
    Feb 2001
    Location
    PK
    Posts
    460
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    and where can i find resources for this?

  12. #12
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    there are plenty of parsing scripts on hotscripts.

    For a regular expression tutorial just search for regular expressions on google, or buy a book on php, they should cover them.

    (note: regular expressions can be used in a variety of languages and are usually the same in each language)
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums

  13. #13
    SitePoint Evangelist kashaziz's Avatar
    Join Date
    Feb 2001
    Location
    PK
    Posts
    460
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    thanks - i have encountered regular expressions in java but now i will read them more carefully.


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •