SitePoint Sponsor

User Tag List

Results 1 to 8 of 8
  1. #1
    boiler up blackdog's Avatar
    Join Date
    Jul 2002
    Location
    Purdue
    Posts
    1,181
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    updating datafeeds through FTP

    Up until now, I have always manually updated my datafeeds. Every few days I download the new feed and dump it into mysql. I'm thinking of looking for an automatic solution. how do you guys do it? do you have a cron job that downloads the feed once a day or something?

    I just signed up with a new company to use their datafeed and they have requested that I give them my ftp address, user and password... what could they want that for? I thought most comanies would give you that information so you can download the feed from their server

  2. #2
    SitePoint Enthusiast
    Join Date
    Feb 2005
    Posts
    65
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    that sounds strange why they would ask you for FTP, are you sure they wern't meaning to give you their FTP server details as a lot of merchants do it this way. I run some access databases i make from Datafeeds, these get updated about twice a month using ftp. I think you can use XML to have it automaticaly updated but I'm unsure how this works.

  3. #3
    boiler up blackdog's Avatar
    Join Date
    Jul 2002
    Location
    Purdue
    Posts
    1,181
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by mobilephones
    that sounds strange why they would ask you for FTP, are you sure they wern't meaning to give you their FTP server details as a lot of merchants do it this way.
    that was my reaction. but here's what they said:
    To get you up and running I will need your FTP address, username, and password

  4. #4
    SitePoint Zealot AlpineZone's Avatar
    Join Date
    Nov 2004
    Location
    Watertown, CT, USA
    Posts
    193
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by blackdog
    I just signed up with a new company to use their datafeed and they have requested that I give them my ftp address, user and password... what could they want that for? I thought most comanies would give you that information so you can download the feed from their server
    Set up a specific FTP account just for them. Don't give them your log on details to your main account. I get data feeds from SnoCountry.com in this way.

  5. #5
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Thats kind of vague, they might be asking for a preexisting FTP account information with an affiliate network (for instance when I asked for more BeFree feeds they wanted my BeFree information).

    Or, as you expect, they're asking for FTP access to your server so they can upload their feed to you directly.

    In anycase... what I do is I have a cron job that downloads from the merchants nightly, then another cron job that updates the databases.
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums

  6. #6
    SitePoint Enthusiast
    Join Date
    Feb 2005
    Posts
    65
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Hi Aspen,

    I would like to know more about these "cron jobs" how do they work, can you explain what the process involves?

  7. #7
    Serial Publisher silver trophy aspen's Avatar
    Join Date
    Aug 1999
    Location
    East Lansing, MI USA
    Posts
    12,937
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Cron is an task scheduler for *nix

    http://www.unixgeeks.org/security/ne...ix/cron-1.html
    Chris Beasley - I publish content and ecommerce sites.
    Featured Article: Free Comprehensive SEO Guide
    My Guide to Building a Successful Website
    My Blog|My Webmaster Forums

  8. #8
    SitePoint Enthusiast
    Join Date
    Feb 2005
    Posts
    65
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by aspen
    ok thanks for the link, might be something i might look into ...


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •