SitePoint Sponsor

User Tag List

Results 1 to 10 of 10
  1. #1
    SitePoint Enthusiast
    Join Date
    Jul 2001
    Location
    Ireland
    Posts
    90
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Flat File Dilemma

    Hi all,

    I have a serious dilemma. I am about to embark on building a large interactive website but I am very confused.

    I have read recent reports on my SQL failing due to too many users using a database at a given time.

    The website I am building must be able to tolerate hundreds of thousands of users. Each will have a login name and password. Logins will timeout after say a 2 hour period of inactivity - therefore there will be constant read/write activity to a database to monitor the timeout function alone never mind anything else.

    Everyone says that I should steer away from a flatfile approach but nobody gives me a good reason. My plan is to have one mySQL database/table with all the login and password data and then to have one flatfile for each user to manage the timeout function and all other personal data of that user. Can someone please advise me on both the a)flatfile issue and b)the mySQL issue?

    Many thanks,

    Willie

  2. #2
    SitePoint Guru
    Join Date
    Apr 2001
    Location
    BC, Canada
    Posts
    630
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    first..

    Flat files are petty slow, and dont have a lot of features

    second...
    if mysql isnt good powerfull enough for you, maybe look into..uh... whats the name of it??
    its like postresql
    something like that..sure someone will come up with the name

  3. #3
    Victory shall be mine tubedogg's Avatar
    Join Date
    Mar 2001
    Location
    Medina, OH
    Posts
    440
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Flatfiles are not the answer.

    MySQL may not be enough - I would look into PostGreSQL.
    Kevin

  4. #4
    SitePoint Wizard TWTCommish's Avatar
    Join Date
    Aug 1999
    Location
    Pittsburgh, PA, USA
    Posts
    3,910
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Hmmm...well, if we're talking about 100s of thousands of users, MySQL can handle it. MySQL can handle a ton of raw data...the problem lies with concurrent users, from what I understand. Do you know how many people will be browsing your site during peak traffic hours? If it's more than several hundred, then I think you'd be better off with something more robust than MySQL.

  5. #5
    Victory shall be mine tubedogg's Avatar
    Join Date
    Mar 2001
    Location
    Medina, OH
    Posts
    440
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Plus how much database-stored information are these hundreds of thousands of users going to generate? There are practical limits on how much data MySQL can store as well as issues with over about 700 concurrent users.
    Kevin

  6. #6
    SitePoint Member
    Join Date
    Jul 2001
    Posts
    7
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    MS SQL is a very powerfull database but it probably costs a fortune to use.

  7. #7
    code addict Abstraction's Avatar
    Join Date
    Apr 2001
    Location
    Des Moines, IA
    Posts
    346
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Another thing to look at: Make sure the machine MySQL resides on has enough horsepower. Other than that, you might want to look at getting a different database such as MS SQL SERVER, ORACLE, etc.

  8. #8
    Grumpy Mole Man Skunk's Avatar
    Join Date
    Jan 2001
    Location
    Lawrence, Kansas
    Posts
    2,066
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Flat Files with that many concurrent users will be anightmare - you'll get horrific performance (Thanks to all the read/writes to disk) and they'll probably end up going corrupt somewhere along the line as well.

    I'd consider PostGreSQL - iut's open source and much more resiliant under high loads than MySQL. SyBase is meant to be good as well (there's a good post on here somehwere by MattR about SyBase).

  9. #9
    Database Jedi MattR's Avatar
    Join Date
    Jan 2001
    Location
    buried in the database shell (Washington, DC)
    Posts
    1,107
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Hundreds of thousands of concurrent users (see: read/writes)?

    Sounds like a job for the Sun E10000! (read: you 0we Sun several hundred thousand dollars).

    What is your budget?

  10. #10
    code addict Abstraction's Avatar
    Join Date
    Apr 2001
    Location
    Des Moines, IA
    Posts
    346
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    If in doubt, throw more hardware at it... ;-)


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •