SitePoint Sponsor

User Tag List

Results 1 to 13 of 13
  1. #1
    Ex-SitePointer silver trophy
    Patrick's Avatar
    Join Date
    Oct 2000
    Location
    Harbinger, NC, U.S.A.
    Posts
    4,126
    Mentioned
    2 Post(s)
    Tagged
    0 Thread(s)

    Trying to open a big (172 MB) text file

    Hello,

    I am trying to open a 172 MB text file (it says it is an MS DOS application, but it is just lines of text... it is the raw access logs from one of my sites).

    I have tried NotePad. Basically kills my PC (2.4 Ghz P4, 512 MB).

    I have tried EditPlus 2. It says that the file is too big (125 MB limit).

    I have tried TextPad. It displays the lines in an incorrect manner (they are not what they are supposed to be - they have all of these numbers before the lines and the lines are jumbled together at the end - and it is not complete).

    What can I do? I need to easily access and search the files with minimal delays.

    Thanks.

  2. #2
    SitePoint Wizard ChrisRoss's Avatar
    Join Date
    Jun 2002
    Location
    MI
    Posts
    2,535
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Do you have Word? Or maybe try Word Pad.... Or anything that can import text.
    Golf Outings? OutingCaddy.com
    Organize - Invite - Create Free website for your golf outing!

  3. #3
    SitePoint Wizard samsm's Avatar
    Join Date
    Nov 2001
    Location
    Atlanta, GA, USA
    Posts
    5,011
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    I think it's safe to say that you (the human you) aren't going to be reading a 172 MB file in it's entirety.

    Have you considered making up a little script to get that data into MySQL or another database? Then you could run queries on the information contained within the file. Would that work?

    Also, maybe Excel or another spreadsheet application would be appropriate.
    Using your unpaid time to add free content to SitePoint Pty Ltd's portfolio?

  4. #4
    Ex-SitePointer silver trophy
    Patrick's Avatar
    Join Date
    Oct 2000
    Location
    Harbinger, NC, U.S.A.
    Posts
    4,126
    Mentioned
    2 Post(s)
    Tagged
    0 Thread(s)
    Thanks for the responses.

    I'd prefer to have it in front of me in text format, although I won't be reading it, you are right.

    I'll try WordPad, Word and Excel.

    Is there maybe a program that will break up files into 1/4 or 1/8 or something like that, so that I can view it in more manageable chunks?

    Thanks.

  5. #5
    Ex-SitePointer silver trophy
    Patrick's Avatar
    Join Date
    Oct 2000
    Location
    Harbinger, NC, U.S.A.
    Posts
    4,126
    Mentioned
    2 Post(s)
    Tagged
    0 Thread(s)
    WordPad was able to open it and search (although very slowly), so I guess that'll work for now.

    But, still, I'd be interested in any other recommendations and seeing if there is a program like the one I mentioned above.

    Thanks.

  6. #6
    SitePoint Wizard samsm's Avatar
    Join Date
    Nov 2001
    Location
    Atlanta, GA, USA
    Posts
    5,011
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    I'm kind of disappointed, the query option is so sweet!

    If nothing else, you could do that 1/4 or 1/8 text file slice and dice no problem with MySQL. But that's just the film on the pudding, there's so much more!
    Using your unpaid time to add free content to SitePoint Pty Ltd's portfolio?

  7. #7
    Ex-SitePointer silver trophy
    Patrick's Avatar
    Join Date
    Oct 2000
    Location
    Harbinger, NC, U.S.A.
    Posts
    4,126
    Mentioned
    2 Post(s)
    Tagged
    0 Thread(s)
    I couldn't do that, I don't really know how. Someone else could do it for me, maybe.

  8. #8
    SitePoint Wizard Keriam's Avatar
    Join Date
    Jun 2003
    Location
    Colorado, USA
    Posts
    1,178
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    You might try UltraEdit-32. I have not found a large file yet that it choked on.
    Never put off until tomorrow what you can do
    the day after tomorrow. ~ Mark Twain

  9. #9
    SitePoint Addict
    Join Date
    Jul 2001
    Posts
    326
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by iFroggy

    What can I do? I need to easily access and search the files with minimal delays.
    Take a look at Synth 17, might be just what you're looking for, it's free also...

    Quote Originally Posted by From the site...

    Synth 17 is a programmers editor; FEATURES: edit huge files, bookmarks, regular expression find/replace, user defineable syntax highlighters (many included).

  10. #10
    SitePoint Wizard samsm's Avatar
    Join Date
    Nov 2001
    Location
    Atlanta, GA, USA
    Posts
    5,011
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by iFroggy
    I couldn't do that, I don't really know how. Someone else could do it for me, maybe.
    If only there was a forum where people helped each other with this sort of thing. If only...

    Keep it in mind as a last recourse if the applications people are suggesting don't work. :-)
    Using your unpaid time to add free content to SitePoint Pty Ltd's portfolio?

  11. #11
    SitePoint Wizard Keriam's Avatar
    Join Date
    Jun 2003
    Location
    Colorado, USA
    Posts
    1,178
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by bob_d
    Take a look at Synth 17, might be just what you're looking for, it's free also...
    Umm, yes, I did not mention that UltraEdit is not free, but it does have a 45-day free trial period.

    I have been using UltraEdit since version 5, I think, and it is now up to version 10.x. It has been one of the few shareware programs that I feel has been worth the money. Great support, free upgrades, frequent bug fixes, etc.
    Never put off until tomorrow what you can do
    the day after tomorrow. ~ Mark Twain

  12. #12
    Ex-SitePointer silver trophy
    Patrick's Avatar
    Join Date
    Oct 2000
    Location
    Harbinger, NC, U.S.A.
    Posts
    4,126
    Mentioned
    2 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by samsm
    If only there was a forum where people helped each other with this sort of thing. If only...
    If only I had the desire (and time) to learn SQL...

    I've tried. Doesn't work out. Doesn't stick.

  13. #13
    SitePoint Wizard
    Join Date
    Oct 2001
    Location
    Tucson, Arizona
    Posts
    1,858
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Noted should work well for you, since there's no file size limit.


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •