Resuming quest to open a massive text file

[Pringles]

Unix / linux / osx: more / less / vi / cat will work just fine on 4gb file, I do it daily on logs much larger than this.

[sawin]

I also have been looking for a program to open very large files. I have considered using http://www.ultraedit.com/

There is a trial and it boasts the capacity to edit files over 4GB. I wish I could recommend it, but as I haven't yet tried it I'm unsure how well it would work for you.

[vulzol]

Originally Posted by letsallkillandy [You must be logged in to view images. Log in or Register.]

There's also a high probability with a file size that large (and old) that it may have gone corrupt. Im frankly impressed you've accumulated 4gbs of TEXT. The largest log file i've seen was 1.5gbs and it barely opened.

Hate to be a downer but this sounds probable.

[Unfadable]

Originally Posted by sawin [You must be logged in to view images. Log in or Register.]

I also have been looking for a program to open very large files. I have considered using http://www.ultraedit.com/

There is a trial and it boasts the capacity to edit files over 4GB. I wish I could recommend it, but as I haven't yet tried it I'm unsure how well it would work for you.

Use this at work and works well. I think the largest file I've opened with it was a 2.5gig csv file.

[Adachi]

Under Unix you can use the split command.

split -l 1000000 file.txt

This would split the file every 1,000,000 lines into files named 'xaa', 'xab', 'xac', etc..

And if you need to rejoin the files after editing them, simply use 'cat'

cat xaa xab xac > newfile.txt

But if you just want to view the file, I'm pretty sure 'less' would work.

Oh, and vim > *
[You must be logged in to view images. Log in or Register.]

[Hackscendence]

Line breaks are still line breaks when the file is converted to CSV.

Copy file, paste somewhere, change extension to CSV, Use This, set max number of lines per file to whatever you'd prefer, convert resulting file extensions back to txt.

[webrunner5]

I think if he breaks the files up this thing is never going to work. Like has been said one stupid corrupt sector and yarcarbluee. [You must be logged in to view images. Log in or Register.] This needs to be transfered complete.

[SirAlvarex]

I concur with everyone suggesting "less." It works by buffering segments of the file and does not edit it. I use it to view multi-gb files all the time.

Although split does seem like a nice command.

In less you can search through the file with "/" and a regex. Although on a 4GB file that might not be most idea lol. Just use grep for that.

[Aeolwind]

[Wed Jul 31 21:56:37 2002] Gazgaz tells the guild, 'Me slowed uz The Idol of Rallos Zek'
[Wed Jul 31 21:56:37 2002] Raelven tells the guild, 'weakened'
[Wed Jul 31 21:56:37 2002] Karitta tells the guild, '#8 Comple healing ------> Sarsippius #8'
[Wed Jul 31 21:56:37 2002] Hoozyur tells the guild, 'get The Idol of Rallos Zek a wheelchair, his ass is CRIPPLED'
[Wed Jul 31 21:56:37 2002] Tuan tells the guild, '[1] --CH-- Sarsippius'
[Wed Jul 31 21:56:37 2002] Teer tells the guild, '#2 CH <<< Sarsippius >>> #2~~~~~~~~ #2 ~~~~~~~~~ #2'
[Wed Jul 31 21:56:37 2002] Tomatos tells the guild, 'Elixier on Sharlene for Assist Heal, Wating for Big Heal !!'
[Wed Jul 31 21:56:40 2002] Welcome to EverQuest!
[Wed Jul 31 21:56:40 2002] You have entered Nektulos Forest.
[Wed Jul 31 21:56:41 2002] GUILD MOTD: Dabiggun - CT, Creator and HP PWNED!!!! AoW NOW!
[Wed Jul 31 21:56:41 2002] Autojoining channels...

Just at taste

[Thulack]

So who gets the reward for the right program? [You must be logged in to view images. Log in or Register.] Grats on getting it to work.