Codenstuff.com

Hey coders,

For school I've to create a huge dictionary (why would they let students do that...) and I've got a couple of problems. Several files are have a really big amount of words (17 million), each word is on a line resulting in 17 million lines. I need all these lines to be in 1 big file named all.txt. So far copy+paste works fine, but for those big files my notepad++ crashes (c++ runtime error, unexpected). Anybody got an idea which program to use to be able to open these? It'd really help me out.

Kind regards,
Max

Does it matter in which order words are merged in the file?

No, as long as there is only 1 word per line. Alphabetical order does not matter at all.

If you're looking into writing a small application to ease your task, try this:

http://www.codeproject.com/Questions/40 ... -in-VB-NET

Using a StreamReader would enable you to read very large files... Just read it line by line and write it in your destination file cooll;

comathi wrote:

If you're looking into writing a small application to ease your task, try this:

http://www.codeproject.com/Questions/40 ... -in-VB-NET

Using a StreamReader would enable you to read very large files... Just read it line by line and write it in your destination file cooll;

Will try after lunch, a big thanks already for the effort

No problem... I'd write something for you, but I'm on my laptop at the moment... Later on in the day I could try something if you still don't have it working

Hey Comathi,

The link you posted does not really make sense to me (in terms of: I dont understand it really). If you could help me with that, that'd be great

EDIT: I've got a file that has 8 million lines and one of 14 million lines and I need to add these together. I dont know if you need the numbers exactly?

I think it would be easier if you do that with xml instead of txt

mshimranpro wrote:

I think it would be easier if you do that with xml instead of txt

xml is in plain text format. I would rather use MySQL.

Why not plain text? There is no need for security or anything. You guys made me curious now