ETL and Data Integration tools - Modern ETL software for everyone

Hello

I am looking for solution which will work with very large text files >20 gigs

I have already tried Altova Mapforce but according to this it is not capable of working with very large files
www.altova.com/forum/default.aspx?g=posts&t=524

I need to be able to sort validate and transform large delimited files

Looking forward to your reply,
Stan

Yes AETL will work with even large files because it does not load everything into the memory.
It will take a while to process bit it will not fail.
Just make sure that you have fast hardware

Peter

In this case can you give us some hardware recommendations?

Stan

Hard disk performance is the key

Use raid 10 it is the fastest

Use separate drives one for source files one for result files and one for sorting

Measure hdd/raid performance yourself using HDtach

Do not trust manufactures hdtach will tell you real numbers.

So you will be able to tell yourself in advance how long will it take to process 10gig file

It is all deepens on how mb/gig per second you raid can do

Happy sorting
Mike