ETL and Data Integration tools - Modern ETL software for everyone

Mike,

if the data that is being loaded via the reader (a text file for example) has a carriage return incorrectly inserted into the middle of a data line ….the tool attempts to auto-populate the rows with data from the preceding line. Or if the extract that is being read has fewer columns than what is expected, it attempts to auto-populate those “missing” columns as well. Is this intentional and, if it is, is there a way to turn it off? I looked through the settings but didn’t see any options related to this.

Thanks,
Vincent

Vincent

I am trying to reproduce the problem

So I created two files one with 4 columns another with 3

File with 4 columns loaded first

when second file is loaded forth field in the database is populated with nulls

Which is as it should be I believe?

Perhaps you can create for us a simple example using files on drive c:?

Mike

Mike,

Here is an example of the issue I was describing. The extracts that I am trying to validate have an EOL column that contains just the value ‘X’. There is a validation done on that column to verify the value of ‘X’ in that last column. If the value did not equal x then reject the record.

If you look at the example extract you will see that there were a couple of carriage returns inserted into the data. Often when I receive data, the client that sends me data accidentally inserts carriage returns into the data. I was hoping that the EOL validation would capture this. Browsing this data though shows that, instead of blank fields where the CR were inserted, it appears that the data is populating based on what was in the prior rows.

Does this make sense? If you need more information from me, please let me know.

Thanks,
Vincent

OK

Thank you for the file we will check it and get back to you

Mike