ETL and Data Integration tools - Modern ETL software for everyone

Hi Mike,

I am having trouble getting the reader to use the mask to find my files. It seems to always want to default to the original file that I used to setup my columns.

Now, as part of the package I created, it always looks for this exact file rather then using the mask I have defined.

Adrian

Adrian

I am really confused about your question

Mask is only used when you load the data

There is a default example which demonstrates that

See the log below

Information 20/03/2011 21:29:24 Starting Transformation...
Information 20/03/2011 21:29:24 Preparing Writers...
Information 20/03/2011 21:29:24 Writer: {Orders Table}, [Table=Orders] Writer { Orders Table } Is Ready
Information 20/03/2011 21:29:24 All Writers are Ready
Information 20/03/2011 21:29:24 Processing Data...
Information 20/03/2011 21:29:24 Reader:{List of Customer's orders} Found: 4 File(s) to read
Information 20/03/2011 21:29:24 Reader:{List of Customer's orders} Path: C:\Program Files\DB Software Laboratory\Demo\Buffer\
Information 20/03/2011 21:29:24 Reader:{List of Customer's orders} Mask: Ord*.csv
Information 20/03/2011 21:29:24 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Ord1.csv
Information 20/03/2011 21:29:25 Reader:{List of Customer's orders} Read 924 Line(s)
Information 20/03/2011 21:29:25 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Ord2.csv
Information 20/03/2011 21:29:26 Reader:{List of Customer's orders} Read 924 Line(s)
Information 20/03/2011 21:29:26 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Ord3.csv
Information 20/03/2011 21:29:30 Reader:{List of Customer's orders} Read 3152 Line(s)
Information 20/03/2011 21:29:30 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Orders.csv
Information 20/03/2011 21:29:36 Reader:{List of Customer's orders} Read 5000 Line(s)
Information 20/03/2011 21:29:36 Reader:{List of Customer's orders} Processed : 10000 Record(s)
Information 20/03/2011 21:29:36 Reader:{List of Customer's orders} Records per second : 1590.07
Information 20/03/2011 21:29:36 Reader:{List of Customer's orders} Rejected : 0 Record(s)
Information 20/03/2011 21:29:36 Reader:{List of Customer's orders} Time Taken : 00:00:06
Information 20/03/2011 21:29:36 Writer: {Orders Table}, [Table=Orders] Inserted : 10000 Record(s)
Information 20/03/2011 21:29:36 Writer: {Orders Table}, [Table=Orders] Updated : 0 Record(s)
Information 20/03/2011 21:29:36 Writer: {Orders Table}, [Table=Orders] Deleted : 0 Record(s)
Information 20/03/2011 21:29:36 Writer: {Orders Table}, [Table=Orders] Errors : 0
Information 20/03/2011 21:29:36 Transformation Completed
Information 20/03/2011 21:30:04 Starting Transformation...
Information 20/03/2011 21:30:04 Preparing Writers...
Information 20/03/2011 21:30:05 Writer: {Orders Table}, [Table=Orders] Writer { Orders Table } Is Ready
Information 20/03/2011 21:30:05 All Writers are Ready
Information 20/03/2011 21:30:05 Processing Data...
Information 20/03/2011 21:30:05 Reader:{List of Customer's orders} Found: 13 File(s) to read
Information 20/03/2011 21:30:05 Reader:{List of Customer's orders} Path: C:\Program Files\DB Software Laboratory\Demo\Buffer\
Information 20/03/2011 21:30:05 Reader:{List of Customer's orders} Mask: *.csv
Information 20/03/2011 21:30:05 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Categories.csv
Error 20/03/2011 21:30:05 Writer: {Orders Table}, [Table=Orders] Can't convert value Beverages to INTEGER for field OrderNo
Error 20/03/2011 21:30:05 1 Writer: {Orders Table}, [Table=Orders] Can't convert value Condiments to INTEGER for field OrderNo
Error 20/03/2011 21:30:05 2 Writer: {Orders Table}, [Table=Orders] Can't convert value Confections to INTEGER for field OrderNo
Error 20/03/2011 21:30:05 3 Writer: {Orders Table}, [Table=Orders] Can't convert value Dairy Products to INTEGER for field OrderNo
Error 20/03/2011 21:30:05 4 Writer: {Orders Table}, [Table=Orders] Can't convert value Grains/Cereals to INTEGER for field OrderNo
Error 20/03/2011 21:30:05 5 Writer: {Orders Table}, [Table=Orders] Can't convert value Meat/Poultry to INTEGER for field OrderNo
Error 20/03/2011 21:30:05 6 Writer: {Orders Table}, [Table=Orders] Can't convert value Produce to INTEGER for field OrderNo
Error 20/03/2011 21:30:05 7 Writer: {Orders Table}, [Table=Orders] Can't convert value Seafood to INTEGER for field OrderNo
Information 20/03/2011 21:30:05 Reader:{List of Customer's orders} Read 8 Line(s)
Information 20/03/2011 21:30:05 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Customer_Lookup.csv
Information 20/03/2011 21:30:05 Reader:{List of Customer's orders} Read 0 Line(s)
Information 20/03/2011 21:30:05 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Customer_Sales.csv
Information 20/03/2011 21:30:05 Reader:{List of Customer's orders} Read 0 Line(s)
Information 20/03/2011 21:30:05 Reader:{List of Customer's orders} Source File: C:\Program Files\DB Software Laboratory\Demo\Buffer\Customer_Sales2.csv

Mike

I will see if I can explain this better.

I am currently receiving e-mails that have attachments. Even though the attachments are the same format text file, they always have a different name.
For example, over the course of a 5 day period, the attachments may be called:

x010101.txt
x043532.txt
x984324.txt
x234523.txt

I have the mask defined to always look for .txt

In the screenshot that I sent you though, the reader always seems to look for the same file name and not using the extension part of the mask. I have the mask setup to look for *.txt (where * is the wildcard part of the mask). Does this support * as a wildcard?

See the error message below that pops up.

The file reservations070109.txt is an old file. It was processed previously, and it has been removed. The new file will have a new name, but the extension will remain as .txt

I see what you mean now

No this part does not use masks.
It just points to the last file used by the user which can be anywhere.

The problem you got that the file is deleted every time you run the package,
why do not you copy a file into the different directory where it will not be deleted and use this file instead?

Mike

I am not sure I understand how to resolve this problem.

The bottom line is that I am going to receive a different attachment name every day. How do I process these?

Adrian

You have already done everything to make it work
Add your transformation to the package and and run it you will see what I mean

Peter