HomeForum
Welcome, Guest

Receive multiple files from various distributors via one FTP site
(1 viewing) (1) Guest
  • Page:
  • 1

TOPIC: Receive multiple files from various distributors via one FTP site

Receive multiple files from various distributors via one FTP site 10 months, 1 week ago #3226

  • SteveK
  • OFFLINE
  • Junior Boarder
  • Posts: 32
  • Karma: 0
Hi,

I have a scenario where we receive multiple files from various distributors via one FTP site.
My package is downloading, transforming, archiving etc.
Since I am downloading files from multiple distributors,I am using a mask when downloading from FTP.

The challenge is that some of the distributors use the same name for each file they upload.
So I may encounter a problem when I am archiving files and there is a previous file with the same name.
Is there is a way for me to change the names of multiple files prior to moving to my archive folder.
I know I can append the date to the file name via a merge within the file operator object, but this only works with one file name.
I have multiple file names to contend with.
It would be great if there was a way to do this via the Rename File within the file operator object.

Any suggestions would be appreciated.

Thanks

Steve

Re: Receive multiple files from various distributors via one FTP site 10 months, 1 week ago #3227

  • admin
  • OFFLINE
  • Moderator
  • Posts: 2182
  • Karma: 12
Steve

2 options

1 Zip all the files into the file like archive-yyyymmddhhnntt.zip
2 create different directories within archive folder.
directory name can be calculated value.
so you can create called dir-yyyymmddhhnntt and move files into it

Peter

Re: Receive multiple files from various distributors via one FTP site 10 months, 1 week ago #3228

  • SteveK
  • OFFLINE
  • Junior Boarder
  • Posts: 32
  • Karma: 0
Hi,

Thanks for the suggestions.

I can get option 2 to work, but am having a problem with option 1. It
is reading the various files to be compressed but I have something wrong
with the zip file portion.

Information 10/2/2011 2:53:27 PM Preparing to execute: Test-Move
File
Information 10/2/2011 2:53:27 PM Package Started
Information 10/2/2011 2:53:27 PM Executing Zip: zip and archive
Information 10/2/2011 2:53:27 PM Zip File : <archive>\20091002
Information 10/2/2011 2:53:27 PM Found: 2 File(s) to Compress
Information 10/2/2011 2:53:27 PM Path: G:\itg\Business
Intelligence\ETL\
Information 10/2/2011 2:53:27 PM Mask: *.csv
Error 10/2/2011 2:53:27 PM Following ZIP Error happened Unable to
access the selected drive!
Information 10/2/2011 2:53:27 PM Sending Email: email failure
Information 10/2/2011 2:53:27 PM To: stevv@m.com
Information 10/2/2011 2:53:27 PM Done
Information 10/2/2011 2:53:27 PM Package Finished

Thanks

Steve

Re: Receive multiple files from various distributors via one FTP site 10 months, 1 week ago #3229

  • admin
  • OFFLINE
  • Moderator
  • Posts: 2182
  • Karma: 12
Steve

There were some issues related to zip object and repository backup.
All of them resolved now
If you have a look at package called "Weekly Repository Backup" it will give an idea how it is done

<Repository Backups>\{LeftString(GETSYSTEMVARIABLE('SYSTEM_DATE'),8)}_log_files.zip

Peter
  • Page:
  • 1
Time to create page: 0.17 seconds

Testimonials

Within an hour we were able  to populate fact and dimension tables in our datawarehouse using Advanced ETL Processor

P. Jonson

User Login

You only need to log in or register to use our support forum



Our customers

BP

BBC

HSBC


Databases we work with

Go to top