HomeForum
Welcome, Guest

Restarting data import
(1 viewing) (1) Guest
Data Warehousing and Data integration
  • Page:
  • 1

TOPIC: Restarting data import

Restarting data import 1 year, 7 months ago #1036

Hello

I am confused which tool can help with my data transformation task

For example a have a flat file containing 2000 lines with a header and a trailer records. There is a problem with line line 1500 so the import fails. Now I want to be able to read from the 1501th line when import is started again instead of starting from the first line.

Please help me,
thanks in advance,
Ralph

Re: Restarting data import 1 year, 7 months ago #1044

  • admin
  • OFFLINE
  • Moderator
  • Posts: 2183
  • Karma: 12
You are probably done a lot work with ms sql server.

Although it is possible specify number of rows to skip the there is no point of doing it
I do not know why you want it, from my point of view the best thing is to write a message into the log and
carry on.

The implementation depends on the target database.

Data can be loaded as part of one big transaction and in case of error the whole transaction will be rolled back,
Or in batches so the batch will be rolled back (for sql server)
or record by record insert record, commit, insert record, commit for(ODBC,OleDB)

It is slightly different for Oracle,Interbase,MySql and PostgreSQL and it is user definable.

For every data target the best possible way of loading the data used

Mike
  • Page:
  • 1
Time to create page: 0.16 seconds

Testimonials

We soon realised that Visual Importer ETL was designed by people who use it everyday.

Mark Brown,
MIS Consultant

User Login

You only need to log in or register to use our support forum



Our customers

BP

BBC

HSBC


Databases we work with

Go to top