HomeForum
Welcome, Guest

ETL Performance Question
(1 viewing) (1) Guest
  • Page:
  • 1

TOPIC: ETL Performance Question

ETL Performance Question 1 year, 2 months ago #2195

  • Todd
  • OFFLINE
  • Fresh Boarder
  • Posts: 18
  • Karma: 0
I’m running Visual Importer ETl Pro. I recently finished development of some Visual Importer jobs on a development machine. I moved these jobs to our test box to test them out. Outside of hardware, the environment is the same.

The problem I’m having is the following:

When I run a job in my development environment, it takes approximately 5 minutes to update/import 28,000 rows. However, when I do it out my test environment, it takes 26 minutes. BIG DIFFERENCE.

Test environment is a more powerful environment than my development environment. The source for both development and test is the same (a FoxPro DB). Target Databases and Visual Importer runs out of the same box on both development and test.

Question is: Is there anything I can look at on Visual Importer to see what is causing the performance difference? I’m a little confused being that test has better/faster hardware, but yet is running A LOT slower.

Your help would be greatly appreciated.
Thank you.
Todd

Re: ETL Performance Question 1 year, 2 months ago #2196

  • admin
  • OFFLINE
  • Moderator
  • Posts: 2191
  • Karma: 12
This is because your production table has got much more data therefore it takes more time find records to update

Peter
  • Page:
  • 1
Time to create page: 0.15 seconds

Testimonials

Visual Importer ETL  saved us 25-30 hours per month. Much of that comes from being able to build in error checking into the scripting. I've even been able to script corrections that run on the fly triggered by the error checking on incoming order files.

Gene Kovacs,
Director of Technical Business Operations,
A2B

User Login

You only need to log in or register to use our support forum



Our customers

BP

BBC

HSBC


Databases we work with

Go to top