HomeForum
Welcome, Guest

Ignore/skip invalid data
(1 viewing) (1) Guest
  • Page:
  • 1

TOPIC: Ignore/skip invalid data

Ignore/skip invalid data 1 year, 2 months ago #1952

  • island
  • OFFLINE
  • Fresh Boarder
  • Posts: 4
  • Karma: 0
Hello,

I trying to migrate some data from one MySql database to another.
The host database is a badly design database with a lot of invalid data. For example, the orders table has
Order_Number(PK) but any type of character could be entered into the column.

I am trying to move data to a new database which the Order_Number field only allows Numeric values.
Now while most values in the old database are in the format of '1234567' there are some rows of data that are corrupted for example 'First Order' and '2XM/56'.
As these orders are not used, I am trying to work out how to bring across only the valid rows of data where the values actually match the integer format and skip any other invalid data.

Any suggestions or directions would be great.
thanks,
ISa

Re: Ignore/skip invalid data 1 year, 2 months ago #1953

  • admin
  • NOW ONLINE
  • Moderator
  • Posts: 2182
  • Karma: 12
This is actually very simple

Use validator together with IsNumber function

All bad data will be rejected or redirected to different data stream

See attached file

Mike
Attachments:

Re: Ignore/skip invalid data 1 year, 2 months ago #1954

  • island
  • OFFLINE
  • Fresh Boarder
  • Posts: 4
  • Karma: 0
All works as expected now

Thank you for your time

ISa
  • Page:
  • 1
Time to create page: 0.15 seconds

Testimonials

Advanced ETL Processor's ability to validate and tranform data without actually loading it into the datawarehouse has saved us a lot of time. We were able to see how data will look like, once it is transformed and which records would fail during data validation.

Antony Clark,
RBS 

User Login

You only need to log in or register to use our support forum



Our customers

BP

BBC

HSBC


Databases we work with

Go to top