Monthly Archives: December 2011

Tips & Tricks #12

SCRIPTING DATA INTEGRITY VERIFICATION

I like this convenient way to script the data intergity verification step with added value.

1.  Extract the entire record into a file if any field is not verifiable.

OPEN TESTFILE

EXTRACT RECORD IF NOT(VERIFY(field1) AND VERIFY(field2) AND VERIFY(field3) AND VERIFY(field…)) TO “Review_for_Invalid_Data.FIL”

You can send the records to excel if any data validation errors are found.

IF WRITE1> 0 EXTRACT Field1 Field2 Field3 Field4 XLS21 TO “Data_errors”

2.  Then you can also create the normal verify text file to indicate which fields weren’t verifiable.

OPEN TESTFILE

VERIFY ALL ERRORLIMIT 1000 TO “Data_ErrorsDetail.TXT”

Usually,  just looking at the .fil created by step one will be enough.  You can usually see why a record wasn’t verified, but the text file confirms exactly which fields were invalid.  The audience doesn’t have to know ACL to review an excel and txt file of data validation errors either!