NULL Valued fields on DQS

Hi sgilla,

That should not be the case. I tested it specifically on Extended Unification step version 12.6.3 and null values work for me as expected. Can you share your expression for the measure?

For the test I created a new measure testMeasure which should match on null values:

And a new rule TestRule, which rely solely on the measure:

And as expected null values are matched to everything, including the null values.

AKislyakov thank you for trying a test. 

our matching measure is similar

SC_NAME   

 //Something is null
    center.mat_name is null
    or
    slave.mat_name is null,
    1,

and 

SC_NPI if match then 2

So Matching rule is looking for SC_NAME is 1 and SC_NPI is 2

Would having multiple group unions cause issue? As the groups look like

1. Union 1: all records except where Name not like ‘ABC INC’
2. Union 2: Only records with NAME like ‘ABC INC’  

Reason for these groups: They have thousands of similar records and do not want them to be processed along with the main group to improve performance. Every time a similar record ‘ABC INC’ comes in all the similar records are being considered in matching and matched through this separate group. 

The records I have trouble with do not fall in this separate group, thought I mention. 

It shouldn’t be a problem. But are the null values falling to either of these groups?

Depending on how exactly the groupping expressions are written it might be that null values are just lost.

E.g., if you are using something like that for group separation:

Group 1

not matches(".*ABC INC.*", mat_name)

Group 2

matches(".*ABC INC.*", mat_name)

then suddenly mat_name=null will produce the null result and will be ignored by both groups. 

You are right. The nulls are not falling in any of the groups but if I exclude all groups nulls are fine, if I add groups even not related single group, nulls get separated.

And if I don't have groups for these large sets the performance is bad. 

That is a good idea. I will try it out.

Alternative which worked for me is using a temporary mat_name and defaulting Null’s to an alphabet. And this is discarded it later.