Not Null Check Rule
Description
The Not Null Check rule ensures that a specific column does not contain null values. This rule runs on a single column and verifies whether the values meet the configured success criteria.
Configuration Fields
-
Operator Options
Greater than
Less than
Equal to
Between
(requires specifying a start and end range)
-
Operator Defines the comparison operation (Greater Than, Less Than, Equal To, or Between).
-
Value The threshold value used for success criteria. Required for
Greater than
,Less than
, andEqual to
operators. -
Value Range Required only when the
Between
operator is selected, specifying thestart
andend
range. -
Threshold Type Indicates whether the
Value
orValue Range
to be considered as percentage or an absolute count. -
Allow Null Values Determines if null values are permitted.
Success Criteria
The success criteria are evaluated based on the number of non-null values in the column:
- If the column has N rows, the number of non-null values is counted.
- The success condition is met if this count satisfies the given
operator
andvalue
. - For example, if
operator
isGreater than
andvalue
is5
, then the column must have more than 5 non-null values to be within the threshold.
Sample Input
ID | Name | Age |
---|---|---|
1 | Alice | 25 |
2 | Bob | 30 |
3 | Charlie | NULL |
4 | David | NULL |
5 | NULL | NULL |
Sample Configuration
- Operator Between
- Value Range
Start
= 3,End
= 5 - Threshold Type Absolute Count
- Allow Null Values Not Applicable
Sample Output
Column Name | Rule Name | Success Count | Failure Count | Within Threshold | Null Count |
---|---|---|---|---|---|
Name | Name Age Not Null Check | 4 | 1 | Yes | 0 |
Age | Name Age Not Null Check | 2 | 1 | No | 3 |