Not Null Check
The Not Null Check rule verifies that specified columns contain the required number of non-null values.
This rule is commonly used to:
- Ensure mandatory fields like customer names or product prices are populated
- Validate data completeness in critical reporting fields
- Detect missing values in essential business columns
Example Usage:
- Confirm that all customer records have
Email
addresses - Check that at least 95% of
ProductCode
entries are not null
Configuration Fields
Success Criteria Configuration
This section defines how the rule’s outcome is measured against expected thresholds.
Field Name | Description | Required | Options / Format |
---|---|---|---|
Operator | Comparison operation for non-null value count | Yes | GreaterThan , LessThan , EqualTo , Between |
Threshold Value | Value for comparison (single value for most operators) | Conditional | Number |
Threshold Min | Minimum value (for Between operator) | Conditional | Number |
Threshold Max | Maximum value (for Between operator) | Conditional | Number |
Is Percentage | Whether the threshold represents a percentage of total rows | No | true / false (default: false ) |
Sample Input Data
ID | Name | Age | |
---|---|---|---|
1 | Alice | 25 | [email protected] |
2 | Bob | 30 | [email protected] |
3 | Charlie | NULL | [email protected] |
4 | David | NULL | NULL |
5 | NULL | NULL | [email protected] |
Sample Configurations
Example 1: Absolute Count Check
Configuration Field | Value |
---|---|
Column | Name |
Operator | EqualTo |
Threshold Value | 4 |
Is Percentage | false |
Explanation:
Validates that exactly 4 Name
values are non-null.
Example 2: Percentage Range Check
Configuration Field | Value |
---|---|
Column | |
Operator | Between |
Threshold Min | 70 |
Threshold Max | 100 |
Is Percentage | true |
Explanation:
Validates that between 70% and 100% of Email
values are non-null.
Sample Output
Column Name | Rule Name | Success Count | Failure Count | Within Threshold |
---|---|---|---|---|
Name | Not Null Check | 4 | 1 | Yes |
Age | Not Null Check | 2 | 3 | No |
Not Null Check | 3 | 2 | No |