Filter On Bad Meaning

Description

This activity filters values in the specified columns based on predefined “bad meanings.” Users can configure actions to handle rows that contain these unwanted values.

Input

Data

Output

Transformed Data

Configuration Fields

• Meanings Specifies the columns and their corresponding bad meanings to filter rows.

  Bad Meanings Include

  • URL
  • Port
  • IP Address
  • Boolean
  • Text
  • Decimal
  • Integer
  • Date

• Actions Defines the actions for rows with bad meanings.

  Available Actions

  • Remove matching rows
  • Clear content of matching cells
  • Keep matching rows
  • Flag rows
  • Clear content of non-matching cells

• FlagRowsAction Specifies the method to flag the rows. (Rendered when “Action” is “Flag rows”)

• FlagRowsColumnName Name of the new flag column. (Rendered when “Action” is “Flag rows”)

Sample Input

ID	Column1	Column2	OtherColumn
1	http://example.com	TRUE	Value A
2	192.168.1.1	42	Value B
3	ValidText	FALSE	Value C

Sample Configuration

Sample Output

ID	Column1	Column2	OtherColumn	BadDataFlag
1	http://example.com	TRUE	Value A	0
2	192.168.1.1	42	Value B	1
3	ValidText	FALSE	Value C	1