---
title: Creating Data Quality
description: Creating Data Quality
---
import { Aside, Steps } from '@astrojs/starlight/components';
import { MediaPlayerComponent } from "../../../../components/video-player";
import RunScript from "../../../../components/RunScript.astro";

# Creating Data Quality

<MediaPlayerComponent 
video="new-data-quality-video.mp4"
 chapters={[
{ "start": 0, "end": 4, "text": "Click on Catalogue", "description" : "Click on Catalogue in the top menu, then select Assets from the sidebar. After that, click on Datasource to view available datasources." },
{ "start": 4, "end": 7, "text": "Search for Datasource", "description" : "Click on Search Assets, type the datasource name, and choose the respective datasource from the filtered results."},
{ "start": 7, "end": 12, "text": "Add Documentation to Asset" , "description" : "Click the New documentation button. Enter the content and then click Save." },
{ "start": 12, "end": 16, "text": "Click on Data Quality under Automation", "description" : "Click on Automation and select Data Quality" },
{ "start": 16, "end": 29, "text": "Create New Data Quality Setup" , "description" : "On the Data Quality page, click New Data Quality. In the pop-up, confirm the connection, click the Select table dropdown, select the table, and click Next."},
{ "start": 29, "end": 36, "text": "Generate AI-Powered Data Quality Rules", "description" : "Click Generate rules. Wait for the AI to analyze and list suggested rules. Once visible, click Generate tests." },
{ "start": 36, "end": 50, "text": "Review and Save Rule Configuration", "description" : "Review the generated rules, make adjustments, or explore options like Schedules. Click Save in the top right corner."},
{ "start": 50, "end": 55, "text": "Execute Data Quality Rules" , "description" : "Click the Execute button in the top right. Confirm by clicking Execute again. The system will run the defined data quality rules against your data." },
{ "start": 55, "end": 67, "text": "View Data Quality Summary", "description" : "The summary page will display progress and initial results. Then, click the Data Quality breadcrumb link to go back to the Data Quality page." },
{ "start": 67, "end": 77, "text": "View Detailed Data Quality Report" , "description" : "Click View Summary on the card to see the full data quality report."}, 
]}
poster="/images/introduction-poster.png"
posterText="Creating Data Quality"
client:load/>

This section provides you with comprehensive guidance and support for navigating and using the Infoveave Data Quality creation features effectively.

## Creating Data Quality Manually

![Data Quality Manually](/images/Data-Quality/Creating-Data-Quality/choose-data-quality.png)

<Steps>
1. You begin the process by clicking the **New Data Quality** button.
2. This action opens a dialog box where you can select a specific data quality type (such as **Data Quality using AI** or **Data Quality**) by using the toggle button before proceeding to the next step.
3. After selecting the data quality type, select the connection and table to be used for the data quality checks. Then click on **Next**.  
![Data Quality setup](/images/Data-Quality/Creating-Data-Quality/data-quality-setup.png)
4. On the **Data Quality Setup** tab, enter the name and description of the Data Quality.  
![column panel](/images/Data-Quality/Creating-Data-Quality/data-quality-columns.png)
5. Drag a column from the **Columns** tab to the designer.  
![addrule](/images/Data-Quality/Creating-Data-Quality/addrule.png)
6. Click on the **+ Add rule** button to add and configure rules.  
![Data Quality Add Rule](/images/Data-Quality/Creating-Data-Quality/data-quality-add-rule.png)
7. On the rule setup screen, you can select rules for data quality. These rules include checks such as accuracy, completeness, and validity.  
![configurerule](/images/Data-Quality/Creating-Data-Quality/configurerule.png)
8. Select the **Primary key columns** from the dropdown. It is a unique key used to track failed records.
9. You can also select the **Segment columns** to apply filters.
10. Click on **Save**. Once saved, configure each rule and click on the **Validate** button.  
![validate-rules](/images/Data-Quality/Creating-Data-Quality/validate-rules.png)
11. After configuring and validating all the rules, click on the **Validate rules** icon to view the validation results.
12. Once the validation is complete, the results are displayed in a table that shows the success percentage and other details about the rule configurations. If needed, you can tweak the rules and validate them again.
13. After validating the rules, click on **Save** to save the configuration.
14. The final step is to **Execute** Data Quality. This runs the configured data quality checks.  
![DQ execute](/images/Data-Quality/Creating-Data-Quality/dqexecute.png)
15. The execution of the data quality check displays the results in a table. It shows various details such as success rates for different rules. You can monitor the progress and ensure that the data quality checks are successfully completed.  
![schedules-data-quality](/images/Data-Quality/Creating-Data-Quality/schedules-data-quality.png)
16. You can also schedule your Data Quality execution under the **Schedules** tab. After adding the schedule, click on **Save**.
</Steps>

## Creating Data Quality Using AI

![data quality using ai](/images/Data-Quality/Creating-Data-Quality/data-quality-using-ai.png)

<Steps>
1. You begin the process by clicking the **New Data Quality** button.
2. In the resulting dialog box, enable the toggle **AI enabled**.
3. After selecting the data quality type, select the connection and table to be used for the data quality checks. Then click on **Next**.  
![aigenerateddescription](/images/Data-Quality/Creating-Data-Quality/aigenerateddescription.png)
4. An AI-generated description is auto-filled in the resulting pop-up. You can also choose to share Catalogue information with AI by checking the displayed checkbox. Click on the **Generate Data Quality Rules** button.  
![aigeneratedrules](/images/Data-Quality/Creating-Data-Quality/aigeneratedrules.png)
5. AI generates the data quality rules for the selected dataset. This ensures that the data meets specified standards and is ready for further analysis.  
   - The relevant **Column name** for each rule is specified, ensuring that the validation is applied accurately.  
   - Each rule is accompanied by a **Citation and Rule Group**. These explain the rule's purpose, such as ensuring uniqueness, non-null values, or the correct format for columns like IDs or dates.  
   - Each rule is assigned a unique **Rule name** and a **Rule type**. Once reviewed, the rules can be applied to the data by clicking on **Generate Data Quality**, which enforces the specified checks across the dataset.  
![automaticnameanddesc](/images/Data-Quality/Creating-Data-Quality/automaticnameanddesc.png)
6. The Data Quality name and description are auto-generated by AI.  
![addrule-ai](/images/Data-Quality/Creating-Data-Quality/addrule-ai.png)
7. Select the **Primary key columns** from the dropdown. It is a unique key used to track failed records.
8. You can also select the **Segment columns** to apply filters.
9. Click on the **Save** button. After saving, you can **Validate** each rule.  
![validate-all-ai](/images/Data-Quality/Creating-Data-Quality/validate-all-ai.png)
10. After validating each rule, click on the **Validate rules** icon to view the validation results.
11. Once the validations are completed, the results are displayed in a green table. This table shows the success percentage and other details about the rule configurations. If needed, you can tweak the rules and validate them again.
12. After validating the rules, click on **Save** to save the configuration.
13. The final step is to **Execute** Data Quality. This runs the configured data quality checks.  
![ai-execute](/images/Data-Quality/Creating-Data-Quality/ai-execute.png)
14. The execution of the data quality check displays the results in a table. It shows various details such as success rates for different rules. You can monitor the progress and ensure that the data quality checks are successfully completed.  
![schedule-ai](/images/Data-Quality/Creating-Data-Quality/schedule-ai.png)
15. You can also schedule your Data Quality execution under the **Schedules** tab. After adding the schedule, click on **Save**.
</Steps>