Overview
In Data Intelligence (DI), rules help validate, cleanse, and monitor data quality. Instead of running all rules at once, you may need to execute specific rules explicitly based on certain conditions to improve efficiency and optimize performance.
By applying filters in the Data Quality (DQ) Dictionary, you can isolate and execute only the necessary rules, reducing processing time and focusing on relevant data validation.
Steps to Run Rules Explicitly Using Filters
Step 1: Navigate to the DQ Dictionary Page
Open the DQ Dictionary section within your DI environment.
This section contains all configured Data Quality (DQ) rules in DI.
Navigate through the menu or search for DQ Dictionary in the search bar.
Step 2: Apply Filters to Isolate Specific Rules
Use the search bar or filtering options to locate specific rules you need to run.
-
You can filter rules based on attributes such as:
Rule ID
Rule Name
Rule Type
Status (Active, Inactive, etc.)
Example: If you need to run DQ-0001234 and DQ-0005678, apply a filter to display only these rules.
After filtering, only the relevant rules will be listed, ensuring that unnecessary rules are excluded.
Step 3: Select the Rules
Once the desired rules are displayed, select them by clicking the checkbox next to each rule.
Ensure that only the required rules are selected before proceeding.
Selected rules will remain highlighted until you execute them or deselect them manually.
Step 4: Execute the Rules Using 'Run Rule'
After selecting the rules, click the "Run Rule" button located at the top right of the page.
A dropdown menu will appear with two execution options: Run Online, Run Offline.
Execution Mode |
Description |
Run Online |
Executes the rule instantly and provides real-time results. |
Run Offline |
Runs the rule in the background (via a scheduler). Results will be available after execution is complete. Execution status can be checked later in the Job section. Recommended for large datasets or when running multiple rules simultaneously. |
Note:
Use "Run Online" for quick rule validation when working with small datasets.
Use "Run Offline" for processing large datasets to prevent UI disruptions.
Apply precise filters to ensure only necessary rules are executed.
Regularly monitor execution logs to identify trends and recurring issues in rule execution.
0 Comments