Configure Azure SQL & Azure Synapse Analytics

In this Article:

1. Overview
2. Prerequisite: Enable Query History via Query Store
3. Step-by-Step Configuration
   • Step 1: Adding a Databricks Source in DvSum
   • Step 2: Configure Source
   • Step 3: Scan Data Source
   • Step 4: Review Data Dictionary
4. Video Tutorial
5. Additional Resources

Overview:

This article outlines the process of configuring Azure SQL or Azure Synapse Analytics as a data source in DvSum, enabling integration for data cataloging and profiling. The steps provided apply to both DvSum Data Insights (DI) and DvSum Data Quality (DQ), with only minor variations based on the specific platform.

Prerequisite: Enable Query History via Query Store

Before proceeding, ensure that Query Store is enabled on your Azure SQL Database or Azure Synapse Analytics instance. Query Store captures query history, which is required for lineage tracking and usage insights in DvSum. For detailed steps, refer to the article Enabling Query History for Data Sources. For step-by-step instructions on creating users, configuring Query Store, and setting up required permissions, refer to Azure SQL & Azure Synapse Analytics User Setup and Query Store Configuration for Metadata Extraction

You can follow the steps mentioned below to configure and authenticate a Azure SQL or Azure Synapse Analytics source:

Step by Step Configuration

Step 1: Adding a Databricks Source in DvSum

1. Navigate to Administration → Data Sources in DvSum. 
2. Click "⊕ Add Source" to open the wizard.
3. Select the appropriate Data Source Type. 
4. Enter a name for the data source. 
5. Click Save. 

2. Configure Source 

1. The Connection tab opens automatically after saving. 
2. Alternatively, navigate to: Administration → Data Sources → Settings → Connection. 
3. Click Edit and configure the connection details:  

•  
  •  
    • Server Name 
    • Database Name 
    • Authentication 
    • Click Authenticate to test the connection. 
    • After authentication, select a database and optionally, specific schemas. 
    • Click Done and Save to complete the process. 

Note: When adding or editing a Data Source, if incorrect details or invalid credentials are entered, it will still allows to save the Data Source. However, authentication will fail, and the Data Source will be marked as unusable with a red icon. The Data Source will not be usable until the correct credentials are provided.

The connection is saved, but it cannot be used until valid authentication details are updated.

3. Scan Data Source 

1. Navigate to Administration → Data Sources → Scan History. 
2. Click "Scan Now" to perform an initial scan. 
3. The scan will progress from Scheduled → Running → Completed.
4. After completion, click the Scan Name to open the Scan Summary. 
5. Review the scan insights 

4. Review Data Dictionary 

1. Navigate to Data Dictionary in the DvSum menu. 
2. Click on the "Recently Refreshed" tab to find recently scanned tables. 
3. Click on the table name for detailed information. 

Video tutorial:

Watch this quick video tutorial on how to add and configure an Azure Data Source into DvSum app.

Additional Resources

Read more about DvSum Web Service (Cloud SAWS)

Read more about DvSum Edge Gateway (On-Premises SAWS)