In this Article
Overview
This article explains how to configure OneLake as a data source in the DvSum Data Catalog. It covers connection setup using Power BI credentials, workspace selection, asset configuration, and scanning.
Before setting up OneLake as a source in DvSum, please ensure all prerequisites are completed. Refer to the article “Prerequisites and Permissions for DvSum Data Source Configuration.”
OneLake acts as a parent source, allowing you to create and manage multiple data sources such as:
- Power BI
- SQL Database
- Lakehouse
- Warehouse
It also explains how metadata and lineage scans are performed and how discovered assets can be accessed.
Step-by-Step Configuration Guide
1. Add a New Data Source
- Navigate to Administration → Data Sources
- Click ⊕ Add Source
- Select OneLake
- Provide a name for the source and click Save
2. Configure Connection
Once the source is saved, the connection settings page appears.
Refer to the connection screen:
- Enter the following credentials:
- Tenant ID
- Client ID
- Client Secret
- Click Authenticate
3. Select Workspaces & Asset Types
After successful authentication, users can configure workspaces and asset selection.
Workspace Selection
- Option to:
- Scan all workspaces, OR
- Enable “Limit to specific workspaces” and select required ones
- Move workspaces from Available → Selected
Asset Selection
Choose the asset types you want to create from OneLake:
- Power BI (Semantic Models, Reports, Dashboards)
- Lakehouse
- Warehouse
- SQL Database
Important behavior:
- OneLake acts as a parent source
- Selected assets determine which child data sources will be created
Click Done → then Save
How Data Sources Are Created
- Data sources are created per database per workspace
- Example:
- If a workspace has:
- 2 Warehouses → 2 Warehouse data sources will be created
- 1 Lakehouse → 1 Lakehouse data source
- If a workspace has:
- This applies to all selected asset types
Note: Deleting the OneLake source does not delete the data sources that were created from it.
Authentication Behavior
If incorrect credentials are entered:
- The data source can still be saved
- Authentication will fail
- The source will be marked unusable (red indicator)
The source will only function after valid credentials are provided.
4. Scan the Data Source
Navigate to Scan History page.
Click Scan Now
There are two scan options:
Workspace Scan
- Automatically creates corresponding data sources based on selected assets
Deep Metadata Scan
- Retrieves:
- Column schemas
- Data types
- Table structures
Notes:
- Catalog scan is enabled by default
- Lineage scan is optional (can be selected)
Post Scan Behavior for Deep Metadata Scan
- Separate data sources are created for:
- Power BI
- Lakehouse
- Warehouse
- SQL Database
- If both Catalog + Lineage are enabled:
- Scans will run automatically for created data sources
Power BI Behavior
- Power BI sources:
- Do not appear in the listing page
- Run in the background
- However, they can be accessed from:
- Overview Page
Where users can view:
- Semantic Models
- BI Reports
- BI Dashboards
Scan Summary
- Navigate to Scan History
- Click on the Execution ID
The Execution Summary page displays:
- Total number of data sources discovered and scanned
- Breakdown of data sources (e.g., Lakehouses, Warehouses, SQL Databases)
- Summary of BI assets including:
- Semantic Models
- BI Reports
- BI Dashboards
- Count of new and existing assets discovered
0 Comments