Fabric Dataflows Gen2 and Low-Code Data Integration

Instructor: Alaa Hady · Language: English or Arabic · Suggested duration: 1–2 days · Level: Intermediate (Level 200)

Objectives

• Migrate and upgrade legacy Power BI Dataflows (Gen1) and Desktop Power Query logic into Fabric Dataflows Gen2.
• Configure Data Destinations (Lakehouse, Warehouse, Azure SQL, KQL) and staging behavior for high-scale ETL.
• Combine Dataflows Gen2 with Data Pipelines for parameterized, monitored orchestration.
• Optimize Dataflow compute efficiency and staging to control Fabric Capacity Unit (CU) consumption.

Outline and contents

1. Dataflows Gen1 vs. Dataflows Gen2: architectural evolution, compute engines, and migration pathways
2. Authoring Dataflows Gen2 in Fabric: Power Query Online interface, diagram view, and schema management
3. Configuring Output Destinations: writing to Lakehouse Delta tables and Warehouse tables (Append vs. Replace, column mapping)
4. Understanding High-Scale compute: automatic Lakehouse staging, Fast Copy integration, and when to disable staging for small tables
5. Modular ETL design: splitting extraction (Bronze) from transformation (Silver/Gold) dataflows
6. Parameterizing Dataflows Gen2 and invoking them dynamically from Fabric Data Pipelines
7. Incremental refresh and change-data patterns in Dataflows Gen2
8. Monitoring refresh history, diagnosing gateway/connector bottlenecks, and analyzing CU consumption in the Capacity Metrics App
9. Hands-on Lab: Building a multi-source low-code Medallion pipeline using Dataflows Gen2 and Lakehouse destinations

Target audience

Power BI developers, citizen integrators, analytics engineers, and data analysts.

Expected outcomes

Participants can leverage their existing Power Query skills to build enterprise-scale, reusable ETL pipelines that land clean Delta tables directly into Fabric Lakehouses and Warehouses.