KNIME Documentation

Outdated version

This is the documentation for KNIME Analytics Platform version 5.11 - go to the latest version.

Work with Microsoft Fabric Data Warehouse ​

For more complex data work, the KNIME Database (DB) Framework extends what you can do with Microsoft Fabric Warehouses beyond reading Delta tables. It lets you visually assemble SQL statements and push down complex data manipulations directly to the Fabric Data Warehouse compute engine — keeping processing in Fabric rather than loading data into KNIME.

Before you start ​

You need:

Connect ​

Use the Microsoft Fabric Data Warehouse Connector node to connect to a Data Warehouse within Microsoft Fabric.

  1. Add a Microsoft Fabric Data Warehouse Connector node.
  2. Connect the Microsoft Fabric Workspace Connection to its input port.
  3. Execute the node.

The output is a Database connection. Use it in nodes from the KNIME Database extension to query and manipulate data.

Read and modify data ​

  1. Connect the Database connection output from the Microsoft Fabric Data Warehouse Connector to a DB Table Selector node. Select the table you want to query or modify.
  2. Chain DB manipulation nodes to build your query logic visually. Each node builds a SQL query that executes on the Fabric side. Common nodes include:
  3. Add a DB Reader node and execute it to run the assembled query in Fabric and import the result into KNIME.

Alternatively, use a DB Query Reader node to enter a SQL query directly and import the result.

For more on in-database processing, see the KNIME Database Extension Guide.

Load data ​

Use the DB Loader node to write data back to a Fabric Data Warehouse. Unlike the standard DB Writer, it uses database-specific bulk loading, which is significantly faster for large datasets.

The DB Loader requires a temporary staging area for data files. To configure it:

  1. Add the optional file system input port to the DB Loader node.
  2. Set the staging location using the Target folder option in the node configuration.
  3. Connect a file system connector to the optional input port — use the Azure Data Lake Storage Gen2 Connector or the Azure Blob Storage Connector.

INFO

OneLake is not supported as a staging area for the DB Loader node. Use Azure Data Lake Storage Gen2 or Azure Blob Storage instead.

Next steps ​