Fabric Data Warehouse Writer
Microsoft Fabric is an all-in-one analytics platform created for businesses and data professionals. The platform handles everything from data science and real-time analytics to data storage and data migration.
All of the data utilized within Fabric is stored in OneLake. OneLake is a single, unified, logical data lake that’s responsible for supporting all of the Fabric workloads. OneLake is built on top of Azure Data Lake Storage (ADLS) Gen2 and can support any type of file, structured or unstructured. All Fabric data items like data warehouses and lakehouses store their data automatically in OneLake in Delta Parquet Table format. On the other hand, raw files (unstructured) can be stored under the "Files" folder in the OneLake storage (see Fabric Lakehouse File Writer).
Fabric Data Warehouse Writer is a target adapter that writes to the SQL endpoint of the Microsoft Fabric Data Warehouse tables. It uses ADLSGen2 as the temporary staging location before copying the data to the Fabric Data Warehouse tables.
Fabric Data Warehouse Writer summary
APIs used/data supported | Uses the SQL endpoint of the Microsoft Fabric Data Warehouse to write data to tables. |
Supported formatters | Formatters are not supported with this writer. |
Supported sources | All sources supported by Striim that generate WAEvent and typed events. See Readers overview. |
Security and authentication | Supports authentication using Entra ID (formerly Azure Active Directory), Microsoft Entra service principal, Active Directory Password with Fabric username and password, or manual OAuth. |
Resilience / recovery |
|
Performance | Supports parallel threads for improved performance in some circumstances. See Creating multiple writer instances (parallel threads). |
Programmability |
|
Metrics and auditing | Key metrics available through Striim monitoring. See Data warehouse monitoring metrics. |
Typical use case and integration
Data engineers can stream data into a Fabric Data warehouse and provide access to business teams to generate Power BI dashboards for insights.