Shared Azure Data Factory Workload
Overview
A Shared Azure Data Factory ("ADF")[1] workload represents an ADF instance intended for sharing an integration runtime ("IR")[2] with other Functional Data Workloads. This is especially helpful when using a self-hosted IR for accessing resources behind a corporate firewall. A single self-hosted IR can be configured and centrally managed to provide the service as a product to teams within the organization.
By itself, this workload can also be used as a standalone ADF, however, it is recommended to start with our Functional Data Workloads to try and meet the requirements of the application.
Configuring this workload scaffolds the infrastructure-as-code to deploy an Azure Data Factory instance.
Architecture
Capabilities
Add-ons
Diagnostic Logging
The Diagnostic Logging Add-on is automatically configured upon adding a Logging Link. This add-on enables diagnostic logging for ADF, backed by the linked Log Analytics[3] workspace.
Links
Logging Link
A Logging Link collects the necessary information from the linked Log Analytics workspace and triggers the provisioning of the Diagnostic Logging Add-on.
Ports
Integration Runtime Port
An Integration Runtime Port enables the connection of one or more Data workloads to allow the sharing of an integration runtime hosted by the Shared ADF instance. Establishing a Link to this Port grants access to the linking Service to reference the integration runtime in its configuration.
Use Cases
- Central management of a self-hosted integration runtime among multiple Data Workloads owned by various teams within an organization
- Use of a standalone ADF instance for authoring and executing data pipelines