During the implementation of Azure Data Factory the question of how to monitor them raises. After a longer discussion we started with the monitoring of Pipeline runs and Triggers. Because they will be created and removed by the business owners without the notice of the IT department I started to automate the management of the monitoring which means:
Automatically add Pipelines and Triggers to monitoring
Automatically delete them from monitoring
Create a new group if needed (name: "Data Factory [Factory name]") to grant the Factory owners access to the metrics
Add new Pipelines and Triggers to the group
Create a new View if needed (name: "DataFactory [Factory name]") to have an overview of the Factory
Add a top Menu called "Cloud" and add the views in it
The outcome was two application templates and a Powershell script.
Each template has one component which does the monitoring. Because SWISS is not (yet) able to add components to an template or application (as far as I know) each trigger and pipeline has it's own application monitor.
What do you have to prepare in front for using the script:
SolarWinds solutions are rooted in our deep connection to our user base in the THWACK® online community.
More than 150,000 members are here to solve problems, share technology and best practices, and directly
contribute to our product development process.
Learn more today by joining now.