Activities
The monitoring capability of Activities allows you to keep track of time series information relating to assets in the catalogue.
There are four types of Activities:
- For Data Pipelines, you can view the execution time of jobs and tasks.
- For Cloud Resources, you can view the compute time and cost.
- For Data Quality Rules, you can view the number of outstanding items or anomalies to resolve.
- For Sources, you can view the status of metadata synchronization jobs.
Activity Types
You can view these activities by selecting the type you want to view from the left-hand navigation.
Each type provides different information about the asset and its activity.
Data Pipeline Execution
You can view the execution time of jobs and tasks under Activities, and then select Data Pipeline Execution.
You can view when each job in Loome Integrate and ADF pipelines were run, and their status of success, failure or in progress, as well as any tags and attributes.
You can view the duration variance of each execution. The duration variance of each data pipeline execution is compared to its first execution. So it will be the variance from the average. For example, using this column you can learn if a job took 30s longer than it usually does.
Click on the dropdown beside a job to view more details about each job execution and then each task execution.
Resource Usage
You can view the usage of resources in Loome Assist, such as the compute time and cost of resources, under Activities, and then select Resource Usage.
You can view their status, timestamp, usage amount and unit, as well as any tags and attributes by scrolling across the row of an asset.
For example, the cost of resources can be viewed in the ‘Amount’ and ‘Unit’ columns.
Quality Rule Execution
You can view the number of outstanding items or anomalies to resolve in rule executions from Loome Monitor. You can view this under Activities, and then select Quality Rule Execution.
This table will display the most recent rule executions, its status of whether it was a success, failure or in progress, and the amount of actions required for each rule, as well as any tags and attributes on the asset.
The ‘Action Required’ column and ‘Non-action Items’ column display how many records in a rule require action and how many records were resolved or require no actions.
Click on the dropdown beside a rule to view each execution activity.
System Syncs
This page will show system sync activity for all sources in the Portal, such as the status of metadata synchronization jobs, under Activities, and then select System Syncs.
This table will display the most recent information for a source system sync, its status of whether it was a success, failure or in progress, the message about its status, and whether it is enabled, as well as any tags and attributes on the asset.
Sync History
Click on the dropdown of a source and you can view the system sync history of the source.
It will display past system syncs and their statuses.
The same actions listed above are also available for these individual past syncs.
Actions
To view the executions at an asset’s source, click View Executions.
To edit a rule found in the rule executions, you can click on Edit Rule.
You can click on View System Syncs to view the Systems sync of your chosen source system.
Click on Manage Tags to manage the tags of a source system asset. You can add and remove tags on your chosen asset.
To view information about a job execution, resource, rule execution, system sync, such as basics, metadata and attributes, click on Info beside the asset’s activity row.
To create and view discussions about a sync, click on Discussions.
