Activities
The monitoring capability of Activities allows you to keep track of time series information relating to assets in the catalogue.
There are four types of Activities:
- For Data Pipelines, you can view the execution time of jobs and tasks.
- For Cloud Resources, you can view the compute time and cost.
- For Data Quality Rules, you can view the number of outstanding items or anomalies to resolve.
- For Sources, you can view the status of metadata synchronization jobs.
On this page, learn about:
Activity Types
You can view these activities by selecting the type you want to view from the left-hand navigation.
Each type provides different information about the asset and its activity.
Data Pipeline Execution
You can view the execution time of jobs and tasks under Activities, and then select Data Pipeline Execution.
You can view when each job in Loome Integrate and ADF pipelines were run, and their status of success, failure or in progress, as well as any tags and attributes.
You can view the duration variance of each execution. The duration variance of each data pipeline execution is compared to its first execution. So it will be the variance from the average. For example, using this column you can learn if a job took 30s longer than it usually does.
Click on the dropdown beside a job to view more details about each job execution and then each task execution.
Resource Usage
You can view the usage of resources in Loome Assist, such as the compute time and cost of resources, under Activities, and then select Resource Usage.
You can view their status, timestamp, usage amount and unit, as well as any tags and attributes by scrolling across the row of an asset.
For example, the cost of resources can be viewed in the ‘Total Amount’ and ‘Unit’ columns.
In hierarchy view, you can click on the dropdown in the ‘Asset Type’ column for each asset and it will display further information about its activity on individual days.
The overall row will display the last updated date and the total sum of the spend for the asset at that date.
When an asset is expanded, the table will also display the spend of this asset per day. So there will be a row for each day it was used with the spend of that day.
Quality Rule Execution
You can view the number of outstanding items or anomalies to resolve in rule executions from Loome Monitor. You can view this under Activities, and then select Quality Rule Execution.
This table will display the most recent rule executions, its status of whether it was a success, failure or in progress, and the amount of actions required for each rule, as well as any tags and attributes on the asset.
The ‘Action Required’ column and ‘Non-action Items’ column display how many records in a rule require action and how many records were resolved or require no actions.
Click on the dropdown beside a rule to view each execution activity.
System Syncs
This page will show system sync activity for all sources in the Portal, such as the status of metadata synchronization jobs, under Activities, and then select System Syncs.
This table will display the most recent information for a source system sync, its status of whether it was a success, failure or in progress, the message about its status, and whether it is enabled, as well as any tags and attributes on the asset.
Sync History
Click on the dropdown of a source and you can view the system sync history of the source.
It will display past system syncs and their statuses.
The same actions listed above are also available for these individual past syncs.
Actions
To view the executions at an asset’s source, click View Executions.
To edit a rule found in the rule executions, you can click on Edit Rule.
You can click on View System Syncs to view the Systems sync of your chosen source system.
Click on Manage Tags to manage the tags of a source system asset. You can add and remove tags on your chosen asset.
To view information about a job execution, resource, rule execution, system sync, such as basics, metadata and attributes, click on Info beside the asset’s activity row.
To create and view discussions about a sync, click on Discussions.
Activity Views
Similar to the Catalogue, you can view activities in a table, hierarchical table, or as cards.
Activity View Types
Using the first dropdown at the top-right of your current view, you can choose between:
- Card: Activities will display in card form.
- Table: This will display all activities in a table.
- Hierarchy: This will display all activities in a table but will also create a hierarchy within the table. Each activity type will display its own type of information in the dropdown; learn more above in each activity type.
Creating a View
You can follow the same steps as when creating a catalogue view to create an activity view.
After you have applied one or more filters, you can create a new view by clicking on Manage Views at the top-right of your table.
Click on Save as new view.
Provide a name for this view and choose to add an audience.
To add an audience, type in a user’s name and then select it from the dropdown.
Click on Save and the view’s name will be displayed at the top of the page.
You can also choose other views from the dropdown beside the title of the view.
Manage a View
You can manage a view using the Manage Views dropdown at the top-right of activities.
After you have applied filters and made changes to the activities displayed, you can save your current view, or save a new view.
In the dropdown, you can also edit a view and delete a view.
You can reset the view of your activities at the top-right.