13th of April, 2023

Service

New Features

Major enhancement to roles and permissions

We have significantly reworked roles and permissions within Loome Monitor to provide a more secure experience for teams operating within a tenant. We now provide security at the project level, allowing you to control what users can see and edit within your tenant.

We have removed the ‘Author’ role at the tenant level and replaced it with the ‘Project Creator’ role. This allows an Administrator to choose which users are allowed to create their own projects. Optionally you can choose to only allow Administrators to perform this function.

At the project level, we have added the following roles.

  • Owner – Assigning a user to this role will allow them to perform all roles within a project, including assigning users to roles within a project.
  • Contributor – Assigning a user to this role will allow them to create and edit rules within a project, this is like the previous Author role, but limited to that project.
  • Member – Assigning a user to this role will allow the user to see and edit all row data within rules in that project.
  • Limited Member – This is not an editable role but will now show you users that have been communicated/assigned to in a rule(s) within your project. Previously you could not see this via the UI.

In addition, as an Administrator you can now limit connections to be available to certain projects only. This is useful for sensitive connections that should not be used by other teams. Project members can still create their own connections, and by default these connections will only be available to the project they were created in.

As part of the migration process, all existing Authors will be moved to the Project Creator role at the tenant level, and to Project Owner role at the project level. You can then remove users from projects as you see fit.

Created by and Modified By

We have now added the ability for Loome Monitor to store the user who created or updated a row(s) in a Monitor rule. This will provide the ability to audit and track who is making changes to row data. This applies to.

  • New records coming in via running a rule interactively in the UI.
  • When the rule is run on a schedule from Integrate, the Created By/Modified By will show ‘System Account’.
  • Custom fields or manual rule data being edited in the UI.
  • Importing new or updated records via Excel Import.

The Created By and Updated By fields are present but hidden in the results view, you can use the column selector to show these fields and view the user making changes. You will need to update your agent and re-run the rule before this data will begin being tracked. Existing data will not be updated with a user.

Custom lockout of row editing

We have now added the ability for you to lock rows within your rules (source data rules only) in Loome Monitor. You can supply a boolean field in your source query and then configure this column as the lockout column. When the field is true, users will not be able to edit that row in the UI. When the value is false, they will be able to edit the row.

Azure Batch improvements

We have added several improvements to the Azure Batch task in Loome Integrate.

  • You can now use auto scale formulas with Azure Batch Pool by providing a autoscaling_formula parameter on the Azure Batch task. In addition, you can optionally provide a Auto Scale evaluation value by providing the autoscaling_evaluation task parameter.
  • Task parameters are now present on Azure Batch tasks and are added to the top of your Azure Batch script at runtime as environment variables.
  • Azure Batch tasks will now run as pool admin by default.
  • You can now specify a custom image on an Azure Batch Pool Cluster Definition rather than by the task parameter on an Azure Batch task, this will allow you to configure this once per Cluster Definition rather than on each task.

Improvements

  • Monitor: Alphabetized the top right menu.
  • Monitor: Improved performance of UI and API.
  • Monitor: Improved security of OAuth login process.
  • Monitor: Improved performance of notifications service.
  • Monitor: Added the ability to communicate how many new records are present in a rule by adding a new draggable token to the communications screen.
  • Monitor: The new connection slideout will now default to the first online agent.
  • Monitor: Added a tooltip to the rule description on the rules list within a project, this will show the entire description on mouse over.
  • Monitor: Changed the excel export page to default exporting with the current view, you can uncheck to export the default view.
  • Integrate: Alphabetized the top right menu.
  • Integrate: Improved the error message returned when you run a Monitor Rule task for a rule that no longer exists in Monitor.
  • Integrate: You can now resize the message column on logging.
  • Integrate: Users can now download log files in JSON format from the UI while viewing logs.
  • Integrate: Improved performance of UI and API.
  • Integrate: Improved security of OAuth login process.
  • Integrate: Improved performance of logging service.
  • Integrate: Improved performance of notifications service.
  • Integrate: Added incremental support to MYOB online instances.
  • Integrate: Job emails are now part of the notifications system. They will now be sent via email and as in-app notifications, depending on notification settings configured on a job.
    • You can opt out of receiving these via in-app, email, or both from the notification settings button on the notifications slide out.
  • Integrate: Monitor tasks in Integrate will now store the Project Id and Rule Id rather than the Project Name and Rule Name. This will mean that you can rename projects and rules without breaking Monitor tasks in Integrate.
    • You will need to update to the latest agent for this to work.
    • Old agents will continue to use Project Name and Rule Name successfully.
    • When you update your agent, you need to do one of the following.
      • Edit each task and save it.
      • Let Loome know so they can migrate the data for that tenant in the background (if you have lots of tasks).
  • Assist: Alphabetized the top right menu.
  • Assist: Improved performance of UI and API.
  • Assist: Improved security of OAuth login process.
  • Assist: Improved performance of notifications service.
  • Assist: Changed Assist to only query spend data for deleted solution collections for 48 hours after deletion.
  • Assist: A number of system generated email events are now part of the notifications system. They will now be sent via email and as in-app notifications.
    • You can opt out of receiving these via in-app, email, or both from the notification settings button on the notifications slide out.
    • The following email events are now part of the notifications system.
      • Budget alerts.
      • Workstation notification.
      • Project role modification.
      • New solution collection repository key generated.

Fixes

  • Monitor: Fixed an issue where user sourced datetime columns were treated as UTC values and converted in the UI for display, dates will be displayed as is with no conversion now.
  • Monitor: Fixed an issue where you would be stuck on a blank screen if you were trying to edit a row when another user runs the rule again.
  • Monitor: Fixed an issue where Mismatches on a reconciliation rule showed the left hand value in both left hand and right hand sides.
  • Monitor: Fixed an issue where the key icon did not display on manual reference rules for key columns.
  • Monitor: Fixed an issue where you could not update a project with the same name but different casing.
  • Integrate: Fixed an issue where the logs page would be intermittently stuck on ‘loading’.
  • Integrate: Fixed an issue where some users could not switch tenants.
  • Integrate: Fixed an issue where you could submit a SQL spark task without the required connection.
  • Integrate: Fixed an issue where some users could not reach the file definitions page.
  • Integrate: Fixed an issue where a job would be stuck in progress after an agent crash.
  • Integrate: Fixed an issue where the docker link for agent was pointing to an old instance of the agent.
  • Integrate: Fixed an issue where log messages appeared twice if the Loome Agent was offline for part of a job execution.
  • Assist: Fixed an issue with the az agent installation command when installing an agent.

Agent

This update requires agent version - 2023.04.12.1

Please download a new install script and update your agent to use new features, improvements, and fixes.

New Features

  • Monitor: We have added Created By and Updated By fields to results tables. To use Created By and Updated By you will need to update your agent. Read more above.
  • Monitor: We have added Custom Lockouts. To use Custom Lockouts you will need to update your agent. Read more above.
  • Integrate: We have added many new features to Azure Batch tasks. To use these improvements you will need to update your agent. Read more above.

Improvements

  • Monitor: Added the ability to specify an alternative log file path and/or specify debug level logging by adding the following to the appsettings.json of the agent. These settings will be added to the agent installation wizard in a future release.
    • You can combine the path setting with an attached file share to an Azure Container Instance to send log files to an Azure file share for easy retrieval see documentation.
    //Both Path and Level are optional settings, you need only specify the value you want
    logging: {
        path: 'c:\\logs',
        level: 'Information' //Where level could be Error, Warning, Information, Debug
    }
  • Integrate: Improved the error message returned when you run a Monitor Rule task for a rule that no longer exists in Monitor.
  • Integrate: Updated the XERO connector to support the latest API additions.
  • Integrate: Added incremental support to MYOB online instances.
  • Integrate: Added support for the RECORD data type in Google BigQuery, this will support exporting Google Analytics 4 data via Google BigQuery into SQL Server.
  • Integrate: Monitor tasks in Integrate will now store the Project Id and Rule Id rather than the Project Name and Rule Name. This will mean that you can rename projects and rules without breaking Monitor tasks in Integrate.
    • You will need to update to the latest agent for this to work.
    • Old agents will continue to use Project Name and Rule Name successfully.
    • When you update your agent, you need to do one of the following.
      • Edit each task and save it.
      • Let Loome know so they can migrate the data for that tenant in the background (if you have lots of tasks).
  • Integrate: Updated how much information is logged to log files on the Loome Agent when it cannot contact the logging server to reduce the disk space used.
  • Integrate: Added the ability to specify an alternative log file path and/or specify debug level logging by adding the following to the appsettings.json of the agent. These settings will be added to the agent installation wizard in a future release.
    • You can combine the path setting with an attached file share to an Azure Container Instance to send log files to an Azure file share for easy retrieval see documentation.
    //Both Path and Level are optional settings, you need only specify the value you want
    logging: {
        path: 'c:\\logs',
        level: 'Information' //Where level could be Error, Warning, Information, Debug
    }
  • Assist: Improved creation of storage accounts by enabling minimum TLS of 1.2, Secure transfer required, and disabling public blob access by default
  • Assist: Added the ability to specify an alternative log file path and/or specify debug level logging by adding the following to the appsettings.json of the agent. These settings will be added to the agent installation wizard in a future release.
    • You can combine the path setting with an attached file share to an Azure Container Instance to send log files to an Azure file share for easy retrieval see documentation.
    //Both Path and Level are optional settings, you need only specify the value you want
    logging: {
        path: 'c:\\logs',
        level: 'Information' //Where level could be Error, Warning, Information, Debug
    }

Fixes

  • Monitor: Fixed an issue where you could not use a custom list field as part of a manual rule key.
  • Monitor: Fixed an issue where the Monitor agent did not work with proxies.
  • Monitor: Fixed an issue where adding a new column in an excel export did not import all rows when importing the spreadsheet back in to a rule.
  • Monitor: Fixed an issue where the Loome Agent might crash while trying to log while offline.
  • Monitor: Fixed an issue where excel import to a monitor rule would fail if columns contained underscores.
  • Monitor: Fixed an issue where rows were duplicated in the LM__MAPPING when updating a rule or project name, they will now correctly update the existing rule record.
  • Monitor: Fixed an issue where Excel Import would not update custom fields where the custom field has a space in the field name.
  • Integrate: Fixed an issue where the Loome Agent might crash while trying to log while offline.
  • Integrate: Fixed an issue where a job would be stuck in progress after an agent crash.
  • Integrate: Fixed a gateway timeout issue on the MYOB connector for online instances.
  • Integrate: Fixed an issue where users could not import data from an on-premises MYOB instance.
  • Integrate: Fixed an issue where log messages appeared twice if the Loome Agent was offline for part of a job execution.
  • Assist: Fixed an issue where the Loome Agent did not work with proxies.
  • Assist: Fixed an issue where the Loome Agent might crash while trying to log while offline.