30th of November, 2023

Service

Improvements

  • You can now change the name of an existing schedule.
  • Improved notifications when disabling and enabling schedules.
  • Added better loading indicators to Scheduling, Application Roles, and API Keys pages.
  • Improved loading indicators in schedule wizard.
  • Improved layout of some buttons in schedule wizard.
  • Added default alphabetical ordering to jobs list.
  • Updated the available spark versions when creating a Databricks cluster definition.
  • Added the ability to specify whether a datetime exported to Parquet should be treated as the current local time zone, a UTC value, or exported as a string literal via the target connection string (configuration via the File Definition will be available in a future service release).
  • Improved performance when editing a task used in many jobs, or a task with many executions.
  • Improved performance when editing a job with many executions.
  • Fixed an issue where some error messages may display multiple times.

Fixes

  • Fixed an issue where firewall rules would not be added when creating an API key.
  • Fixed an issue where log streams could be seen in the wrong job when viewing the logs for a running job.
  • Fixed an issue where a schedule starting at 5 past the hour, every ten minutes would start running at 0 past the hour, in the second hour.
  • Fixed an issue where the schedules wizard sometimes progresses to the next page with no user input.
  • Fixed an issue where changing the every days, hours, or minutes value on the schedule wizard would default back to the default value.
  • Fixed an issue where you could not filter on columns on the Schedules page.
  • Fixed an issue where you would receive a validation error when changing the time zone of a schedule.
  • Fixed issues where going back and fourth between the schedule wizard and manually entering crons could cause an error.
  • Fixed an issue where weekly schedule would be deselected when changing between hourly and minutely in the schedule wizard.
  • Fixed an issue where a blank email was sent when inviting users directly from a project role.
  • Fixed an issue where users may occasionally be redirected to registration screen.
  • Fixed an issue where start and end date (not start and end time) on a schedule were calculated in UTC instead of the specified time zone.
  • Fixed an issue where you would sometimes receive a schedule already exists error when using a schedule name that does not exist.
  • Fixed an issue where API keys were not added to the application consumer role when directly added to a project role.
  • Fixed an issue where the Application Roles page did not show all API keys when you have more than 10 API keys.
  • Fixed an issue where tooltips sometimes get stuck on the page.

Agent

This update requires agent version - 2023.11.29.1

Please download a new install script and update your agent to use new features, improvements, and fixes.

Improvements

  • Updated exporting of decimal values to Parquet format to retain precision and scale from source system.
  • Added the ability to specify whether a datetime exported to Parquet should be treated as the current local time zone, a UTC value, or exported as a string literal via the target connection string (configuration via the File Definition will be available in a future service release).

Fixes

  • Fixed an issue with exporting smallint and tinyint from SQL to parquet file format.
  • Fixed an issue that resulted in an error when running a notebook task on Databricks.