Maintenance Packs

Incorta encourages customers to upgrade to the most recent release. Here are maintenance packs notes for this minor release.

Maintenance Pack 5.1.5

What’s New?

This release introduces a new built-in function: dayOfYear(). The dayOfYear() is a conversion function that returns the count of days from the beginning of the year till a given date or timestamp, ranging from 1 to 366. For more information, refer to Built-in Functions → dayOfYear

Starting this release, Incorta Data API is packaged as a WHEEL file instead of an EGG file. Incorta Data API provides access to Incorta and Incorta Spark cluster from external notebook and python environments. For more information, refer to Tools → Data APIs for External Notebooks

Fixed Issues

Physical Schema

• Resolved an issue in which schema load failed when trying to read folders as parquet

Dashboards

• Resolved an issue in which Send Now did not work when trying to send a dashboard in PDF, HTML, and HTML file formats
• Fixed an issue in which date was exported as timestamp in CSV files format
• Fixed an issue in which the dashboard was not formatted correctly when emailed to an Outlook client
• Fixed an issue in which an error occurred while applying filters for a model
• Fixed an issue in which the export folders of a dashboard scheduler could not be imported from version 4.9.14 to version 5.1.3
• Fixed an issue in which expanding the row group of the Aggregate Table with enabled merge and collapse options did not work correctly

Analyzer

• Fixed an issue in which opening the Query Plan Viewer resulted in an error when using a formula in the Aggregate Filter tray

Materialized Views and SQLi

• Fixed an issue with SQLi queries, in which running queries from external business intelligence tools, such as Tableau and Power BI, resulted in a lock on schema loads
• Fixed an issue with the SQLi audit file, in which loading its physical schema resulted in an error due to concurrent writes of the threads
• Fixed an issue in which MVs encountered a Spark version 3.0.x error during Parquet reading after the upgrade
• Fixed an issue in which the MVs having no dependencies between them started sequentially instead of concurrently

Cluster Management Console (CMC)

• Fixed an issue in which creating a new cluster based on Oracle metadata resulted in the "Couldn't create cluster due to Error in upgrading cluster metadata" error
• Fixed an issue that caused deleting a tenant with scheduled jobs to fail

Miscellaneous

• Fixed an issue with scheduled data alerts, in which the notification emails were not sent to the user(s)
• Fixed an issue in which an interruption of the query parent threads did not also result in an interruption of the child threads
• Fixed an issue in which the parquet merge tool failed on ADLS and did not restore backups
• Resolved an issue in which old source versions was not cleared properly and hence consumed lots of disk space
• Fixed an issue in which upgrading metadata took an extended period of time and then resulted in an error
• Resolved an issue in which the SSO login did not work when upgrading from the Incorta release 5.1.1 to 5.1.2
• Fixed an issue in which UPDATE_ENTITY messages were flooding the loader service tenant log and consuming disk space
• Fixed an error that occurred when loading the SQL_Audit table in the _IncortaMetadata schema that was caused by corrupt audit files
• Fixed an issue with previewing data in Dark Mode
• Fixed an issue that caused loading joined tables to consume excessive on-heap memory when engine.parallel_join_use_flat_column and engine.parallel_join_builder are set to true
• Fixed an issue in which sync dir for the command line using CLI caused a runtime exception

Maintenance Pack 5.1.4

What’s New?

This release introduces the Incorta Intelligent Ingest for Azure Synapse. Incorta Intelligent Ingest streamlines the integration between complex data sources and Microsoft Azure Synapse Analytics. Incorta Intelligent Ingest accelerates data mart deployment, and automates data model design and source schema mapping with Incorta data applications. Incorta data applications provide a new, faster, more effective option for analyzing and understanding your data, with no data modeling or extract, transform, load (ETL) required.

Here are the steps to get started with the Incorta Intelligent Ingest for Azure Synapse:

• Enable Incorta Intelligent Ingest
• Create a Data Destination to push data to Azure Synapse Analytics
• Set a Data Destination for a Physical Schema

Enable Incorta Intelligent Ingest

A System Administrator can enable Incorta Intelligent Ingest on a host by setting the intelligent.ingest.enabled property to true in the Analytics and Loader service.properties files.

For more information, refer to Configure Incorta Intelligent Ingest for Azure Synapse → Enable Incorta Intelligent Ingest.

Create a Data Destination to push data to Azure Synapse Analytics

Once you enable Incorta Intelligent Ingest, you are able to create a data destination to push data to Azure Synapse Analytics. Here are the high level steps in the Incorta Direct Data Platform:

• ​​In the Navigation bar, select Data.
• In the Action bar, select + New → Add Data Destination.
• In the Choose a Data Destination dialog, in Schema Destination select Synapse Analytics.

For more information, refer to Configure Incorta Intelligent Ingest for Azure Synapse → Create an Azure Synapse Data Destination.

Set a Data Destination for a Physical Schema

Once you enable Incorta Intelligent Ingest, you are able to set a data destination for a physical schema. Here are the high level steps in the Incorta Direct Data Platform:

• In the Navigation bar, select Schema.
• In the Action bar, select Settings (gear icon) → Set Data Destination.

For more information, refer to Configure Incorta Intelligent Ingest for Azure Synapse → Set a Data Destination for a Physical Schema.

Fixed Issues

Data Agent

• Fixed an issue that caused schema discovery to fail for SAP ERP connections using the Incorta Data Agent

SQLi

• Fixed an issue that caused the connection between BI tools, Tableau and Power BI, and Incorta to be broken during data extraction and after fetching a number of records

Miscellaneous

• Fixed an issue that caused Incorta to fail to access a tenant created on an Azure Data Lake Storage (ADLS) that exists on Azure China cloud

• Fixed an issue that prevented authorizing Incorta to access Dropbox, Box, and Google Drive as data sources and data destinations when security was implemented through a proxy server and not through the server that hosts Incorta Analytics

  • This fix requires using the proxy server information to define the Server URL Protocol, Server Name, Server Port properties in the CMC → Tenant Configurations → Email. In addition, you must use the same information when registering the OAuth Redirect URI in the app that you create to allow Incorta to access your cloud storage.

Maintenance Pack 5.1.3

Fixed Issues

Physical Schema

• Fixed an issue in which updating schemas deletes joins on Alias tables

Analyzer

• Fixed an issue with inconsistent caching for all chart, KPI and gauge visualizations
• Fixed an issue in which a join between a Materialized View (MV) table and an Alias table is broken in the insight’s Query Plan after updating the physical schemas

Materialized Views and SQLi

• Fixed an issue that prevented users from accessing Incorta through SQLi after upgrading to the 5.1.2 release when the external tools authentication type is different from the default authentication type
• Fixed an issue in which SQLi queries from external business intelligence tools, such as Tableau and Power BI, resulted in a lock on schema loads
• Fixed an issue with the prolonged transformation phase time when running multiple MVs concurrently
• Fixed an issue in which the loading order of MVs was sequential instead of parallel

Maintenance Pack 5.1.1

What’s New?

• Enhanced the SQLi performance.
• Less time is needed during the upgrade.
• Increased the SQL minimum fetch size to 10000 with the BI tools.
• Enhanced the performance of Schema updates.
• Enhanced the security of the query endpoint when users with View only access rights open a dashboard.

Issues fixed

Dashboards

• Fixed an issue with the downloading of dashboards that have multiple tabs, with session variables in the tab title, in HTML or PDF formats.
• Fixed an issue with scrolling in dashboard playlists.
• Fixed an issue with date session variables in the session variables list used in filters.
• Resolved an issue with closing error pop-up messages, while exporting dashboard tabs.
• Resolved an issue when downloading transpose tables as PDF, where the columns were repositioned.
• Resolved an issue with enabling the incremental reporting option.
• Fixed an error that resulted from entering values in the filters search bar.
• Resolved an issue with sorting filters and prompts in Firefox.
• Fixed an issue with sharing a dashboard with a user when the schema is not shared.
• Fixed an issue with the date picker range in the list of variables.
• Fixed an issue with accessing Table or Pivot insights settings in the dashboard maximized mode.

Visualizations

• Fixed an issue with displaying URLs in Advanced Map visualization when opening Manage Filters and Prompts.
• Fixed an issue with displaying the number of rows and format in tables insights.
• Resolved an issue with scrolling through text in the Richtext visualization when there are no spaces in the text.
• (Cloud) Resolved an issue with the exported HTML insights, where the chat bubble was exported in the file too.
• Fixed an error when downloading a Table visualization as HTML.

Business Schema

• Fixed an issue with rendering the list of business schemas, by adding locks on the business schemas that are being updated.

Schema

• Fixed different issues with Schema updates, such as failed jobs that are stuck in the update phase.
• Fixed an issue with Schema load, where the Schema load job is finished but the tables show they are still loading.
• Increased the number of Schemas returned in the Schema drop down list while creating joins.
• (Cloud) Fixed an issue with loading a schema that has an updated incorta table.
• Fixed an issue with loading the rest of the tables in a schema even if a table load fails.
• Fixed an issue with interrupting schema loads, where schemas with materialized views were not interrupted.
• Fixed an issue with queuing several updates for the same schema, if the schema is already updating.
• Fixed an issue with importing a schema with an overwrite option while loading it.
• Fixed an issue with the time counter in a schema when the schema update fails.
• Changed the icon beside the phase from → to X, where the schema load was interrupted.
• Fixed an issue with editing a shared data destination with a user that has Edit access rights.
• Fixed an issue with creating a materialized view table using Python.
• Fixed a performance issue with frequent schema updates causing the service to hang.
• Fixed an issue with Zookeeper when starting a schema update job.

Analyzer

• Enhanced the performance of rendering Schemas when you select Manage Datasets in the Analyzer.

Formula builder

• Fixed an issue when executing formulas that contain (‘’), as it caused the analytics service to hold the lock for a long time when using a distinct filter.
• Resolved an issue with displaying variables, where the number of variables displayed was limited to 200 only.
• Fixed an issue with saving a query with an inQuery operator in an individual filter.

Scheduler

• Resolved an issue with displaying dashboard tab names in data notifications when exporting the alert.
• Fixed an issue with schema notifications, where it used to stop after a period of time.
• Resolved an issue with the schema load job description field.

CMC

• Resolved an issue with the default value of the cleanup job; the default is 60 minutes.

Spark/SQLi

• Resolved an issue with Spark application failure, when there are exceptions produced.
• [Cloud] Resolved performance issue with SQLi when running different simultaneous queries.
• Fixed an issue with discovering remote tables.
• Resolved an issue with the displayed values of Now(), Today(), and ISDATE() functions within Tableau.
• Resolved an issue with SQLi queries that prevented old compacted versions from deletion in a cleanup job.
• Fixed an issue with executing some Window functions on Spark ports.
• Fixed an issue where using the Not operator with INoperator rendered incorrect results.
• Fixed an issue with the JDBC driver in handling Incorta on Incorta tables.

Miscellaneous

• Fixed an issue with compaction when upgrading to 5.1.1.
• Resolved an issue with the migration tool, where non-optimized tables should have zero rows in the database.
• Enhanced the validation message displayed for entering an invalid name when creating a new data destination.
• Fixed an issue with resolving “?” in the query of a materialized view.