Release Notes 2022.3.0

Release Highlights

The goal of the Incorta Cloud 2022.3.0 release is to enhance the platform’s analytical capabilities, data management, and performance. The 2022.3.0 release introduces new features, such as Incorta SQL Business Views, the Oracle Enterprise Performance Management (EPM) connector, and the data application Data Wizard.

Also, this release adds new charts to the Cluster Management Console (CMC) Monitoring section, as well as introduces the new upload service command line interface (CLI), and Incorta Notebook exports and imports.

The Incorta Cloud 2022.3.0 release includes various enhancements to the Bubble and Advanced Map visualizations, the SAP connector, and the Schema Designer and Table Editor, which include a new interface to improve the user experience.

New Features

In addition to the new features, there are other enhancements and fixes.

Data Application Data Wizard

This release introduces an interactive data application Data Wizard. With easy, sequential steps, use the data application Data Wizard to install a data application, connect to data, review the data application components, load data, and explore data.

For more information, refer to Data applications → Data application Data Wizard.

Bubble Chart visualization improvements

Incorta has enhanced the Bubble chart visualization to allow both aggregated and listed result sets. You can now use dimensions and measures in the Horizontal and Vertical trays, add a measure to the Size by tray to precisely size the bubble, and group the plotted points by the coloring dimension.

For more information, refer to Visualizations → Bubble.

Advanced Map visualization enhancements

In this release, the Analyzer supports the following enhancements to the Advanced Map visualizations:

In the Color By tray, the default Aggregation is now set to MIN instead of COUNT for columns of type String.
A new Custom Label tray is now available for GEO DATA that applies to Geo Attribute and Geospatial (Lat/Long) entities, in which the tray is only visible when the Data Label option is enabled in the Layer settings. The value of the column in the Custom Label tray overrides the default label shown for this layer on the Advanced Map insight. For more information, refer to Visualizations → Advanced Map

Incorta SQL Views in Business Schemas

Incorta now supports SQL as a type of Incorta View in addition to the Incorta Analyzer View in Business Schemas. This new feature enables you to create complex SQL queries to create a new view. Using the provided SQL editor, you can write simple and complex SQL queries, format these queries, and run them to see the output before you save the view.

Note: The Incorta SQL Views is an Incorta Labs feature

An Incorta Labs feature is experimental and functionality may produce unexpected results. For this reason, an Incorta Lab feature is not ready for use in a production environment. Incorta Support will investigate issues with an Incorta Labs feature. In a future release, an Incorta Lab feature may be either promoted to a product feature ready for use in a production environment or be deprecated without notice.

For more information about the Incorta SQL View, refer to Concepts → Incorta SQL View.

Support for the TO_NUMBER PostgreSQL format function

This release supports the TO_NUMBER(string, format) PostgreSQL format function to convert various string data types to numbers.

The function is available for a PostgreSQL script in a materialized view and for a SQL query that uses the SQL interface (SQLi) and Apache Spark.

The following table illustrates the supported formats:

Format	Description
`9`	Numeric value with the specified number of digits
`0`	Numeric value with leading zeros
`. (period)`	decimal point
`D`	decimal point that uses locale
`, (comma)`	group (thousand) separator
`FM`	Fill mode, which suppresses padding blanks and leading zeroes
`PR`	Negative value in angle brackets
`S`	Sign anchored to a number that uses locale
`L`	Currency symbol that uses locale
`G`	Group separator that uses locale
`MI`	Minus sign in the specified position for numbers that are less than 0
`PL`	Plus sign in the specified position for numbers that are greater than 0
`SG`	Plus / minus sign in the specified position
`RH`	Roman numeral that ranges from 1 to 3999
`TH` or `th`	Upper case or lower case ordinal number suffix

Note

The previous string formats also apply to the TO_CHAR() PostgreSQL function.

Upload Service Command Line Interface (CLI)

The Incorta Upload Service CLI moves data files from Incorta On-Premises host or remote server to an Incorta Cloud GCS bucket for accessibility from your Incorta Cloud Instance. You can use the Upload Service CLI to migrate data files from Incorta On-Premises or a remote server to Incorta Cloud, or to use Incorta Cloud for disaster recovery.

For more information about the Upload Service CLI, refer to Tools → Upload Service Command Line Interface.

Oracle Cloud Applications connector Maximum Cache Size

The Oracle Cloud Applications connector now includes a Maximum Cache Size property. This property can be used to limit the size of downloaded files to prevent running out of disk space.

For more information, refer to Connectors → Oracle Cloud Applications.

SAP ERP connector enhancements

The SAP ERP connector now includes improved data extraction performance in which business rules are processed in Incorta by default, including the following features:

Currency decimal shift for amount fields associated with currencies that do not have decimals
Timestamp data type identification and conversion to a date and time format

For more information, refer to Connectors → SAP ERP.

Oracle EPM connector

Now you can get financial data from Oracle Enterprise Performance Management (EPM) inside Incorta using the new Oracle EPM connector. This connector enables data extraction for consolidation, planning, and budgeting applications.

For more information, refer to Connectors → Oracle EPM.

Important

The Oracle EPM connector is a preview connector. Contact Incorta Support if you want to use it in production environments.

New CMC Monitor Charts

Incorta is introducing new utilization charts that enable you to monitor your Incorta environment, such as Ram usage, Diskspace %, and Real Memory %. The Ram usage and Diskspace % charts are for each node you have installed. The Real Memory % chart is for the Analytics and Loader Services.

For more information, refer to Tools → CMC Monitor.

Schema Designer and Table Editor New User Interface (UI)

This release introduces a new UI for the Schema Designer and the Table Editor. The new UI enriches the user experience and facilitates managing objects and joins in a physical schema. The new UI has the same look and feel of other components, such as the Analyzer and the Catalog (Content Manager), which provides a consistent user experience. For example:

A tab-based view for tables and joins, which reduces the need to scroll vertically across multiple tables to get to the joins section.
Different filter, search, and input options in the Schema Designer and Tables Editor that enable you to do the following:
- Search for tables and joins
- Filter the table list by the object type and the performance optimization status
- Filter the object columns by the column type, function, and encryption status
- Show or hide the schema name in the join list
- Use the available visual indication to find joins with join filters
- Use the date picker when defining a join filter

For more information, refer to Tools → Schema Designer and Tools → Table Editor.

Export and Import an Incorta Notebook

This release supports exporting and importing Incorta Notebooks in Materialized Views (MVs). You can now upload a new Notebook to replace the existing one, download the current Notebook, and import a new Notebook inside a specific physical schema. After performing an import action, you must select Done to save your changes.

Note

You can only import JSON files to the Notebook. For more information, refer to Tools → Notebook Editor.

Enhanced data loading into memory

This release introduces a new feature to enable parallel reading of parquet segments to enhance the performance of loading data into the Analytics Service memory, especially when rendering dashboard insights for the first time.

This feature is beneficial in the following situations:

The ratio of unique values in a column is low.
Insights require reading multiple columns at the same time.
There is a large number of parquet segments or rows.
Insights mainly reference integer or long data columns.

This feature is currently disabled by default. To enable it and manage its related settings, contact Incorta Support to edit the engine.properies file in both the Analytics Service and the Loader Service directories.

Enhanced Dashboard query performance

In this release, Incorta has enhanced the performance of dashboards by adding a temporary cache layer, which will cache the populated result-set during the loading of an insight. Any concurrent requests for the same temporary table will use the cached temporary table and only one insight can populate it.

Additional Enhancements and Fixes

In addition to the new features and major enhancements mentioned above, this release introduces additional enhancements and fixes that help to make Incorta more stable, engaging, and reliable.

Physical Schema

Fixed an issue in which Incorta tables and Incorta SQL tables required a schema load after the schema update
Fixed in issue in which a load required message persists after an Analyzer table is modified and reloaded

Visualizations

Enhanced filters at the insight level to show the filter selection at the top of the list, regardless of its initial order in the list
Fixed an issue with the Treemap visualization in which the insight did not properly render when a column with more than 500 labels is added to the Coloring Dimension tray
Enhanced the message displayed when there are too many data series to render in the Pie visualization to: There are too many data series to properly render this chart
Resolved an issue with the Donut and Pie donut visualizations in which the Analyzer becomes unresponsive when trying to render many data series
Fixed an issue in which changing the insight type from a chart to a table caused an increase in the Max Rows Limit, but did not display the full data
Fixed an issue that caused a chart to be displayed differently when enabling the Logarithmic settings option
Fixed an issue in which the Advanced Map visualization displays data correctly in the Analyzer, but a map without data appears in the dashboard
Fixed an issue in which the Map visualization does not render in the dashboard when integrated with Google Maps
Fixed an issue with the Advanced Map visualization that caused colors not to be applied when using a formula column in the Color By tray

Dashboards

Fixed an issue in which an error occurred when downloading a dashboard as Excel with a date type pill in the Grouping Dimension tray
Enhanced the behavior of the default bookmark of the dashboard. Now when you add a default bookmark to a dashboard you can either choose to include the default prompts or exclude them.
Resolved multiple issues when exporting dashboards to PDF or HTML. Exporting dashboards to these formats now honors the status of the Append Timestamp check box and the exported file type.
- When selecting the Append Timestamp check box, the export time is added to the exported file name, whether the dashboard is sent via email or to an export folder, and to the .zip file in the case of export folders.
- When clearing the check box, the export time will not be added to the name of the exported file or the .zip file.
- Dashboards exported to PDF are now sent to the export folder as PDF files rather than HTML files.

Analyzer

Fixed an issue with the Download as option in the Analyzer, in which the Download as option was enabled for an empty Table insight that had no column(s)
Fixed an issue in which creating a Table insight that returns empty data showed the Cannot read properties of undefined (reading 'concat') error message in the Visualization canvas, instead of rendering the table with headers and 0 row(s)

Materialized Views, Notebook, and SQLi

Fixed an issue in which schema, table, or column names that are longer than 63 characters did not appear in SQLi
Fixed an issue in which an error appeared on the Spark port when you run a query containing a formula column with a decode function
Fixed an issue in which MVs encountered a Spark error during Parquet reading after an upgrade from 2022.1.0 to 2022.2.0.
Fixed an issue that caused the failure of creating or loading an Incorta PostgreSQL or Spark SQL MV that referenced an encrypted source table when enabling the cluster deployment mode
Fixed an issue in which the HA, task, schema name, table name, job ID, job type, ETL, and load type were missing in the log when loading a schema with a MV

Cluster Management Console (CMC)

Fixed an issue with the Backup frequency option in the CMC, in which committing changes within the specified backup time interval resulted in a new schema version instead of overwriting the current schema version with the latest saved version
Fixed an issue with Logs in the CMC, in which selecting Show Logs for a given tenant in the Tenants tab redirects to the Logs listing page without selecting the Tenant name from the dropdown list
Fixed an issue with Logs in the CMC, in which selecting Show Logs for a given service (Analytics or Loader) redirects to the Logs listing page without selecting the Service name from the dropdown list
Enhanced the name of the enable notifications option in Default Tenant Configurations to be Enable Sharing Notifications as this option enables you to share notifications with other users through emails
Fixed an issue that caused deleting a tenant with scheduled jobs to fail
Resolved an issue in which creating a tenant resulted in an error

Miscellaneous

Fixed an issue in which UPDATE_ENTITY messages are flooding the loader service tenant log and consuming disk space
Fixed an issue in which the an interruption of the query parent threads did not also result in an interruption of the child threads
Enhanced the admin portal to allow the migration of a cluster from one supported region to another. Contact support for assistance with the migration.

Known Issues

The following list illustrates the known issues in this release:

Insights might not render when you run the same query multiple times for the same dashboard
In the Schema Designer, when a table requires stage loading, the warning message appears as Full load required for a new model to take effect instead of Staging load required for new model to take effect.
In the Schema Designer, for a given unloaded object, the Preview Data button is enabled instead of being disabled
In the Schema Designer, a warning message should be displayed when enabling the encryption for a Key column
In the Table Editor, the Filters tab is displayed for alias tables
Missing Geo Column type from the column type list
Missing In operator in the security runtime filters operators
Updating the bookmark for dashboard with an applied filter after editing the filter results in an error
Loading a table without a key incrementally for the first time results in an error — Workaround: Attempt to load the table incrementally again
After changing the data source of an object in an imported physical schema or tenant to an Incorta SQL Table or changing an Incorta SQL Table in an imported physical schema or tenant to another object type, MV for example, the Disable Full Load option will be automatically enabled, which will lead to skipping these objects in the next schema full load jobs.
- You need to either disable the feature manually for objects that support disabling full loads (physical schema tables and MVs with incremental load enabled) or recreate the objects.