Release Notes Incorta 2024.1.7

Release Highlights

In this maintenance pack:

  • An offering for Incorta Premium to unlock advanced features
  • A new Apache Kafka connector with a simplified implementation and multiple enhancements
  • Enhancements to multiple connectors, including SFTP, Oracle OTM/GTM, Oracle EPM, and Oracle Cloud Applications (BICC)
  • Applying more flexible conditions for reading columns in parallel
  • A new version of the Excel Add-in, featuring several enhancements and fixes
Important

This release uses the Data Agent version 8.4.0. Please upgrade to this version.

Upgrade Considerations

After upgrading to 2024.1.7 and with the introduction of Incorta Premium, the following features will be impacted:

  • Notebook for business users: Enable Incorta Premium to be able to access existing business notebooks and create new ones.
  • Data Studio: To avail the Data Studio tab in the Analytics platform, enable Incorta Premium, enable Data Studio for Cloud clusters in the Cloud Admin Portal > Configurations, and enable and configure it in the CMC > Server Configurations > Incorta Data Studio.

What’s New

Incorta Premium

With this release, we are happy to package some of our most newest innovative features into the Incorta Premium Package. Features packaged as a part of Incorta Premium include:

  • The Incorta Data Studio - The Incorta Data Studio is a new suite enabling Schema Managers to accelerate Materialized View development through Dataflows—low-code workflows made of interconnected Recipes. Users can perform data quality checks, blending, preparation, analysis, and complex operations with Python, SQL, and LLM Recipes, ultimately deploying the workflow into a Physical Schema.
  • Business Notebooks - The Analyzer Notebook enables analysts to develop in PySpark, Spark SQL, Scala, and Spark R, providing access to verified Business Schema views with row-level security, ensuring secure and governed data analysis.

To explore our Premium features in depth, check Incorta Premium.

New Apache Kafka connector

The new Apache Kafka connector V2 provides multiple enhancements over the older connector version, including:

  • An enhanced and streamlined user experience
  • Supporting multiple topics per data source
  • Automatic discovery; no need to generate an Avro schema
  • Transformation of JSON messages (Flattening objects and arrays)
  • Consuming messages in a batch mode during the load job
  • Native support for Data Agent

Connector enhancements

In this release, Incorta has introduced multiple enhancements to different connectors, including:

  • OAuth 2.0 authentication for Oracle EPM and Cloud Applications (BICC) connectors
  • Reading PGP-encrypted files from SFTP and Oracle Cloud Applications (BICC) data sources
  • Oracle OTM/GTM connector:
    • An optional list of tables that can be accessed by Incorta
    • Support for asynchronous export via the Data Export API
    • Support for deleted Primary Keys (PKs) extraction
  • Support for SSH authentication for SFTP
  • Support UCM discovery in Oracle Cloud Applications (BICC) (The connector has been renamed to Oracle Cloud Applications starting the 2.2.3.0 connector version)

Parallel column reading enhancements

This release introduces more flexible conditions for parallel column reading into memory. Previously, only Parquet files with at least 10 million rows and 4 segments qualified for parallel processing. Now, Incorta reads columns from Parquet files in parallel if they meet any of these criteria, significantly optimizing load times, particularly for clusters using Google Cloud Storage (GCS).

New Excel Add-in version 16.9.0

A new version of the Excel Add-in (16.9.0) is now available, featuring several enhancements and fixes:

  • Enhanced User Experience: A simplified, more intuitive connection process to Incorta. You can now choose between Continue with direct login or Continue with SSO from the Login panel.
  • Expanded Date Part options: Additional options for Date Part selection, beyond Full date, to accommodate diverse reporting needs.
  • Resolved Issues:
    • Fixed an issue where numbers were truncated (rounded) in the Excel Add-in, ensuring data accuracy and numbers match the precision of those stored in Incorta.
    • Addressed a bug that caused errors when creating Pivot tables, improving reliability.
Important

This new version is not yet supported in the 2024.7.x releases. Therefore, upgrading from 2024.1.7 to 2024.7.1 or 2024.7.2 is not recommended for the Excel Add-in users.

Fixes and Enhancements

Enhancements

EnhancementArea
A new version of the Kyuubi Hive JDBC Jar is now available for connecting Tableau to Incorta via Advanced SQli. The new Jar introduces enhanced error messaging, providing clearer feedback when incorrect user credentials are supplied.Advanced SQLi

Fixes

Fixed IssueArea
Incremental Mode activated in the Save MV Recipe in a Dataflow would fail to deploy an MV to the target schema.Data Studio
Upgrading clusters that used a MySQL 8 metadata database from a 6.0.x or earlier release to 2024.1.x might fail.Metadata Database