Incorta Premium

Incorta Premium is a new offering that provides access to advanced features. Incorta Premium is available for both Cloud and On-Premises installations.

Premium Features

The following are the features available in Incorta Premium on 2024.7.2:

• Data Studio
• Copilot and generative AI capabilities
• Business Notebook
• Spark SQL Views

The following are the features available in Incorta Premium on 2024.1.7:

• Data Studio
• Business Notebook

Feature Availability Matrix

The following table shows features available in different Incorta releases when Incorta Premium is enabled.

Data Studio

The Incorta Data Studio is a new suite experience available within the platform. Once enabled, Schema Managers can accelerate Materialized View development by creating Dataflows. Dataflows consist of Recipes (analytical steps) that are interconnected to form a visual, low-code, step-by-step workflow.

During the Dataflow development process, you can connect to tables and perform various activities, including:

• Conducting data quality checks, verification, and filtering using the Data Quality Recipe.
• Blending data with Join, Fuzzy Join, and Union Recipes.
• Preparing data with Select, Rename, Formula, and Filter Recipes.
• Analyzing data using Unpivot and Aggregation Recipes.
• Enhance data and conduct complex analyses through code injection in Python and SQL Recipes.
• Performing intelligent classification, translation, summarization, and more with the LLM Recipe.

Once a Dataflow has been constructed and validated using live data views and data profiling, you can deploy the underlying PySpark code, which is visually represented through the Data Studio interface, into a Physical Schema. From there, you can load, schedule, and manage your Data Studio-built Materialized View like any other physical table.

To enable the Data Studio, please review this guide.

Copilot and generative AI capabilities

Generative AI experiences have been integrated across the platform to enhance user interactions. These experiences are collectively referred to as "Copilot" and can be found in various interfaces.

1. Copilot Business Assistant: Ask the Copilot any business-related question and specify a View for reference. The Copilot will then construct and execute an SQL query, providing you with the resulting data, relevant insights, and a summary of the findings.
2. Copilot Dashboard Assistant: Build on the insights from the Copilot Business Assistant by mentioning @insight. This allows you to transform your data into Interactive Insights that can be added to your dashboard.
3. Copilot Story Generation Assistant: Describe the story you want to convey with your data, and watch the Copilot create a dashboard in minutes. The resulting dashboards are formatted in templates compatible with our PowerPoint download capabilities.
4. Copilot Business View Metadata Assistant: While editing a business view, you can generate column labels and descriptions with just a click of a button.
5. Notebook Assistant: Create Spark SQL queries using simple natural language prompts. Additionally, the Notebook Copilot can assist you in troubleshooting any notebook errors you encounter.
6. Data Studio Assistant: Utilize natural language to create formulas, PySpark code, Spark SQL code, and establish data quality rules.

To learn more about Incorta Copilot and how to enable it, please follow this guide.

For details about the Incorta Copilot configurations, refer to Server Configurations > Incorta Copilot.

Business Notebook

Traditionally, the interactive notebook experience has been limited to Schema Managers who have access to materialized views. Analysts, eager to use Interactive Notebooks, often find themselves without access to the Physical Schema. To address this, we introduced our Analyzer Notebook—an interactive IDE for development in PySpark, Spark SQL, Scala, and Spark R.

Business Notebooks differ from Materialized Views primarily in terms of data accessibility. In Business Notebooks, users can only access verified views from Business Schemas that have been shared with them. Additionally, row-level security is active in this notebook experience, providing code-savvy users the freedom to analyze data while ensuring governed and secure oversight.

To get started with activating the Business Notebook, please see our guide here.

Spark SQL Views

In the 2024.7 release, Incorta continued to build on the success of the Advanced SQL interface by extending accessibility beyond external tools and into the experience of building views within Incorta. This means that users can compose Business views in Spark SQL and achieve the following benefits:

• Perform Complex Data Transformations
  • You can easily execute advanced data transformations using Spark SQL Views, such as moving averages, rankings, and cohort analysis. Only the necessary columns from business views are used to optimize performance and simplify data handling.
• Apply Filters Using Variables
  • Dynamically filter data with session, presentation, or global variables in Spark SQL Views. The presentation variables adjust in real time based on the dashboard’s current context for more accurate insights.
• Filter Based on Source Data
  • Enable dashboards to filter data using the source columns from Spark SQL Views, including verified business views. This ensures a smooth experience when working with a mix of insights from Spark SQL Views and traditional data sources.
• Visualize Your Results
  • View transformed data directly within Incorta dashboards for further analysis and reporting.

To learn more about the Spark SQL View, view our overview here.

Activate this feature by enabling the Advanced SQL Interface and turning on the Spark SQL View toggle in the Server Configurations > Incorta Labs.

Impact of disabling Incorta Premium

After upgrading to 2024.7.2 or 2024.1.7 and whenever Incorta Premium is disabled, Premium features won’t be available by default.

• Notebook for business users: Previously created business notebooks will no longer be accessible, and you will not be able to create new notebooks.
• Spark SQL Views (2024.7.2 only): You won’t be able to create new, explore, or edit Spark SQL Views. Additionally, any object referencing a Spark SQL View, such as an insight, will fail.
• Data Studio: The Data Studio tab won’t be available in the Analytics platform.
• Copilot (2024.7.2 only): The Copilot option won’t be available. Additionally, you can’t have AI tools suggesting or generating labels or descriptions for business view columns.

To access these features, you must upgrade your license to Incorta Premium and enable the required features.

Enable Incorta Premium and its features

On Cloud

Incorta Premium on Cloud requires an additional license to activate the Premium Features. Cloud administrators can submit a request to enable Incorta Premium per cluster from the Cloud Admin Portal > Upgrade to Premium.

After upgrading your license to Incorta Premium, you must enable and configure the required features.

• Notebook for business users:
  • If this feature was enabled and configured before the upgrade, Business Notebook will be available once you enable Incorta Premium.
  • Otherwise, refer to References → Notebook for Business Users for prerequisites and steps to enable it on Cloud.
• Spark SQL Views (2024.7.2 only):
  • If Advanced SQLi was configured before, in the CMC > Server Configurations > Incorta Labs, turn on the Spark SQL Views toggle (available starting 2024.7.2).
  • Otherwise, in the Cloud Admin Portal (CAP) > Cluster > Configurations, turn on the Enable Advanced SQL Interface toggle, and then turn on the Spark SQL Views toggle in the CMC or the CAP > Server Configurations > Incorta Labs.
• Data Studio:
  • In the Cloud Admin Portal (CAP) > Configurations, turn on the Enable Data Studio toggle, and then in the CAP or CMC > Server Configurations > Data Studio, turn on Data Studio and set configurations as required.
    Refer to References → Enabling the Data Studio for more details.
• Advanced Copilot (Nexus) (2024.7.2 only):
  • In the Cloud Admin Portal (CAP) > Configurations, turn on the Enable Copilot toggle, and then in the CAP or CMC > Server Configurations > Incorta Copilot, turn on Enable Incorta Copilot and set configurations as required.

Enabling Copilot automatically enables AI generative capabilities, including label and description generation for business view columns.

On On-Premises

To upgrade to Incorta Premium on an On-Premises cluster after upgrading to a supported release, follow these steps:

1. Log in to CMC.
2. On the Clusters tab, select a cluster, and then select the Cluster Configurations tab.
3. On the Server Configurations tab, select Incorta Premium, and then turn on the Incorta Premium toggle.

After enabling Incorta Premium, you must enable and configure the required features.

• Notebook for business users:
  • If this feature was enabled and configured before the upgrade, Business Notebook will be available once you enable Incorta Premium.
  • Otherwise, refer to References → Notebook for Business Users for prerequisites and steps to enable it on On-Premises clusters.
• Spark SQL Views (2024.7.2 only):
  • If Advanced SQLi was configured before, in the CMC > Server Configurations > Incorta Labs, turn on the Spark SQL Views toggle.
  • Otherwise, enable and configure Advanced SQLi, and then in the CMC > Cluster > Server Configurations > Incorta Labs, turn on the Advanced SQL Interface and Spark SQL Views toggles.
• Data Studio:
  • In the CMC > Server Configurations > Data Studio, turn on Data Studio and set configurations as required.
    Refer to References → Enabling the Data Studio for more details.