Incorta Nexus Audit

Installation Requirements

Before installing this application, you must enable enhanced auditing feature in CMC.

In the Cluster Management Console (CMC) > Clusters > your_cluster > Server Configurations > Analytics Workload Management, for the Analytics Auditing option, specify if you want to log activities in the Standard audit files, the Enhanced ones, or Both.

Note

Starting with the 2025.7.1 release, Incorta Copilot has been renamed to Incorta Nexus.

Physical Schemas

  • _IncortaNexusAudit

Business Schemas

  • _NexusAudit

Dashboard Folder

Nexus Audit Dashboard

The Nexus Audit Dashboard provides comprehensive monitoring and analysis of Nexus usage, performance, and user feedback. This dashboard consists of the following tabs: Audit and Details.

Audit Tab

The Audit tab offers a complete overview of Nexus usage metrics, query performance, and user feedback.

InsightDescription
KPIsA set of key performance indicators displaying Last Updated timestamp, # Users, # Sessions, # Queries, and Avg Execution Time (in Sec) for the entire system.
Queries per User SessionAn aggregated table showing each user's login name, number of sessions, number of queries, and queries per session ratio.
User Queries by Source with Avg. Execution TimeA table displaying user login names, number of queries, and average execution time broken down by query source (e.g., Nexus Chat).
Queries by Hour of the DayA line chart visualization showing the distribution of queries throughout the day, with separate lines for number of queries and number of users active at each hour.
Queries by SourceA pie chart showing the distribution of queries by their source (e.g., Nexus Chat).
Queries by Stop ReasonA pie chart displaying the outcome of queries categorized by stop reason (SUCCESS, EXCEPTION, CANCEL) with percentage breakdowns.
Feedback for QueriesA donut chart showing the count and percentage of query feedback, such as "like" reactions.
User RatingA detailed table showing individual query ratings with columns for Status, Query text, Query Source, Rating, User, Query Timestamp, Category, and Rating Comments.

Details Tab

The Details tab provides a comprehensive audit log of all Nexus interactions with granular information about each query.

SectionDescription
Audit LogA detailed table displaying comprehensive information for each Nexus query with the following columns:
Session IdUnique identifier for each user session
Query IdNumerical identifier for each query within a session
TimestampDate and time when the query was executed
Login NameUsername of the person who executed the query
User QueryThe actual text of the query submitted by the user
Query SourceThe interface through which the query was submitted (e.g., Nexus Chat)
ContextDetailed context information including client settings, business schema, table name, and verbosity settings
TasksSystem tasks performed to process the query (e.g., MetadataRetrievalOp, PrepareSqlForInsightOp, SqlExecutorOp, GenerateSqlInsightOp)
Result SummaryThe SQL generated by Nexus to answer the user query
Stop ReasonFinal status of the query execution (SUCCESS, EXCEPTION, CANCEL)
Nexus Execution TimeTime in seconds taken to process and respond to the query
Debugging HelpersAdditional debugging information if applicable
Feedback RatingA secondary table showing user feedback on queries with the following columns:
Session IdIdentifier linking feedback to the specific session
Query IdIdentifier linking feedback to the specific query
Feedback TimestampDate and time when the feedback was provided
ActionType of feedback provided (e.g., "like")
CategoryClassification of the feedback if applicable (e.g., "Easy to Understand")
FeedbackSpecific comments provided by the user

Key Metrics Explained

  • # Users: Total number of unique users who have used Nexus.
  • # Sessions: Total number of Nexus sessions initiated.
  • # Queries: Total number of queries submitted to Nexus.
  • Avg Execution Time: Average time in seconds for Nexus to process and respond to queries.
  • Queries per Session: Average number of queries users submit during a single session.
  • Stop Reason: Categorizes query completions as:
    • SUCCESS: Query completed normally
    • EXCEPTION: Query encountered an error
    • CANCEL: Query was canceled by the user
  • Feedback: User reactions to query responses (e.g., "like")
  • Context: Includes information about the business schema, table names, and verbosity settings used for each query
  • Tasks: System operations performed to process a query, such as metadata retrieval, SQL preparation, and execution
  • Result Summary: The actual SQL generated by Nexus to fulfill the user's natural language request

Use Cases for the Dashboard

Usage Monitoring

  • Track overall system adoption and engagement
  • Identify peak usage times and patterns
  • Monitor which users are most actively using the system

Performance Analysis

  • Evaluate query execution times
  • Identify slow-performing queries
  • Track success and failure rates

User Experience Improvement

  • Analyze user feedback patterns
  • Identify commonly asked questions
  • Understand which types of queries receive positive feedback

Audit and Compliance

  • Maintain a complete log of all system interactions
  • Track who asked what questions and when
  • Document the SQL used to generate responses for transparency

Troubleshooting

  • Investigate failed queries
  • Review context settings for problematic sessions
  • Analyze complex queries that may need optimization