1. Latest Release Home
  2. Guides
  3. Concepts
  4. Tools
  5. References
  6. Integrations
  7. Data applications
  8. Data Governance
  9. Release Notes
  10. Incorta Premium
  11. Release Support Policy
  12. Release Model

Data Applications → Enhanced Audit

The Enhanced Audit dashboard is a comprehensive monitoring tool within Incorta that provides detailed insights into system usage, performance metrics, and user engagement. This dashboard helps administrators track user activity, analyze query performance, and troubleshoot issues to optimize the Incorta platform's performance.

Prerequisites

This is only available to versions 2024.7.x.

Before using the Enhanced Audit dashboard, you must enable the enhanced auditing feature in the Cluster Management Console (CMC):

  1. Navigate to Cluster Management Console (CMC) > Clusters > your_cluster > Server Configurations > Analytics Workload Management
  2. Locate the Analytics Auditing option
  3. Specify the desired auditing level:
    • Standard - Basic audit logging only
    • Enhanced - Detailed audit logging required for this dashboard
    • Both - Maintains both standard and enhanced audit logs

The Enhanced Audit dashboard requires that either "Enhanced" or "Both" options be selected for full functionality.

Insallation

  • Go the to Incorta Marketplace
  • Install the "Enhanced Audit"

Dashboard Structure

The Enhanced Audit dashboard is organized into three main tabs:

  1. User Engagement - Provides insights into how users interact with the system
  2. Query Performance - Displays detailed metrics about query execution and performance
  3. Details - Offers granular information about system activities and tasks

Accessing the Dashboard

The Enhanced Audit dashboard can be accessed via:

  1. Navigate to Content > Incorta Tools > Enhanced Audit
  2. Use the date filter at the top to select the relevant time period for analysis
  3. Navigate between tabs to view different aspects of system performance

User Engagement Tab

The User Engagement tab provides insights into how users are interacting with the Incorta platform.

Key Metrics

  • Last Updated - Timestamp of the most recent data refresh
  • # of users - Total number of active users in the selected period
  • # of dashboards - Total number of dashboards accessed
  • # of queries - Total number of queries executed

Visualizations

  1. Are users engaging? - Chart showing the number of users and queries per month/day
  2. User activity by hour of the day - Chart displaying when users are most active throughout the day
  3. Which dashboards are most popular? - Bubble chart visualizing dashboard popularity, with bubble size indicating usage frequency
  4. Which users are active across multiple dashboards? - Scatter plot showing user activity across dashboards and queries
  5. How are people using the Incorta Direct Data Platform? - Donut chart breaking down user actions (VIEW: 53.9%, ANALYZE: 20.1%, etc.)

Summary Tables

  • User activity summary - Displays detailed information about each user, including:

    • User Name
    • Number of Queries
    • Most Recent Activity
    • Number of Dashboards accessed
    • Query performance metrics (Median, Average, Max)

  • Average Dashboard Query Time - Shows performance metrics for dashboards:

    • Dashboard Name
    • Service Name
    • Run Frequency
    • Average, Minimum, and Maximum Duration

Query Performance Tab

The Query Performance tab focuses on database query execution and system performance.

Key Metrics

  • Last Updated - Timestamp of the most recent data refresh
  • Max Query Time (sec) - Maximum query execution time in seconds
  • Median Query Time (sec) - Median query execution time in seconds

Visualizations

  1. Performance Outliers - Scatter plot showing relationship between average and maximum query times
  2. Max Query Time for the Last 10 Days - Chart tracking performance trends over time
  3. Cache Hit Ratio - Donut chart showing proportion of queries served from cache vs. executed by the engine
  4. Memory Usage and Max Query Time by Insight State - Bar chart showing resource consumption by processing state

Performance Tables

  • Top 10 Dashboards by Max Query Time - Lists the slowest-performing dashboards
  • Top 10 Insights by Max Query Time - Lists the slowest-performing insights
  • Top 10 Dashboards by Memory Use - Shows dashboards consuming the most memory
  • Top 10 Insights by Memory Use - Shows insights consuming the most memory

Details Tab

The Details tab provides granular information about system activities and task execution.

Action Details

Displays comprehensive information about each action in the system:

  • Action ID
  • User Name
  • Tenant ID
  • Source
  • Format
  • Sampling status
  • Mode (e.g., ANALYZE)
  • Dashboard information
  • Tasks Count
  • Termination State (e.g., FAILED, DONE)
  • State (e.g., INITIALIZED, RUNNING, FAILED, DONE)
  • Service Name
  • Start Time
  • Duration (in Sec)
  • Query Mode

Task Details

Provides detailed execution information for individual tasks:

  • Task ID
  • Dashboard and Insight information
  • Task Type
  • Thread ID
  • Start and End Times
  • Termination State
  • Specific processing State (e.g., FILTER_SUBQUERY, RUNTIME_VIEW_EXECUTION)
  • Duration
  • Off Heap Usage Bytes

Using the Dashboard

Performance Monitoring

  1. Use the Query Performance tab to identify slow-running queries and dashboards
  2. Pay attention to the Performance Outliers chart to identify anomalies
  3. Monitor the Cache Hit Ratio to ensure caching is working effectively
  4. Review Memory Usage metrics to identify resource-intensive operations

User Engagement Analysis

  1. Track user activity patterns over time
  2. Identify the most popular dashboards and insights
  3. Analyze usage patterns by time of day
  4. Monitor which users are most active and which resources they access

Troubleshooting

  1. Use the Details tab to investigate failed queries
  2. Examine task execution states to identify bottlenecks
  3. Review execution durations to pinpoint performance issues
  4. Analyze terminated tasks to understand failure patterns

Best Practices

Regular Monitoring

  • Schedule regular reviews of the Enhanced Audit dashboard
  • Set baseline expectations for key metrics
  • Track trends over time to identify performance degradation
  • Pay attention to users experiencing performance issues

Performance Optimization

  • Investigate dashboards with high query times
  • Review insights consuming excessive memory
  • Monitor cache hit ratio and optimize caching strategies
  • Analyze query performance patterns to guide optimization efforts

Resource Planning

  • Use memory usage metrics to plan for capacity requirements
  • Monitor user growth and query volume trends
  • Identify peak usage periods to optimize resource allocation
  • Track dashboard popularity to prioritize optimization efforts

Interpreting Key Metrics

Query Time Metrics

  • Max Query Time - Indicates the worst-case performance scenario
  • Median Query Time - Represents typical user experience
  • Average Query Time - Shows overall performance trends

Cache Performance

  • Cache Hit Ratio - Higher percentages indicate better caching efficiency
  • Engine vs. Cache - Queries served from cache are significantly faster

Memory Usage

  • Memory Usage by Dashboard/Insight - Identify resource-intensive components
  • Memory Usage by State - Understand which processing states require the most resources