Tools → Load Job Viewer
About the Load Job Viewer
The Load Job Viewer shows the details of both the current load job and previous load jobs for a selected physical schema in a given tenant. The load job can be for the whole physical schema or a specific entity object in the physical schema.
Starting from 2023.4.0 release, the Load Job Details Viewer replaced the Load Job Viewer.
The Load Job Viewer only shows the status of a load job from the perspective of the Loader Service, not the Analytics Service. This change from previous releases means that the Load Job Viewer no longer waits for the Analytics Service to report the successful load of performance optimized entity objects into memory. For this reason, in certain cases, the Load Job Viewer may report the successful status of a load job, but a dashboard insight that references the successfully loaded physical schema will show the message: The data is being refreshed
. This means that the Analytics Service is still loading into memory the related performance optimized objects required by the insight query.
Load Job Viewer Access Rights
A user that belongs to a group with the Schema Manager or SuperRole role can access the Load Job Viewer for a physical schema that this user owns or has access rights to. A user that belongs to a group with the SuperRole role or a Super User that is a Tenant Administrator can also access the Load Job Viewer for any physical schema in the tenant regardless of the access rights to the physical schemas in the case that the tenant configuration enables the Super User Mode.
Access the Load Job Viewer
There are three ways to access the Load Job Viewer:
- In the Schema Manager, in the List View, for a physical schema with a Load Status other than No Data Loaded, select the Load Status link, for example:
- Success
- Finished with Errors
- In the Schema Manager, in the List View, for a physical schema with a Load Status other than No Data Loaded, select the Last Load link.
- In the Schema Designer for a given physical schema, in the Summary section, in Last Load Status, select the link:
- Please Load Data
- Date Time
- Load Status such as In Queue, Interrupted, or Finished with Errors
Load Job Viewer Anatomy
The Load Job Viewer consists of the following:
- Header bar
- Jobs section
- Action bar
- Jobs list view
- Page controls
- Job details section
Header bar
The Header bar shows the breadcrumbs trail for the Load Job Viewer as follows: schema_manager_link / physical_schema_link / current_physical_schema_load_job_viewer
.
- Select Schema to access the Schema Manager.
- Select the physical schema link to access the Schema Designer for the current physical schema.
Jobs section
The Jobs section consists of the following:
- Action bar
- Jobs list view
- Page controls
Action bar
The Action bar of the Jobs section contains:
- Down arrow to collapse.
- Right arrow to expand the Jobs list view in the case that you collapsed it.
- The total number of load jobs for the physical schema as a whole and/or for selected entity objects in it.
- Refresh (circle with arrow icon) to update the status or stage for the current or recent load job as well as the load job details for each object in the Job details section.
Jobs list view
The Jobs list view is a summarized table of all load jobs for the given physical schema. For the selected load job summary, the Job details section contains all the load details for each and every entity object in the load job, as applicable. By default, jobs are sorted by the Start Time in descending order: from the newest to the oldest. You can filter the load jobs by status.
The following table shows the details that the Jobs list view includes for each load job summary:
Column | Description | Comment |
---|---|---|
Service | The Loader Service related to the load job | Starting with release 4.9, the Load Job Viewer only shows the status of a load job from the perspective of the Loader Service, not the Analytics Service |
Start Time | The start date and time of the load job | Used to sort the jobs list in descending order |
End Time | The end date and time of the load job | |
Load Status | The status of the load job. The statuses are: ● Succeeded ● Finished With Errors ● Failed ● Interrupted ● Running ● In Queue ● Aborted* | In the case of a running job, the Load Status column shows the current state or phase of the load job. The available states are: ● In Queue ● Extraction ● Enrichment ● Load ● Post-load When you hover over the Load Status, a tooltip appears to detail the durations of parallelized activities and states within a load job. A check mark or a cross mark next to the state denotes if the activity completed successfully or failed, respectively. |
Duration | The time taken to complete the load job, regardless of its final status | A given Loader Service executes many load job activities in parallel. As a result, the Load Status tooltip depicts activity durations that, when aggregated, are typically greater than the overall duration of the load job itself. |
Aborted
is the status of a load job that is automatically forced to stop after exceeding the configured interruption timeout. Starting the 2021.4.3 release, Incorta automatically aborts any load job that is interrupted in the extraction phase and exceeds the configured interruption time interval. For more information, refer to References → Data Ingestion and Loading → Aborted load jobs.
Page controls
The Jobs list view shows 20 jobs at a time. For lists with more than 20 jobs, the view contains page controls. The page controls allow you to navigate forwards or backwards as well as to the first page or to the last page of jobs.
Job Details section
For the selected load job summary, the Job Details section contains all the extraction and load details for each and every physical schema entity object in the load job. You can sort the list by any column either in ascending or descending order. You can also filter the list by object name or load status.
An alias is not and cannot be included in a load job. Thus, you cannot find one in the Job Details section
The Job Load Details table shows the following sortable columns:
Column | Description | Comment |
---|---|---|
Name | The name of the entity object | You can filter the list by using a search term for the object name. Select the name to access the Table Editor for the entity object. |
Load Type | A letter that represents the load type: ● F for Full load ● I for Incremental load ● S for loading from Staging | |
Extraction - Start: | The start date and time of the object data extraction by the Loader Service | This is not available in the case of: ● Loading from staging ● Incorta Analyzer table ● Incorta SQL table |
Extraction - Duration | The duration time for the object data extraction | This is not available in the case of: ● Loading from staging ● Incorta Analyzer table ● Incorta SQL table |
Extraction - Extracted | The number of rows extracted | This value is always zero in the case of: ● Loading from Staging ● Incorta Analyzer table ● Incorta SQL table |
Extraction - Rejected | The number or rows rejected in the extraction | |
Load - Start | The start date and time of the object load into the Analytics Service | This is not available in the case of an object with optimized performance disabled |
Load - Duration | The duration time for the object data loading into the Analytics Service | This is not available in the case of an object with optimized performance disabled |
Load - Loaded | The number of rows loaded by the Analytics Service | This value will be zero in the case of an object with optimized performance disabled |
Status | The current load status of the object with the option to filter by one or more statuses. The available object statuses that you can use to filter the list are: ● Succeeded ● Failed ● Interrupted ● Running ● In Queue Starting with release 4.9, the Status column shows the load activity or state for a given object. While a load is running, these states are: ● In Queue ● Extracting ● Enriching ● Loading ● Post-loading ● Success ● Failed | A tooltip for the object load status details the durations of parallelized activities and states within the extraction and load phases of a object load as follows: ● In Queue ● Extraction ● Enrichment ● Load ● Post-load The activities and related states differ based on the load type (Full, Incremental, or Staging) as well as the table type such as an Incorta SQL table, materialized view, or Incorta Analyzer table |
Load Job Viewer Actions
Using the Load Job Viewer, you can perform the following actions:
- Navigate to the Schema Manager
- Navigate to the physical schema Schema Designer
- Navigate to the Table Editor for a given object
- Refresh the load job status
- Filter the Jobs summary list by Load Status
- Clear the Load Status filter
- Display the load job details for a given job
- View the error details for a non-successful load job
- Filter the Job Details list by object name
- Clear the object name filter
- Filter the Job Details list by load status
- Clear the Job Details Load Status filter
- View the error details for a non-successful load job for an object
- Sort the Job Details list
Navigate to the Schema Manager
- In the Header bar, in the breadcrumb trail, select Schema.
Navigate to the physical schema Schema Designer
- In the Header bar, in the breadcrumb trail, select the physical schema name.
Navigate to the Table Editor for a given object
- In the Job Details section, in the load job details list view, in the Name column, select the object that you want to access in the Table Editor.
Refresh the load job status
- In the Action bar, select Refresh (circle with arrow icon).
Filter the Jobs summary list by Load Status
- In the Jobs section, in the load jobs summary list view, in the Load Status column header, select the filter icon (funnel icon).
- In the dialog, select one or more statuses to show their related jobs.
- Select OK.
Clear the Load Status filter
- In the Jobs section, in the load jobs summary list view, in the Load Status column header, select the filter icon (funnel icon).
- In the dialog, select Reset.
Display the load job details for a given job
- In the Jobs section, in the load jobs summary list view, select the row for a given load job, except for the Load Status column for a non-successful load job (Finished with error or Interrupted, for example).
View the error details for a non-successful load job
- In the Jobs section, in the load jobs summary list view, for a non-successful load job, select the Load Status link.
- In the Job Errors dialog, if applicable, select View Details.
Filter the Job Details list by object name
- In the Job Details section, in the load job details list view, in the Name column header, select the Search icon (magnifying glass icon).
- In the dialog, in the search box, enter a search term, for example, the object name or part of it.
- Select Search.
Clear the object name filter
- In the Job Details section, in the load job details list view, in the Name column header, select the Search icon (magnifying glass icon).
- In the dialog, select Reset.
Filter the Job Details list by load status
- In the Job Details section, in the load job details list view, in the Load → Status column header, select the filter icon (funnel icon).
- In the dialog, select one or more statuses to show their related load job details.
- Select OK.
Clear the Job Details Load Status filter
- In the Job Details section, in the load job details list view, in the Load → Status column header, select the filter icon (funnel icon).
- In the dialog, select Reset.
View the error details for a non-successful load job for an object
- In the Job Details section, in the load job details list view, for a non-successful load job (Failed or Interrupted), select the Load → Status link.
- In the Job Errors dialog, select View Details.
Sort the Job Details list
- In the Job Details section, in the load job details list view, for the column that you want to use to sort the job details list, select the column header to sort by the column value in ascending order, an arrow that points upwards appears next to the column name.
- Select it once more to sort by the column value in descending order, an arrow that points downwards appears next to the column name.