Tools → Scheduler
About the Scheduler
The Scheduler allows you to both manage the scheduled jobs for dashboard delivery and create and manage scheduled jobs for physical schema loads or load plans, data notifications, and schema notifications. Incorta sends the scheduled dashboards, data notifications (dashboard alerts), or schema notifications in an email to the recipients you specify. You can also deliver a dashboard to a Data Destination.
Changelog
Release | Change |
---|---|
2022.11.0 | ● The Load Plans tab replaces Schema Loads. Load plans are scheduled jobs to load multiple physical schemas as well as a single physical schema. ● The multi-schema loading is available as a preview feature, and you must contact Incorta Support to enable this feature on your cluster. |
2023.7.0 | ● Orchestrating load plans using sequencing schema groups. As a schema manager, you can now organize schemas in a load plan into separate groups. The Loader Service simultaneously loads all schemas in the first group, then starts loading the next group, and so on. ● Saving a load plan without setting a schedule. A new status, Not Scheduled, is available on the load plans list. ● Editing a completed load plan. ● Suspending and activating one or more load plans. ● Suspending and activating load plans while editing them. ● The multi-schema load plan is a general availability (GA) feature that is always enabled. ● A new option, Show DAG, is now available as a preview feature to view the execution plan of the load plan visualized as a directed acyclic graph (DAG). |
2024.1.0 | ● The Schema Notifications tab is no longer available and is replaced by the Notifications tab where you can set email notification at the load plan level rather than the schema level. ● A new notification type when a load job takes longer than expected ● Default load type at the load plan level ● Exporting and importing load plans ● Manual load plan execution |
When you select a time zone for scheduled jobs, note that Etc/GMT time zones have the opposite offset of similar GMT time zones. In other words, the Etc/GMT+x
is the opposite of the GMT+x:00
; however, the Etc/GMT+x
is the same as the GMT-x:00
. For example, if the UTC time is 12:00pm, then the time in the Etc/GMT+4
and GMT-4:00
time zones will be 8:00am while the time in the Etc/GMT-4
and GMT+4:00
time zones will be 4:00pm.
- To minimize the impact of Daylight Savings Time (DST) on job start time, ensure that any scheduled job you create runs at least once before DST occurs.
- If you have a browser window open before DST occurs, you will need to refresh the browser page to view the correct Next Run time of a scheduled job after DST occurs.
Scheduler access rights
To access the Scheduler, in the Navigation bar, select Scheduler.
All Incorta Analytics users can access the Scheduler, but not all users can create or manage scheduled jobs. Only users who created or have edit rights to a dashboard can edit a scheduled job for a dashboard delivery. The users who create or have edit rights to a schema can create and manage a scheduled schema load or a load plan.
If you don't have edit rights and didn't create a schema, the +New button is disabled.
Scheduler Anatomy
The Scheduler consists of the following:
Context Bar
The context bar consists of the four tabs:
- Dashboards: contains a list of the scheduled dashboards deliverables.
- Schema Loads: contains a list of the scheduled schema loads. The Load Plans tab replaced Schema Loads starting the 2022.11.0 release.
- Load Plans: contains a list of load plans.
- Data Notifications: contains a list of the configured data notifications (dashboard alerts).
- Schema Notifications: contains a list of the configured schema notifications. The Notifications tab replaced Schema Notifications starting with the 2024.1.0 release.
- Notifications: contains a list of the configured load plan notifications. Available starting with 2024.1.0.
Action Bar
The action bar contains the +New button that opens the New menu. It is available when you open any tab except for the Dashboard tab.
The following are the options available on the New menu:
Option | Description |
---|---|
Add Schema Load | Adds a new scheduled schema load job. Available in releases before 2022.11.0. |
Add Load Plan | Adds a new load plan job. Available in releases starting 2022.11.0. |
Import Load Plan | Import one or more load plans. Available in releases starting 2024.1.0. |
Create DataNotifications | Creates a new dashboard notification. |
Import Data Notifications | Imports data notifications from a .zip file. |
Create Email Notifications | Creates a new email notification upon a schema load success, failure, interruption, or finishing with errors. As of releases before 2023.1.0, email notifications didn’t distinguish between failed, interrupted, and finished with errors jobs. Available in releases before 2024.1.0. |
Create Load Plan Notifications | Creates a new email notification upon the execution of a load plan. Available in releases starting with 2024.1.0. |
The +New button isn't available on the Dashboards tab. You create a dashboard delivery scheduled job from the Content Manager.
Search Bar
The Search bar contains a search text box that is only available on the Schema Notifications, Load Plans and Notifications tabs. For schema notifications and notifications, you can search by any part of a given job name. On the Load Plans tab, you can search by the schema name or the load plan name.
The Search bar shows:
- The number of items in the result list
- The number of selected items in the result list with the option (
x
) to deselect the items - Delete icon: To delete all selected items
- Export icon: To export Data Notifications (only available on the Data Notifications tab)
- More Options: Available starting with 2023.7.0 in the case of load plans only. When you select one or more load plan, the More Options menu shows the following options depending on the status of the selected load plans:
- Activate: Activates suspended load plans in the selected plans.
- Suspend: Suspends active load plans in the selected plans.
- Export: Exports the selected load plans to a
.zip
file. This option is available starting with 2024.1.0. - Delete: Deletes the selected load plans. This option replaces the Delete icon that used to appear when you select multiple load plans before 2023.7.0.
List View
Dashboards list view
The Dashboards list view displays all of the scheduled delivery jobs that you created for a certain dashboard.
Property | Control | Description |
---|---|---|
Select All | checkbox | A header control to select all scheduled jobs for dashboard delivery. |
Name | text | The scheduled job unique name that you entered while creating the scheduled dashboard delivery. |
Owner | text | The username that created the scheduled dashboard delivery. |
Dashboard | link | Select the dashboard name to navigate to the corresponding dashboard. |
Status | link | The status of the scheduled job. When selected, a prompt is displayed to confirm if you want to suspend/activate the scheduled delivery job. A scheduled delivery status can be one of the following: ● Active ● Suspended ● Completed When you create a scheduled dashboard delivery, Status is Active by default. |
Status filter (funnel icon) | dropdown menu | A dropdown menu that contains all possible statuses of a scheduled delivery. By default, the list is filtered by the Active status. Use this dropdown to filter the list with a certain status. The dropdown contains two buttons: ● OK - to apply the filter ● Reset - to clear any filtration applied |
Next Run | text | The date, time, and time zone when a scheduled job will run. |
Delete (trash icon) | button | Select to delete the scheduled delivery. |
When you select the name of a scheduled dashboard delivery, it opens the Schedule dialog, where you can edit the scheduled job details.
Schema Loads list view
The Schema Loads list view displays all scheduled schema load jobs that you created from the Scheduler or from the Schema tab.
The Schema Loads tab isn't available starting 2022.11.0 where the Load Plans tab replaces it.
Property | Control | Description |
---|---|---|
Select All | checkbox | A header control to select all scheduled jobs for schema loads. |
Name | text | The scheduled job unique name that you entered while creating the scheduled schema load. |
Owner | text | The username that created the scheduled schema load. |
Schema | link | Select the schema name to navigate to the schema for which the scheduled load job is created. |
Status | link | The status of the scheduled job. Select to change the status of the scheduled load. A scheduled schema load status can be one of the following: ● Active ● Suspended ● Completed When you create a scheduled schema load, Status is Active by default. |
Status filter (funnel icon) | dropdown menu | A dropdown menu that contains all possible statuses of a scheduled schema load. By default, the list is filtered by the Active status. Use this dropdown to filter the list with a certain status. The dropdown contains two buttons: ● OK - to apply the filter ● Reset - to clear any filtration applied |
Next Run | text | The date, time, and time zone when a scheduled schema load job is to run next. |
Delete (trash icon) | button | Select to delete the scheduled schema load. |
When you select the name of a scheduled schema load, it opens the Edit Schema Load dialog, where you can edit the scheduled schema load details.
Load Plans list view
The Load Plans list view displays all load plans that you have created or have access to. You can view a load plan if you have view access rights to at least one schema in the plan. Available options vary according to your access rights to the schemas in the plan.
- The Load Plans tab is available starting with 2022.11.0.
- Starting with 2023.7.0, you can organize schemas in a load plan into separate groups that the Loader Service handles sequentially in different load jobs. However, the Loader Service continues to handle schemas in a group concurrently in a single load job.
- Starting with 2023.7.0, you can sort the list by the load plan's name, owner, or next run.
Property | Control | Description |
---|---|---|
Select All | checkbox | A header control to select all load plans. |
Name | text | The load plan unique name that you entered while creating it. |
Owner | text | The display name of the user who created the load plan. |
Schemas | links | The names of the schemas in the load plan. ● If more than two schemas exist in the load plan, the names are collapsed and the number of collapsed schemas appears instead. Select the name of the schema to navigate it, or select the number of collapsed items to view all schemas in the load plan. ● If the load plan has multiple groups, it shows the number of schemas and groups. Select the expand button to view each group and the included schemas. |
Status | link | The status of the load plan. The status can be one of the following: ● Active ● Suspended ● Completed ● Not Scheduled (Available starting 2023.7.0 to denote load jobs for which you have not set a schedule yet) When you create a scheduled schema load, the status is Active by default. Select the status link to change it. You can change the status from Active to Suspended and vice versa. |
Status filter (funnel icon) | dropdown list | A dropdown list that contains all possible statuses of a load plan. By default, the list is filtered by the Active and Not Scheduled statuses. Use it to filter the list according to the plan status. To clear the applied filters, select Reset. |
Next Run | text | The date, time, and time zone of the next run of the load plan. |
Delete (trash icon) | button | Select to delete the load plan. Starting with 2023.7.0, the Delete option in the More Options menu (⋮ vertical ellipsis icon) replaced the trash icon that used to appear when you hover over the load plan row. |
Execute Load Plan (play button icon) | button | Select this option to manually start the execution of the respective load plan. Available starting with 2024.1.0. |
Show DAG | link | Select this option to view the execution plan of the load plan visualized as a directed acyclic graph (DAG) For more details, refer to Tools → Load Plan DAG Viewer. |
More Options > Activate | menu item | Available starting with 2023.7.0 in the case of a suspended load plan. Activates the respective suspended load plan. Only the system admin or the load plan owner can activate the load plan. However, the owner of a load plan can't suspend it if it includes one or more schemas that the owner no longer has edit access rights to. |
More Options > Suspend | menu item | Available starting with 2023.7.0 in the case of an active load plan. Suspends the respective active load plan. Only the system admin or the load plan owner can suspend the load plan. However, the owner of a load plan can't suspend it if it includes one or more schemas that the owner no longer has edit access rights to. |
More Options > Export | menu item | Available starting with 2024.1.0. Exports the respective load plan to a .zip file. |
More Options > Delete | menu item | Available starting with 2023.7.0, replacing the Delete (trash icon) option that was available in previous releases. Deletes the respective load plan. Only the system admin or the load plan owner can delete the load plan. However, the owner of a load plan can't delete it if it includes one or more schemas that the owner no longer has edit access rights to. You can't delete a load plan that is being executed. |
When you select the row of a load plan, it opens the Edit Load Plan dialog where you can edit the details and update the schedule. In releases before 2023.7.0, you couldn't edit a completed load plan.
Starting with 2023.7.0, you can edit a completed load plan and change its schedule so that it is active again. You can also suspend or activate a load plan when you edit it and activate or suspend multiple load plans at once.
Deleting a load plan deletes the related notifications.
Data Notifications list view
The Data Notifications list view displays all scheduled data alerts. With the Alert Editor, you can define a data alert. A data alert is a scheduled job that evaluates an alert condition. An alert condition is an Aggregated Table or a Listing Table insight that you create using the Analyzer. If the alert condition evaluates to True, the scheduled job for a data alert sends an email data notification to one or more users, one or more group of users, or one or more email addresses.
Property | Control | Description |
---|---|---|
Select All | checkbox | A header control to select all scheduled data notifications. |
Name | text | The scheduled job unique name that you entered while creating the scheduled alert. |
Owner | text | The username that created the scheduled data notifications. |
Target | link | Select the dashboard name to navigate to the dashboard for which the scheduled alert is created. |
Status | link | The status of the scheduled job. When you select it, a prompt is displayed to confirm if you want to change the status of the scheduled data notification. A scheduled data notification status can be one of the following: ● Active ● Suspended ● Completed When you create a scheduled data notification, Status is Active by default. |
Status filter (funnel icon) | dropdown menu | A dropdown menu that contains all possible statuses of a scheduled data notification. By default, the list is filtered by the Active status. Select to filter the list with a certain status. The dropdown contains two buttons: ● OK - to apply the filter ● Reset - to clear any filtration applied |
Next Run | text | The date, time, and time zone when a scheduled data notification is to run next. |
Delete (trash icon) | button | Select to delete the scheduled data notification. |
Export | button | Select to export the selected data notification to a .zip file that you can use later on to import the scheduled data notification again. |
When you select the name of a scheduled data notification, it opens the Alert Editor dialog, where you can edit the data alert details.
Schema Notifications list view
The Schema Notifications list view displays all email alerts that you created for a schema. The Schema Notifications tab is not available starting with 2024.1.0.
Property | Control | Description |
---|---|---|
Select All | checkbox | A header control to select all scheduled email notifications. |
Name | text | The scheduled notification unique name that you entered while creating the alert. |
Schema(s) | text | Schema(s) name(s) for which you created the email alert. |
Last Modified | text | The date and time when the email notification was last modified. |
Edit (pen icon) | button | Select to edit the email notification. |
Delete (trash icon) | button | Select to delete the scheduled data notification. |
Notifications list view
The Notifications list view displays all email alerts that you created for load plans. The Notifications tab is available starting with 2024.1.0. The Notifications list will show only notifications that you have created. However, the Super User and users with the SuperRole will have full access to all notifications.
Property | Control | Description |
---|---|---|
Select All | checkbox | A header control to select all scheduled load plan notifications. |
Name | text | The scheduled notification unique name that you entered while creating the load plan notification. |
Owner | text | The user who created the load plan notification. |
Load Plan | text | The name of the load plan for which you created the email notification. |
Schemas | text | The names of the schemas in the load plan. ● If more than two schemas exist in the load plan, the names are collapsed and the number of collapsed schemas appears instead. Select the number of collapsed items to view all schemas in the load plan. ● If the load plan has multiple groups, it shows the number of schemas and groups. Select the expand button to view each group and the included schemas. |
Last Modified | text | The date and time when the load plan notification was last modified. |
Edit (pen icon) | button | Select to edit the load plan notification. |
Delete (trash icon) | button | Select to delete the load plan notification. Note: Deleting a load plan deletes all its data load notifications as well. |
Existing schema load notifications will be migrated to load plan notifications during the release upgrade process. Each schema load notification will be automatically assigned to all single-schema load plans for this schema. The migration process will not migrate schema notifications to load plans having multiple schemas. Additionally, schemas with no single-schema load plans will not have their notifications migrated.
- The Last Modified Date of a migrated notification will reflect the migration date.
- Migrating a notification will not change its owner.
- Migrated notifications will follow the following naming convention:
[notification name]_[load plan name]
.
Scheduler Actions
Using the Scheduler, you can perform the following actions:
Dashboards:
Schema Loads:
Load Plans:
- Create a load plan
- View a load plan
- Edit a load plan
- View the execution plan DAG of a load plan
- Manually start the execution of a load plan
- Suspend a load plan
- Suspend one or more load plans
- Activate a load plan
- Activate one or more load plans
- Export a load plan
- Export one or more load plans
- Import one or more load plans
- Delete a load plan
- Delete one or more load plans
Data Notifications:
- Create a Data Notification
- Edit a Data Notification
- Export Data Notifications
- Import Data Notifications
Schema Notifications:
Load Plan Notifications:
- Create a load plan notification
- Edit a load plan notification
- Search the list of load plan notifications
General actions:
Dashboard
Edit scheduled Dashboards
To schedule a dashboard for delivery, use the Content Manager. For more information, refer to Schedule Delivery of the Dashboard.
You can edit a scheduled dashboard delivery job through the Scheduler using the following steps:
- Select a scheduled Dashboard job.
- Edit the details of the scheduled job.
- Select Save changes.
Schema Loads
The Schema Loads tab isn't available starting 2022.11.0 when the Load Plans tab replaces it. You can use the Load Plans tab to create scheduled jobs to load one or more physical schemas.
Create scheduled Schema Loads
You can schedule a job to load a certain schema from the Schema Manager.
You can also create a scheduled job from the Scheduler by applying the following steps:
Open the Scheduler.
Go to the Schema Loads tab.
From the Action bar, select + New → Add Schema Load.
The Add Schema Load dialog opens.
Fill in the following options in the dialog to schedule the Schema Load job.
Property | Control | Description |
---|---|---|
Schema Load Name | text box | Enter a unique name for the Schema Load job you are creating. |
Description | text box | Enter a description for the Schema Load job. |
Schema | dropdown menu | Select the desired Schema to schedule a load job. The list only displays the available schema(s) that you can edit. |
Load Type | dropdown menu | Select the type of the load you want to perform. The types of load are: ● Full ● Incremental (default) ● Staging |
Recur Every | increments and dropdown menu | Select the recurrence of the load job by selecting an interval of minutes, hours, days, weeks, or months. This option is disabled when you select the No recurrence checkbox. |
No recurrence | checkbox | Select the checkbox to schedule the load job for one time only. This option is unselected by default. |
At | time and time zone selection | Select the time and time zone desired to schedule the Schema Load job. |
At → Now | button | (Optional) Select Now in the time dropdown menu to choose current local time. |
At → Ok | button | Select to confirm the time you chose. |
Between | checkbox | Select the checkbox to schedule the load job between a specific time start time and end time. |
Between | time and time zone selection | Select the start time, end time, and time zone desired to schedule the Schema Load job. |
Between → Ok | button | Select to confirm the time you chose. |
Every | increments and dropdown menu | Select the recurrence of the load job by selecting an interval of minutes or hours. This option is only enabled when you select the Between checkbox. |
From / On | calendar | Select the date range of the Schema Load job. The field name changes to On when you select the No recurrence checkbox. |
Does not end | checkbox | Select this checkbox to disable the end date of the load job. Not available when you select the No recurrence checkbox. |
Add | button | Select to save the dialog and add the scheduled job to the list. |
Cancel | button | Select to cancel what you have entered and close the dialog. |
Edit scheduled Schema Loads
You can edit a scheduled Schema Load through the Scheduler using the following steps:
- On the Schema Loads tab, Select a scheduled Schema Load job.
- The Edit Schema Load dialog opens.
- Edit the details of the scheduled job.
- Select Save.
Load Plans
Starting with 2023.7.0, you can activate and suspend multiple load plans. You can also activate and suspend a single plan using the plan's More Options menu that is available starting with this release.
Only the system admin or the load plan owner can edit, suspend, activate, and delete the load plan. However, the owner of a load plan can't perform these actions if the load plan includes one or more schemas that the owner no longer has edit access rights to. You can't edit or delete a load plan that is being executed; however, you can change its schedule, and suspend or activate it.
Create a load plan
You can create a load plan with one or more physical schema from the Schema Manager or the Schema Designer.
To be able to create a load plan with multiple schemas, the multi-schema loading feature must be enabled on your cluster. This feature is always enabled starting with 2023.7.0. You can add to a load plan only schemas that you own or have edit access rights to.
You can create a load plan from the Scheduler by applying the following steps in releases before 2023.7.0:
- In the navigation bar, select Scheduler.
- Go to the Load Plans tab.
- From the Action bar, select + New → Add Load Plan. The Add Load Plan dialog opens.
- Fill in the following details in the dialog to schedule the load plan.
- Select Add.
The following table shows the details of a load plan.
Property | Control | Description |
---|---|---|
Name | text box | Enter a unique name for the load plan you are creating. |
Description | text box | Enter a description for the load plan. |
Schemas/Schema | list/ dropdown list | Select the schema or schemas that you want to schedule a job to load. The list displays the schemas that you can edit. The Schemas list is available only when the multi-schema loading feature is enabled. If the list contains more than 20 schemas, page controls are available to navigate the list. |
Schemas > Search Schemas | text box | Available only when the multi-schema loading feature is enabled. Search for the schemas you want to include in the load plan. |
Schemas > Default Load Type | dropdown list | Available only when the multi-schema loading feature is enabled. Specify the default load type before selecting the required schemas. Specifying a default load type doesn’t affect the load type you specify for the selected schemas. To apply the default load type to the selected schemas, select Reset. |
Schemas > select all | checkbox | Select all schemas that currently appear on the list. ● If the list contains multiple pages, you select only schemas on this page. ● If you search for schemas, you select the schemas that match your search. ● If the search result contains multiple pages, you select the schemas on the current page. |
Load Type | dropdown list | Select the load type you want to perform. The types are ● Full ● Incremental (default) ● Staging When creating a multi-schema load plan, you can determine the load type per schema. You can also apply a specific type to all schemas. |
Recur Every | increments and dropdown list | Select the recurrence of the job by selecting an interval of minutes, hours, days, weeks, or months. This option isn’t available when you select the No Recurrence checkbox. |
No Recurrence | checkbox | Select the checkbox to schedule the job for one time only. This option is unselected by default. |
At | time and time zone selection | Select the time and time zone to run the load plan job. Select Now to immediately run the job. |
Between | checkbox | Select the checkbox to schedule the load plan job to run within a specific period. You have to define the start time, end time, and timezone. |
Every | increments and dropdown list | Select the recurrence of the load plan job by selecting an interval of minutes or hours. This option is available only when you select the Between checkbox. |
From / On | calendar | Select the date range of the load plan job. The field name changes to On when you select the No Recurrence checkbox. |
Does not end | checkbox | Select this checkbox to disable the end date of the load plan job. It isn't available when you select the No Recurrence checkbox. |
Add | button | Select to save the dialog and add the scheduled job to the list. |
Cancel | button | Select to discard what you have entered and close the dialog. |
Create a load plan in 2023.7.0 and later
The following are the steps and details of creating a load plan starting with 2023.7.0.
- In the navigation bar, select Scheduler.
- Go to the Load Plans tab.
- From the Action bar, select + New → Add Load Plan. The New Load Plan dialog opens.
- Enter a name for the load plan and optionally enter a description.
- Specify the default load type for the schemas you will add to the load plan.
- Under Select Schema, drag one or more schemas to the Selected Schemas list.
- To select multiple schemas, use the Command or Ctrl key while selecting the schemas. You can add a schema only once in the load plan.
- Optionally, change the load type for each schema.
- To remove a schema from the list, select the remove button (x icon).
- Optionally, select Set sequential loading groups to add a new group and drag schemas to it.
- To add more groups, select New Group.
- To remove all schemas from the group, select More Options (⋮ vertical ellipsis icon), and then select Clear All.
- To move a schema from one group to another, drag the schema from a group to another.
- To delete a group, select More Options (⋮ vertical ellipsis icon), and then select Delete
- Select Save.
- Under Scheduler, specify the scheduling options of the load plan, and then select Save.
- To save the load plan without setting a schedule to run it, select Schedule later.
- Select Close.
The default load type option is available starting with 2024.1.0. Whenever you add a new schema to the load plan, it inherits the default load type. If you change the default load type, it will not affect the schemas that you have already added.
View a load plan
You can view a load plan if you have view access rights to at least one schema in the plan. Available options vary according to your access rights to schemas in the plan.
Here are the steps to view the details of a load plan:
- On the Load Plans tab, select a load plan.
- In the Edit Load Plan dialog, review the details of the selected load plan. Starting with 2023.7.0, the included schemas appear in the Load Plan section, and if a schedule is set to run the load plan, the Scheduler part shows a summary of this load schedule.
- Select Close to exit the dialog.
Edit a load plan
Only the system admin or the load plan owner can edit the load plan. However, the owner of a load plan can't edit it if it includes one or more schemas that the owner no longer has edit access rights to. You can’t edit a completed load plan in releases before 2023.7.0. Additionally, you can't edit a load plan that is being executed; however, you can change its schedule, and suspend or activate it.
You can edit a load plan through the Scheduler using the following steps:
- On the Load Plans tab, select a load plan. The Edit Load Plan dialog opens.
- Edit the details of the load plan.
- Select Save.
Starting with 2023.7.0:
- To edit the details of a load plan, such as the name or selected schemas, in the Edit Load Plan dialog, under Load Plan, select Change.
- To edit the schedule of the load plan, in the Edit Load Plan dialog, under Scheduler, select Change.
- To suspend the scheduler of a load plan, under Scheduler, turn the Suspend scheduler toggle on.
- To activate the scheduler of a suspended load plan, under Scheduler, turn the Suspend scheduler toggle off.
You must save the changes to the load plan and scheduler separately before you close the Edit Load Plan dialog.
View the execution plan DAG of a load plan
You can view the execution plan of a load plan using the following steps:
- On the Load Plans tab, for the load plan you want, select Show DAG.
- In the Load Plan DAG Viewer, expand the nodes to show the included objects and processes.
For more details, refer to Tools → Load Plan DAG Viewer.
Manually start the execution of a load plan
You can manually start the execution of a load plan if you own or have Edit access to all schemas in the load plan, regardless of its schedule status: Active, Suspended, Completed, or Not Scheduled. You can't start the execution of a load plan that is already running. Manually executing a load plan does not impact the next scheduled run if exists.
To manually start the execution of a load plan:
- On the Load Plans tab, for the load plan you want, select Execute Load Plan (play button icon).
You can stop the execution of a load plan from the Schema Manager > Load Jobs. You can also review the progress and status of a load plan execution on the Load Job Details Viewer.
Suspend a load plan
Here are the steps to suspend an active load plan.
- On the Load Plans tab, do one of the following:
- In the Scheduler column, select the Active status.
- Hover over the active load plan, select More Options (⋮ vertical ellipsis icon), and then select Suspend.
- Select the active load plan row, and then in the Search bar, select More Options (⋮ vertical ellipsis icon) > Suspend.
- In the Confirm Changing Status dialog, select Ok to confirm changing the status of the job.
Suspend one or more load plans
Here are the steps to suspend one or more active load plans.
- On the Load Plans tab, select the rows of the plans you want to suspend.
- In the Search bar, select More Options (⋮ vertical ellipsis icon), and then select Suspend.
- In the Confirm Changing Status dialog, select Ok to confirm changing the status of the job.
If you select load plans with different statuses, the system suspends only active plans that you can edit.
Activate a load plan
Here are the steps to activate a suspended load plan.
- On the Load Plans tab, do one of the following:
- In the Scheduler column, select the Suspended status.
- Hover over the suspended load plan, select More Options (⋮ vertical ellipsis icon), and then select Activate.
- Select the suspended load plan row, and then in the Search bar, select More Options (⋮ vertical ellipsis icon) > Activate.
- In the Confirm Changing Status dialog, select Ok to confirm changing the status of the job.
Activate one or more load plans
Here are the steps to activate one or more suspended load plans.
- On the Load Plans tab, select the rows of the plans you want to activate.
- In the Search bar, select More Options (⋮ vertical ellipsis icon), and then select Activate.
- In the Confirm Changing Status dialog, select Ok to confirm changing the status of the job.
If you select load plans with different statuses, the system activates only suspended plans that you can edit.
Export a load plan
Here are the steps to export a load plan a .zip
file.
- On the Load Plans tab, do one of the following:
- Hover over the load plan you want, select More Options (⋮ vertical ellipsis icon), and then select Export.
- Select the load plan row, and then in the Search bar, select More Options (⋮ vertical ellipsis icon) > Export.
Export one or more load plans
Here are the steps to export one or more load plans to a .zip
file.
- On the Load Plans tab, select the load plans you want to export.
- In the Search bar, select More Options (⋮ vertical ellipsis icon) > Export.
Import one or more load plans
Here are the steps to import one or more load plans.
- On the Action bar, select New, and then select Import Load Plan.
- In the Import Load Plan dialog, select the Overwrite existing load plans if you want to replace existing load plans with the new ones if they share the same name.
- Drag or browse to locate the
.zip
file that contains the load plans you want to import.
A dialog appears showing the status of the import operation.
Importing load plans fails in the following cases:
- The imported load plan has one or more schemas that do not exist in the target tenant.
- You do not have edit access rights to all schemas in the load plan.
- The imported load plan shares the same name with an existing load plan while the Overwrite existing load plans option is not selected.
Delete a load plan
Only the system admin or the load plan owner can delete the load plan. However, the owner of a load plan can't delete it if it includes one or more schemas that the owner no longer has edit access rights to. You can't delete a load plan that is being executed. When you delete a load plan, its execution history will be maintained, and it continues to appear on the Schema Manager > Load Jobs page.
- When you delete a schema that exists in a single-schema load plan, the load plan will be automatically deleted along with its scheduled runs. However, the load plan history will remain in the Schema Manager > Load Jobs.
- When you delete a schema that exists in a multi-schema load plan:
- If the schema is part of a load group with other schemas, the schema will be removed from the group. However, load job history of this load plan will keep reference to this schema.
- If the schema exists alone in a load group, the group will be removed from the load plan. However, load job history of this load plan will keep reference to this schema.
You can delete a load plan through the Scheduler using the following steps in releases before 2023.7.0.
- On the Load Plans tab, hover over the load plan you want, and then select Delete (trash can icon).
- In the dialog, select Delete.
Starting with 2023.7.0, you can follow these steps to delete a load plan.
- On the Load Plans tab, do one of the following:
- Hover over the load plan, select More Options (⋮ vertical ellipsis icon), and then select Delete.
- Select the load plan row, and then in the Search bar, select More Options (⋮ vertical ellipsis icon) > Delete.
- In the dialog, select Delete.
Delete one or more load plans
Here are the steps to delete one or more load plans.
- On the Load Plans tab, select the rows of the plans you want to delete.
- In the Search bar, select More Options (⋮ vertical ellipsis icon), and then select Delete.
- In the dialog, select Delete. The system deletes only plans that you can delete and as applicable according to their statuses.
If the selection includes load plans that are being executed or that you don't have privilege to delete, they won't be deleted.
Data Notifications
A data notification is an email notification for a data alert. From the Scheduler, you can define and edit the properties of a data alert using the Alert Editor.
Create a data notification
From the Scheduler, you can create and edit the properties of a data alert using the Alert Editor. Here are the steps to open the Alert Editor from the Scheduler:
- In the Navigation bar, select Scheduler.
- In the Context bar, select the Data Notifications tab.
- In the Action bar, select +New → Create Notifications to open the Alert Editor.
- Define the properties of the data alert with the Alert Editor.
A data notification example
Assuming you created a Dashboard named Sales Insight for the SALES schema, the following is an example to create a data notification (alert) for this dashboard.
You must have the email configuration set for your tenant in the CMC. Refer to the Configure Tenants guide for more information.
In this example, you will create an email alert for the Sales Insight dashboard to be sent daily to your email if the cost of the goods is less than 500.
- Open the Scheduler and go to the Data Notifications tab.
- Select + New → Create Notifications.
- The Alert Editor window opens.
- Fill in the Name field to be: Sales Insight Alert.
- (Optional) Add a description to this alert in the Description field.
- Select the Type of the attachment to be HTML.
- In the Target field, select the pen icon, and then navigate to the Sales Insight dashboard.
- Select Tab1, and then select Add.
- For the Condition field, select the pen icon to open the Analyzer:
- In Data, select Add Data Set, expand the SALES schema, and then select the SALES table.
- Drag and drop the Sales Date column to the Grouping Dimension tray.
- Drag and drop the Cost column to the Measure tray, and change the format to Dollar.
- Drag and drop Add Formula to the Individual Filter tray.
- Add the following formula in the Formula Builder:
SALES.SALES.COST_OF_GOODS < 500
- Select Validate & Save.
- Change the Column Label to be Cost less than 500.
- Select Save.
- Select the Start By field to be today’s date and the current time on your machine.
- Select the Recurrence to be Daily, Every 1 day, and No End for example purposes.
- In the Send To field, select +:
- Add your email address.
- Select Add.
- Select Done.
Edit a data notification
You can edit a scheduled data notification (alert) through the Scheduler using the following steps:
- Select a scheduled alert job.
- The Alert Editor dialog opens.
- Edit the details of the scheduled alert.
- Select Done.
Export Data Notifications
The Scheduler enables you to export Data Notifications you created to be able to import them later on.
You can export Data Notifications by applying the following steps:
To export one scheduled job:
Hover on or select a scheduled data notification.
Select the Export button.
The Scheduler downloads a .zip file to your machine.
To export multiple scheduled jobs:
Select multiple scheduled data notifications.
Select the Export button.
The Scheduler downloads a .zip file to your machine.
Import Data Notifications
The Scheduler enables you to import .zip files that contain Data Notifications. You can import Data Notifications by performing the following steps:
- From the Action bar, select + New → Import Data Notifications.
- The Import Alerts window opens.
- Select Overwrite existing alerts option if you want to delete any alerts that you created before and create new ones.
- Browse to, or drag and drop, the .zip file that contains the notifications you want to import.
Schema Notifications
Schema notifications are no longer available starting with 2024.1.0 and were replaced by load plan notifications.
Create a Schema Notification
You can create an email alert for one or multiple certain schemas. The alert that you create is triggered upon the success or failure of a schema load.
Perform the following steps to create the schema load alert:
- Open the Scheduler.
- Go to the Schema Notifications tab.
- From the Action bar, select + New → Create Email Notifications. The Create Email Notification dialog opens.
- Fill in the following options in the dialog to create a schema notification job.
- Select Done to save the email notification.
Property | Control | Description |
---|---|---|
Notification Name | text box | Enter the name of the email notification job you are creating. |
Notify upon | multi-select | Select when you want to send the email notification. There are 4 possible values: ● Success ● Failure (Default) ● Finishing With Error ● Interruption Note: Before 2023.1.0, you have only two options: Success and Failure. Jobs that finished with errors or were interrupted were considered failed jobs when sending the notification. There was no differentiation between the three cases then. |
Select Schema(s) | multi-select | Select one or multiple schemas you want to send an alert for. |
Recipients | text box | Enter the email, name, or group of recipients you want to send the email notification to. |
Body | text box | (Optional) Enter the body for the email notification job you are creating. If you didn't enter a body for the email notification, Incorta sends a body with auto-generated text that contains the sender name, the schema name, its status, and URL. |
Edit a Schema Notification
You can edit a scheduled schema notification (alert) through the Scheduler using the following steps:
- Select a scheduled alert job. The Edit Email Notification dialog opens.
- Edit the details of the scheduled alert.
- Select Done.
Search the list of Schema Notifications
The Scheduler enables you to search the list of Schema Notifications through the search bar available in the list view.
To search for a scheduled schema notification:
- Open the Scheduler, and go to the Schema Notifications tab.
- In the search bar, enter the schema notification job name.
- The search result is displayed according to the keyword you entered.
You can only search the Schema Notifications list using the schema notification job name.
Notifications
Load plan notifications are available starting with 2024.1.0.
- You can add notifications for load plans that you own or have Edit access to.
- The system admin can edit all notifications.
- The notification owners can edit their notifications. If the owner no longer has Edit access to a load plan, the owner can't update the related notifications and can only delete them.
Create a load plan notification
You can create an email alert for a load plan that you own or have Edit access rights to. The alert that you create is triggered upon the success or failure of a load plan execution job.
You can also create email notifications for load jobs that take longer than expected, based on the load time of recent load jobs for the same load plan. This feature helps you detect delays in data refresh cycles as early as possible and act accordingly.
Perform the following steps to create a load plan notification:
- Open the Scheduler.
- Go to the Notifications tab.
- From the Action bar, select + New → Create Load Plan Notification. The Create Load Plan Notification dialog opens.
- Fill in the following options in the dialog to create a load plan notification job.
- Select Done to save the email notification.
Property | Control | Description |
---|---|---|
Notification Name | text box | Enter the name of the load plan notification job you are creating. |
Select a Load Plan | drop down list | Select the load plan you want to send an alert for. Groups and schemas in the selected load plan are displayed. |
Notify upon | multi-select | Select when you want to send the notification email. There are 5 possible values: ● Success ● Failure (Default) ● Finishing With Error ● Interruption ● Taking longer than expected For notifications for jobs taking longer than expected, you can specify the percentage that triggers the notification job. |
Recipients | text box | Enter the email, name, or group of recipients you want to send the email notification to. |
Email Body | text box | (Optional) Enter the body of the notification email. If you do not enter a body for the notification email, Incorta sends a body with auto-generated text that contains the sender name, the load plan name, its status, and URL. |
Edit a load plan notification
You can edit a load plan notification (alert) through the Scheduler using the following steps:
- Select a scheduled notification job. The Edit Load Plan Notification dialog opens.
- Edit the details of the scheduled alert.
- Select Done.
Search the list of load plan notifications
The Scheduler enables you to search the list of Notifications through the search bar available in the list view.
To search for a scheduled load plan notification:
- Open the Scheduler, and go to the Notifications tab.
- In the search bar, enter the load plan notification job name.
- The search result is filtered according to the keyword you entered.
You can search the load plan notifications list by the notification job name only.
General Scheduler Actions
Suspend and activate scheduled jobs
When you suspend a scheduled job, the job will pause all future actions. You can resume the job's scheduled actions by returning the job to active. When you create a scheduled job, its status is Active by default. Starting with 2023.7.0, you can save a load plan without setting a schedule. Additionally, you can suspend or activate a load plan while editing it.
You can activate or suspend a scheduled job for the following:
- Dashboards
- Schema Loads
- Load Plans
- Data Notifications
The following steps show how to suspend or activate a job:
- In the Scheduler, identify the desired scheduled job.
- In the status column, select the current status for the scheduled job (the status will be Active or Suspended).
- Confirm Changing Status window will appear.
- Select Ok to confirm changing the status of the job.
You can select Never Mind to cancel.
The Scheduler, by default, filters to display Active jobs only. See filter scheduled jobs to display the desired scheduled jobs based on status.
Deleting a bookmark automatically suspends the related scheduled jobs. Also, changing a bookmark from public to private suspends all related dashboard scheduled jobs that other users created. However, the scheduled jobs that the bookmark owner created will run as usual.
You can't activate a dashboard delivery job that has been suspended due to deleting a bookmark or changing it to private. You have to first edit the scheduled job to remove the bookmark or select a valid one.
Delete scheduled jobs
The Scheduler enables you to delete one or multiple scheduled jobs.
To delete one scheduled job:
- Select or hover on a scheduled job.
- Select the Delete button (bin icon).
- The Delete this job? confirmation window appears.
- Confirm deleting the job by selecting Delete.
To delete multiple scheduled jobs:
- Select multiple scheduled jobs.
- Select the Delete button (bin icon).
- The Delete these jobs? confirmation window appears.
- Confirm deleting the job by selecting Delete.
You can select Never Mind to cancel.
Filter scheduled jobs
You can filter the list of the scheduled jobs for the following according to their status:
- Dashboards
- Schema Loads
- Load Plans
- Data Notifications
A scheduled job can have one of three statuses:
- Active (default): Indicates that the job is active and will run according to schedule.
- Suspended: Indicates that the job is on hold and won't run.
- Completed: Indicates that the job was completed successfully and does have next runs.
- Not Scheduled: Indicates that you have not set a schedule for the job. This status is available only for load plans starting with 2023.7.0.
By default, the list displays the jobs with Active status only. The Load Plans list shows both active and not scheduled jobs.
To filter the list of scheduled jobs, do the following:
- Select the Status filter (funnel icon).
- Select the status(es) you want to filter the list with.
- Select OK.
- The list will only display the jobs that have the status(es) you selected.
You can select Reset to clear any selection.