Connectors → Oracle Cloud Applications

About Oracle Cloud Applications

Oracle Cloud Applications offer both an integrated suite of cloud applications and the cloud infrastructure platform. Your Oracle Cloud Applications allow you to build and extend your applications and better cope with any process changes.

Oracle Cloud Application Connector Updates

This section is to explore the updates in the newer versions of the Oracle Cloud Application connector available on the Incorta connectors marketplace.

Note

Starting with version 2.2.3.0, this connector supports both UCM and BICC discovery modes. As a result, the connector name has been changed from Oracle Cloud Application (BICC) to Oracle Cloud Applications starting 2024.7.x. It is advisable to use this connector instead of the Oracle Cloud Applications (UCM) connector.

In order to get the newer version of the connector, please update the connector using the marketplace.

VersionUpdates
2.0.2.0Introducing Oracle Cloud Storage integration, where you can choose OCI storage as your storage type. With this new feature added, you must provide: External Storage Name, Bucket Name, OCI Auth Configurations, OCI Private Key, and optionally the OCI Object Storage Uploaded File Name Prefix.
2.2.2.0Requires upgrading the cluster to release 2024.7.x.
  ●  Support for OAuth 2.0 authentication
  ●  Support reading PGP-encrypted files
2.2.3.0Requires upgrading the cluster to release 2024.7.x.
  ●  Support UCM discovery
  ●  The connector name has been changed from Oracle Cloud Application (BICC) to Oracle Cloud Applications.

About the Oracle Cloud Application Connector

The Oracle Cloud Applications connector supports the following Incorta-specific functionality:

FeatureSupported
Chunking
Data Agent
Encryption at Ingest
Incremental Load
Multi-Source
OAuth✔ (starting 2024.7.x)
Performance Optimized
Remote
Single-Source
Spark Extraction
Webhook Callbacks

Steps to connect Oracle Cloud Applications and Incorta

To connect Oracle Cloud Applications and Incorta, here are the high level steps, tools, and procedures:

Create an external data source

Here are the steps to create a external data source with the Oracle Cloud Applications connector:

  • Sign in to the Incorta Direct Data Platform™.
  • In the Navigation bar, select Data.
  • In the Action bar, select + NewAdd Data Source.
  • In the Choose a Data Source dialog, in Database, select Oracle Cloud Applications.
  • In the New Data Source dialog, specify the applicable connector properties.
  • To test, select Test Connection.
  • Select Ok to save your changes.

Oracle Cloud Applications connector properties

Here are the properties for the Oracle Cloud Applications connector:

PropertyControlDescription
Name Your Data Sourcetext boxEnter a name for the data source
Oracle Cloud Applications URLtext boxData location For example, if you set the cluster path prefix to /mycluster when you created a service instance, then your URL should look like: https://public_ip:port/mycluster/app
Authentication Typedropdown listThis option is available starting 2024.7.x.
Select the authentication type:
  ●  Basic: via a username and password
  ●  OAuth 2.0 via a client ID and secret
Usernametext boxEnter the Oracle Cloud Applications account identifier.
This option is available when you select the Basic authentication type.
Passwordtext boxEnter the Oracle Cloud Applications password.
This option is available when you select the Basic authentication type.
Oracle Cloud Identity Service URLtext boxEnter the Oracle Identity Cloud Service URL associated with the Oracle Cloud Applications instance.
This option is required when you select the OAuth 2.0 authentication type.
Client IDtext boxEnter the client ID.
This option is required when you select the OAuth 2.0 authentication type.
Client Secrettext boxEnter the client secret
This option is required when you select the OAuth 2.0 authentication type.
Scopetext boxSpecify the scope of the access request, whether the scope of the Oracle resource or the service URL (Primary Audience) concatenated with the API. You can specify multiple scopes as a space-delimited list.
This option is required when you select the OAuth 2.0 authentication type.
AuthorizebuttonSelect the button to authorize Incorta using the provided OAuth 2.0 credentials.
This option is available when you select the OAuth 2.0 authentication type.
Discovery Modedropdown listThis option is available starting 2024.7.x.
Select the discovery mode:
  ●  BICC: (the default mode in all releases)
  ●  UCM (supported starting 2024.7.x with version 2.2.3.0)
Load Only Files Created Sincetext boxActs as a time filter for all the results concerning this data source. You can either use a fixed date, or a look-back period(number of years, months, or days). Fixed date format: yyyy-MM-dd HH:mm. Example: 2019-05-31 15:30. Look-back period example: 90d.
Extraction Modedrop-down listChoose the appropriate file extension wither CSV or pecsv.
This option is available when you select the BICC discovery mode.
Start BICC Jobs Usingdrop-down listChoose the initiator for the BICC jobs, whether it is BICC (default) or Incorta.
This option is available when you select the BICC discovery mode.
File Name Patterntext boxBy default the file name pattern looks like this example: file_<catalog>_<schema>_<table>batch.zip You can enter an irregular file name pattern, but you must toggle the irregular pattern property in the data source properties before loading.
This option is available when you select the BICC discovery mode and BICC to start BICC jobs.
BICC Jobstext boxEnter the BICC jobs associated with the targeted data stores in the form of ‘job_name = ID’. You can add multiple jobs as comma-separated or line-separated list.
This option is available when you select the BICC discovery mode and Incorta to start BICC jobs.
Root Query Texttext boxAn optional filtering query that can be used to filter files retrieved from WCC. Example: dSecurityGroup <matches> OBIAIMport
This option is available when you select both the BICC discovery mode and the UCM storage type or the UCM discovery mode.
Storage Typedrop downThis option is available starting connector version 2.0.2.0.
Choose the storage type you are using:
  ●   UCM (default)
  ●  OCI Object Storage
This option is available when you select the BICC discovery mode.
External Storage Nametext boxAvailable when choosing OCI Object Storage as your Storage type .
Enter your storage bucket name.
Bucket Nametext boxAvailable when choosing OCI Object Storage as your Storage type .
Enter your storage name.
OCI Auth Configurationstext boxAvailable when choosing OCI Object Storage as your Storage type .
Enter the OCI Auth configurations.
OCI Private KeybuttonAvailable when choosing OCI Object Storage as your Storage type .
Upload your OCI private key file.
OCI Object Storage Uploaded File Name Prefixtext boxAvailable when choosing OCI Object Storage as your Storage type .
Optionally, enter your OCI storage files prefix.
PGP Encrypted FilestoggleThis option is available starting 2024.7.x with version 2.2.2.0.
Enable this option if data files are encrypted using Pretty Good Privacy (PGP)
PGP Private KeybuttonAvailable when you enable PGP Encrypted Files.
Select this button to upload the PGP private key.
PGP Private Key Passphrasetext boxAvailable when you enable PGP Encrypted Files.
Optionally, enter the passphrase that PGP uses to encrypt your private key.
Advanced OptionstoggleEnable this property to use the advanced connection options
Request Page Sizetext boxEnable Advanced Options to configure this property. Enter the maximum number of results to return per page from Oracle Cloud Applications to enhance discovery performance. Setting a higher value may result in better performance at the cost of additional memory consumed per page. The default is 2000.
Maximum SOAP Requests Per Secondtext boxEnter the maximum SOAP requests that can be done in a second. The default is 25.
Max Job Wait Time (in Seconds)text boxEnter the upper limit of the time period (in seconds) during which the job request waits to run.
This option is available when you select Incorta to start BICC jobs.
Job Status Check Interval (in Seconds)text boxEnter the interval (in seconds) to check the job status updates.
This option is available when you select Incorta to start BICC jobs.
Maximum Concurrent Chunkstext boxEnter the maximum number of concurrent chunks that can run. The default is 10.
Extra Optionstext boxEnter supported extra options in the form of key=value.

Create a schema with the Schema Wizard

Here are the steps to create an Oracle Cloud Applications schema with the Schema Wizard:

  • Sign in to the Incorta Direct Data Platform™.
  • In the Navigation bar, select Schema.
  • In the Action bar, select + New → Schema Wizard.
  • In (1) Choose a Source, specify the following:
    • For Enter a name, enter the schema name.
    • For Select a Datasource, select the Oracle Cloud Applications data source.
    • Optionally create a description.
  • In the Schema Wizard footer, select Next.
  • In (2) Manage Tables, in the Data Panel, first select the name of the Data Source, and then check the Select All checkbox.
  • In the Schema Wizard footer, select Next.
  • In (3) Finalize, in the Schema Wizard footer, select Create Schema.

Create a schema with the Schema Designer

Here are the steps to create an Oracle Cloud Applications schema using the Schema Designer:

  • Sign in to the Incorta Direct Data Platform.
  • In the Navigation bar, select Schema.
  • In the Action bar, select + New → Create Schema.
  • In Name, specify the schema name and select Save.
  • In Start adding tables to your schema, select Oracle Cloud Applications.
  • In the Data Source dialog, specify the Oracle Cloud Applications table data source properties.
  • Select Add.
  • In the Table Editor, in the Table Summary section, enter the table name.
  • To save your changes, select Done in the Action bar.

Oracle Cloud Applications table data source properties

For a schema table in Incorta, you can define the following Oracle Cloud Applications specific data source properties as follows:

PropertyControlDescription
Typedrop down listThe default is Oracle Cloud Applications
Data Sourcedrop down listSelect the Oracle Cloud Applications external data source
Data Store Entry Methoddrop down listYou can either select to Enter Fully Qualified Data Store Name or Select from List.
Top-Level Application Moduledrop down listChoose Select from List in Data Store Entry Method to configure this property. Select your catalogue name.
Intermediate Application Moduledrop down listChoose Select from List in Data Store Entry Method to configure this property. Select your schema name.
Data Storetext boxEnter Fully Qualified Data Store name.
IncrementaltoggleEnable the incremental load configuration for the schema table
Irregular PatterntoggleToggle if Fully Qualified Data Store name does not follow conventional pattern of file_<schema>_<catalog>_<table> or if it contains uppercase letters
Which Batches to Loaddrop down listFor full-load-always tables, control which batches you want to load into Incorta. Select one of the options: Load Last Batch Only option (the default) Load All Batches
Data Type Discovery Policydrop down listMetadata Definition files must be uploaded first to Incorta data files, and must have .csv extension.
Load Only Files Created Sincetext boxFilter which files to load based on the file creation timestamp. Use either a fixed date in the format yyyy-MM-dd HH:mm (example: 2019-05-31 15:30), or a look-back period expressed as the number of years, months or days before the loading starts (example: use the value 90d to load files that have been created since 90 days)
Date Formatdrop down listChoose the suitable date format from the list provided. Or, you can choose Other and provide your own format in the Other field that will appear.
Timestamp Formatdrop down listChoose the suitable timestamp format from the list provided. Or, you can choose Other and provide your own format in the Other field that will appear.
Character Setdrop down listSelect the character set
CallbacktoggleEnable this option to call back on the source data set
Callback URLtext boxEnable Callback to configure this property. Specify the URL.

View the schema diagram with the Schema Diagram Viewer

Here are the steps to view the schema diagram using the Schema Diagram Viewer:

  • Sign in to the Incorta Direct Data Platform™.
  • In the Navigation bar, select Schema.
  • In the list of schemas, select the Oracle Cloud Applications schema.
  • In the Schema Designer, in the Action bar, select Diagram.

Load the schema

Here are the steps to perform a Full Load of the Oracle Cloud Applications schema using the Schema Designer:

  • Sign in to the Incorta Direct Data Platform™.
  • In the Navigation bar, select Schema.
  • In the list of schemas, select the Oracle Cloud Applications schema.
  • In the Schema Designer, in the Action bar, select LoadFull Load.
  • To review the load status, in Last Load Status, select the date.

Explore the schema

With the full load of the Oracle Cloud Applications schema complete, you can use the Analyzer to explore the schema, create your first insight, and save the insight to a new dashboard.

To open the Analyzer from the schema, follow these steps:

  • In the Navigation bar, select Schema.
  • In the Schema Manager, in the List view, select the Oracle Cloud Applications schema.
  • In the Schema Designer, in the Action bar, select Explore Data.

Additional Considerations

Types of Incremental Loads

You can enable Incremental Load for a Oracle Cloud Applications data source. There are two types of incremental extracts:

Last Successful Extract Time

Fetch updates since the last time the tables were loaded. It is determined by the difference between the current time and the database timestamp.

Maximum Value of a Column

The column-based strategy depends on an extra column called Incremental Column in each table. The Oracle Cloud Applications connector supports both timestamp and numeric columns. A timestamp column is of the type date or timestamp. A numeric column is of the type int or long.

Note

Changing the incremental load strategy requires a full load to ensure data integrity.