Connectors → Oracle Cloud Applications
About Oracle Cloud Applications
Oracle Cloud Applications offer both an integrated suite of cloud applications and the cloud infrastructure platform. Your Oracle Cloud Applications allow you to build and extend your applications and better cope with any process changes.
Oracle Cloud Application Connector Updates
This section is to explore the updates in the newer versions of the Oracle Cloud Application connector available on the Incorta connectors marketplace.
Starting with version 2.2.3.0, this connector supports both UCM and BICC discovery modes. As a result, the connector name has been changed from Oracle Cloud Application (BICC) to Oracle Cloud Applications starting 2024.7.x. It is advisable to use this connector instead of the Oracle Cloud Applications (UCM) connector.
In order to get the newer version of the connector, please update the connector using the marketplace.
Version | Updates |
---|---|
2.0.2.0 | Introducing Oracle Cloud Storage integration, where you can choose OCI storage as your storage type. With this new feature added, you must provide: External Storage Name, Bucket Name, OCI Auth Configurations, OCI Private Key, and optionally the OCI Object Storage Uploaded File Name Prefix. |
2.2.2.0 | Requires upgrading the cluster to release 2024.7.x. ● Support for OAuth 2.0 authentication ● Support reading PGP-encrypted files |
2.2.3.0 | Requires upgrading the cluster to release 2024.7.x. ● Support UCM discovery ● The connector name has been changed from Oracle Cloud Application (BICC) to Oracle Cloud Applications. |
About the Oracle Cloud Application Connector
The Oracle Cloud Applications connector supports the following Incorta-specific functionality:
Feature | Supported |
---|---|
Chunking | |
Data Agent | |
Encryption at Ingest | |
Incremental Load | ✔ |
Multi-Source | ✔ |
OAuth | ✔ (starting 2024.7.x) |
Performance Optimized | ✔ |
Remote | |
Single-Source | ✔ |
Spark Extraction | |
Webhook Callbacks | ✔ |
Steps to connect Oracle Cloud Applications and Incorta
To connect Oracle Cloud Applications and Incorta, here are the high level steps, tools, and procedures:
- Create an external data source
- Create a schema with the Schema Wizard
- or,Create a schema with the Schema Designer
- Load the schema
- Explore the schema
Create an external data source
Here are the steps to create a external data source with the Oracle Cloud Applications connector:
- Sign in to the Incorta Direct Data Platform™.
- In the Navigation bar, select Data.
- In the Action bar, select + New → Add Data Source.
- In the Choose a Data Source dialog, in Database, select Oracle Cloud Applications.
- In the New Data Source dialog, specify the applicable connector properties.
- To test, select Test Connection.
- Select Ok to save your changes.
Oracle Cloud Applications connector properties
Here are the properties for the Oracle Cloud Applications connector:
Property | Control | Description |
---|---|---|
Name Your Data Source | text box | Enter a name for the data source |
Oracle Cloud Applications URL | text box | Data location For example, if you set the cluster path prefix to /mycluster when you created a service instance, then your URL should look like: https://public_ip:port/mycluster/app |
Authentication Type | dropdown list | This option is available starting 2024.7.x. Select the authentication type: ● Basic: via a username and password ● OAuth 2.0 via a client ID and secret |
Username | text box | Enter the Oracle Cloud Applications account identifier. This option is available when you select the Basic authentication type. |
Password | text box | Enter the Oracle Cloud Applications password. This option is available when you select the Basic authentication type. |
Oracle Cloud Identity Service URL | text box | Enter the Oracle Identity Cloud Service URL associated with the Oracle Cloud Applications instance. This option is required when you select the OAuth 2.0 authentication type. |
Client ID | text box | Enter the client ID. This option is required when you select the OAuth 2.0 authentication type. |
Client Secret | text box | Enter the client secret This option is required when you select the OAuth 2.0 authentication type. |
Scope | text box | Specify the scope of the access request, whether the scope of the Oracle resource or the service URL (Primary Audience) concatenated with the API. You can specify multiple scopes as a space-delimited list. This option is required when you select the OAuth 2.0 authentication type. |
Authorize | button | Select the button to authorize Incorta using the provided OAuth 2.0 credentials. This option is available when you select the OAuth 2.0 authentication type. |
Discovery Mode | dropdown list | This option is available starting 2024.7.x. Select the discovery mode: ● BICC: (the default mode in all releases) ● UCM (supported starting 2024.7.x with version 2.2.3.0) |
Load Only Files Created Since | text box | Acts as a time filter for all the results concerning this data source. You can either use a fixed date, or a look-back period(number of years, months, or days). Fixed date format: yyyy-MM-dd HH:mm. Example: 2019-05-31 15:30. Look-back period example: 90d. |
Extraction Mode | drop-down list | Choose the appropriate file extension wither CSV or pecsv. This option is available when you select the BICC discovery mode. |
Start BICC Jobs Using | drop-down list | Choose the initiator for the BICC jobs, whether it is BICC (default) or Incorta. This option is available when you select the BICC discovery mode. |
File Name Pattern | text box | By default the file name pattern looks like this example: file_<catalog>_<schema>_<table>batch.zip You can enter an irregular file name pattern, but you must toggle the irregular pattern property in the data source properties before loading. This option is available when you select the BICC discovery mode and BICC to start BICC jobs. |
BICC Jobs | text box | Enter the BICC jobs associated with the targeted data stores in the form of ‘job_name = ID’. You can add multiple jobs as comma-separated or line-separated list. This option is available when you select the BICC discovery mode and Incorta to start BICC jobs. |
Root Query Text | text box | An optional filtering query that can be used to filter files retrieved from WCC. Example: dSecurityGroup <matches> OBIAIMport This option is available when you select both the BICC discovery mode and the UCM storage type or the UCM discovery mode. |
Storage Type | drop down | This option is available starting connector version 2.0.2.0. Choose the storage type you are using: ● UCM (default) ● OCI Object Storage This option is available when you select the BICC discovery mode. |
External Storage Name | text box | Available when choosing OCI Object Storage as your Storage type . Enter your storage bucket name. |
Bucket Name | text box | Available when choosing OCI Object Storage as your Storage type . Enter your storage name. |
OCI Auth Configurations | text box | Available when choosing OCI Object Storage as your Storage type . Enter the OCI Auth configurations. |
OCI Private Key | button | Available when choosing OCI Object Storage as your Storage type . Upload your OCI private key file. |
OCI Object Storage Uploaded File Name Prefix | text box | Available when choosing OCI Object Storage as your Storage type . Optionally, enter your OCI storage files prefix. |
PGP Encrypted Files | toggle | This option is available starting 2024.7.x with version 2.2.2.0. Enable this option if data files are encrypted using Pretty Good Privacy (PGP) |
PGP Private Key | button | Available when you enable PGP Encrypted Files. Select this button to upload the PGP private key. |
PGP Private Key Passphrase | text box | Available when you enable PGP Encrypted Files. Optionally, enter the passphrase that PGP uses to encrypt your private key. |
Advanced Options | toggle | Enable this property to use the advanced connection options |
Request Page Size | text box | Enable Advanced Options to configure this property. Enter the maximum number of results to return per page from Oracle Cloud Applications to enhance discovery performance. Setting a higher value may result in better performance at the cost of additional memory consumed per page. The default is 2000. |
Maximum SOAP Requests Per Second | text box | Enter the maximum SOAP requests that can be done in a second. The default is 25. |
Max Job Wait Time (in Seconds) | text box | Enter the upper limit of the time period (in seconds) during which the job request waits to run. This option is available when you select Incorta to start BICC jobs. |
Job Status Check Interval (in Seconds) | text box | Enter the interval (in seconds) to check the job status updates. This option is available when you select Incorta to start BICC jobs. |
Maximum Concurrent Chunks | text box | Enter the maximum number of concurrent chunks that can run. The default is 10. |
Extra Options | text box | Enter supported extra options in the form of key=value . |
Create a schema with the Schema Wizard
Here are the steps to create an Oracle Cloud Applications schema with the Schema Wizard:
- Sign in to the Incorta Direct Data Platform™.
- In the Navigation bar, select Schema.
- In the Action bar, select + New → Schema Wizard.
- In (1) Choose a Source, specify the following:
- For Enter a name, enter the schema name.
- For Select a Datasource, select the Oracle Cloud Applications data source.
- Optionally create a description.
- In the Schema Wizard footer, select Next.
- In (2) Manage Tables, in the Data Panel, first select the name of the Data Source, and then check the Select All checkbox.
- In the Schema Wizard footer, select Next.
- In (3) Finalize, in the Schema Wizard footer, select Create Schema.
Create a schema with the Schema Designer
Here are the steps to create an Oracle Cloud Applications schema using the Schema Designer:
- Sign in to the Incorta Direct Data Platform.
- In the Navigation bar, select Schema.
- In the Action bar, select + New → Create Schema.
- In Name, specify the schema name and select Save.
- In Start adding tables to your schema, select Oracle Cloud Applications.
- In the Data Source dialog, specify the Oracle Cloud Applications table data source properties.
- Select Add.
- In the Table Editor, in the Table Summary section, enter the table name.
- To save your changes, select Done in the Action bar.
Oracle Cloud Applications table data source properties
For a schema table in Incorta, you can define the following Oracle Cloud Applications specific data source properties as follows:
View the schema diagram with the Schema Diagram Viewer
Here are the steps to view the schema diagram using the Schema Diagram Viewer:
- Sign in to the Incorta Direct Data Platform™.
- In the Navigation bar, select Schema.
- In the list of schemas, select the Oracle Cloud Applications schema.
- In the Schema Designer, in the Action bar, select Diagram.
Load the schema
Here are the steps to perform a Full Load of the Oracle Cloud Applications schema using the Schema Designer:
- Sign in to the Incorta Direct Data Platform™.
- In the Navigation bar, select Schema.
- In the list of schemas, select the Oracle Cloud Applications schema.
- In the Schema Designer, in the Action bar, select Load → Full Load.
- To review the load status, in Last Load Status, select the date.
Explore the schema
With the full load of the Oracle Cloud Applications schema complete, you can use the Analyzer to explore the schema, create your first insight, and save the insight to a new dashboard.
To open the Analyzer from the schema, follow these steps:
- In the Navigation bar, select Schema.
- In the Schema Manager, in the List view, select the Oracle Cloud Applications schema.
- In the Schema Designer, in the Action bar, select Explore Data.
Additional Considerations
Types of Incremental Loads
You can enable Incremental Load for a Oracle Cloud Applications data source. There are two types of incremental extracts:
Last Successful Extract Time
Fetch updates since the last time the tables were loaded. It is determined by the difference between the current time and the database timestamp.
Maximum Value of a Column
The column-based strategy depends on an extra column called Incremental Column in each table. The Oracle Cloud Applications connector supports both timestamp and numeric columns. A timestamp column is of the type date or timestamp. A numeric column is of the type int or long.
Changing the incremental load strategy requires a full load to ensure data integrity.