1. Home
  2. On-premises 5.2
  3. Guides
  4. Tours
  5. Concepts
    1. Aggregate filter
    2. Alias
    3. Apache Avro™
    4. Apache Kafka™
    5. Applied filter
    6. Base table
    7. Bookmark
    8. Business schema
    9. Business schema view
    10. Business schema view column
    11. Business schema view formula column
    12. Column
    13. Connector
    14. Dashboard filter
    15. Dashboard folder
    16. Dashboard runtime filter
    17. Data agent
    18. Data alert
    19. Data destination
    20. Date system variable
    21. Distinct filter
    22. Expression
    23. External data source
    24. External session variable
    25. Filter expression
    26. Filter expression session variable
    27. Filter option
    28. Formula column
    29. Formula expression
    30. Full load
    31. Global Variable
    32. Incorta Analyzer Table
    33. Incorta Analyzer Table column
    34. Incorta Analyzer Table formula column
    35. Incorta Analyzer View
    36. Incorta Analyzer View formula column
    37. Incorta SQL Table
    38. Incorta SQL View
    39. Individual filter
    40. Insight filter
    41. Internal query expression
    42. Internal session variable
    43. Join
    44. Join condition
    45. Join condition column
    46. Join filter
    47. Join filter column
    48. Level based measure
    49. Load filter
    50. Local data file
    51. Local data folder
    52. Materialized View
    53. Materialized View Column
    54. Materialized View Formula Column
    55. Measure filter
    56. Miscellaneous system variable
    57. Multi-Source table
    58. Physical schema
    59. Physical schema table
    60. Physical schema table column
    61. Physical schema table formula column
    62. Physical schema table runtime security filter
    63. Presentation variable
    64. Prompt
    65. Query system variable
    66. Runtime business view
    67. Runtime business view formula column
    68. Runtime security filter
    69. Session variable
    70. Shared Storage
    71. SQL Interface
    72. Upgrade Readiness
    73. Variable
    74. Visualization
  6. Tools
  7. References
  8. Integrations
  9. Data applications
  10. Releases

Concepts → Shared Storage

About Shared Storage

For a standalone instance of Incorta, shared storage is local to the host that runs the Incorta Node. In other words, shared storage is the local file system.

For an Incorta cluster, where there are multiple Incorta Nodes with each node running at least one Analytics or Loader Service, it is not possible to share a local file system among the various hosts. Instead, a System Administrator must implement a common mount for shared storage for each host. An on-premises Incorta cluster typically mounts a Network File System v4 (NFSv4) as a directory common to all the hosts in a cluster. From the perspective of the host, the mounted directory appears a local file system directory.

A cloud deployed Incorta cluster typically also has a mounted directory for shared storage which is similar to NFSv4. For example, a cluster deployed in AWS on EC2 instances, typically mounts shared storage as an Elastic File Share (EFS) directory.

For a given tenant, shared storage best characterizes the various usages of a local file system, network file system, or similar mount such as EFS.

Here are some of various ways that Incorta as a direct data platform uses shared storage:

  • Users that belong to a group with the Schema Manager role can upload one or more files and folders
  • The Loader Service creates direct data mapping and parquet files
  • The Analytics Service reads direct data mapping and parquet files
  • Apache Spark both writes and reads parquet files
  • When enabled, an Apache Kafka external data source ingests data from a Kafka broker for given topic and writes encrypted files