☁️ OCI Configuration

Oracle Cloud Infrastructure (OCI) can optionally be configured to enable additional AI Optimizer functionality including:

• Document Source for Splitting and Embedding from Object Storage
• Private Cloud Large Language and Embedding models from OCI Generative AI service

Configuration

OCI can either be configured through the AI Optimizer interface, a CLI Configuration File, or by using environment variables.

You will need to generate an API Key to obtain the required configuration values.

Interface

To configure OCI access from the AI Optimizer, navigate to Configuration menu and OCI tab:

Provide the values obtained by generating an API Key.

OCI GenAI Services can also be configured on this page, once OCI access has been confirmed.

Config File

Depending on the runtime environment, either Bare Metal or Containerized, your local CLI Configuration File can be used to configure AI Optimizer for OCI access.

In addition to the standard configuration file entries, two additional entries can be added to enable OCI GenAI Services:

• genai_region: the Region for the OCI GenAI Service
• genai_compartment_id: the Compartment OCID of the OCI GenAI Service

Bare Metal

During startup, the AI Optimizer will automatically look for and consume a CLI Configuration File for configuring OCI access.

Container

When starting the container, volume mount the configuration file to /app/.oci for it to be used.

For example:

podman run -v ~/.oci:/app/.oci -p 8501:8501 -it --rm ai-optimizer-aio

Environment Variables

OCI can also be configured using environment variables. See the OCI CLI Overrides and OCI GenAI sections of the Configuration page for available variables and usage.

Authentication Types

The following authentication types are supported via the AIO_OCI_CLI_AUTH variable or the authentication field in the config file: