Add nodes to Oracle WebLogic Server

This page documents how to configure an existing deployment of Oracle WebLogic Server to add new managed application server using Azure CLI.

Prerequisites

Environment for Setup

WebLogic Server Instance

The template will be applied to an existing Oracle WebLogic Server instance. If you don’t have one, please create a new instance from the Azure portal, by following the link to the offer in the index.

Azure Active Directory LDAP Instance

Refer to Azure Active Directory(AAD) LDAP Instance.

Certificate for SSL Termination

Refer to Configure Azure Application Gateway#Certificate for SSL Termination.

Administering Security for Oracle WebLogic Server & Configuring KeyStores

Refer to Configuring Keystores.

Generate Base64 string for a given ssl certificate/keystore file

Use the following command to generate a Base64 string for a given ssl certificate/keystore file, to be used as input in the parameters JSON file

base64 /my/path/your-certificate.cer -w 0 >temp.txt

Prepare the Parameters JSON file

You must construct a parameters JSON file containing the parameters to the add-node ARM template. See Create Resource Manager parameter file for background information about parameter files. You must specify the information of the existing Oracle WebLogic Server and nodes that to be added. This section shows how to obtain the values for the following required properties.

Parameter Name Explanation
_artifactsLocation See below for details.
aadsSettings Optional. JSON object type. You can specify this parameters for Azure Active Directory integration. If enable is true, must specify other properties.
enable If enable is true, must specify all properties of the aadSettings.
publicIP The public IP address of Azure Active Directory LDAP server.
serverHost The server host of Azure Active Directory LDAP server.
certificateBase64String The based64 string of LADP client certificate that will be imported to trust store of WebLogic Server to enable SSL connection of AD provider.
adminPasswordOrKey Password of administration account for the new Virtual Machine that host new nodes.
adminURL The URL of WebLogic Administration Server, usually made up with Virtual Machine name and port, for example: adminVM:7001.
appGatewaySettings Optional. JSON object type. You can specify these parameters for application gateway configuration. If enable is true, you must specify other properties. If enable is false, the other properties are ignored. See the page Migrate a WebLogic Server cluster to Azure with Azure Application Gateway as a load balancer for further information.
enable If enable is true, must specify all properties of the appGatewaySettings.
publicIPName Azure resource name of application gateway public IP, default value is gwip
certificateBase64String Base64 string of server certificate for application gateway.
certificatePassword Password of server certificate.
elkSettings Optional. JSON object type. You can specify this parameters for Elasticsearch and Kibana(ELK) connection. If enable is true, must specify other properties. See the page WebLogic with Elastic on Azure for further information.
enable If enable is true, must specify all properties of the elkSettings.
elasticsearchEndpoint Endpoint of the Elasticsearch instance.
elasticsearchPassword Password for Elasticsearch account.
elasticsearchUserName User name for Elasticsearch account.
logIndex Must be the same value output at ELK deployment time.
logsToIntegrate Array with string value. Specify the expeted logs to integrate, you must input at least one log.
enableCoherence If true, create application managed server and add to the Coherence cluster application tier.
numberOfExistingNodes The number of existing managed application servers, used to generate new virtual machine name.
numberOfNewNodes The number of application managed server to add.
storageAccountName The name of an existing storage account.
wlsDomainName Must be the same value provided at deployment time.
wlsUserName Must be the same value provided at deployment time.
wlsPassword Must be the same value provided at deployment time.
customSSLSettings Optional. JSON object type. You can specify this parameters for configuring Custom SSL Settings for WebLogic Administration Server. If enable is true, must specify other properties. See the page Administering Security for Oracle WebLogic Server and Configuring Keystores for further information.
enable If enable is true, must specify all properties of the customSSLSettings.   Set to false by default.
customIdentityKeyStoreBase64String The based64 string of the custom identity keystore file that will be configured in the WebLogic Administration Server to enable SSL connection.
customIdentityKeyStorePassPhrase The identity keystore pass phrase
customIdentityKeyStoreType Identity Key Store Type. This can be either JKS or PKCS12
customTrustKeyStoreBase64String The based64 string of the custom trust keystore file that will be configured in the WebLogic Administration Server to enable SSL connection.
customTrustKeyStorePassPhrase The trust keystore pass phrase
customTrustKeyStoreType Trust Key Store Type. This can be either JKS or PKCS12
privateKeyAlias The private key alias
privateKeyPassPhrase The private Key Pass phrase.

_artifactsLocation

This value must be the following.

https://raw.githubusercontent.com/oracle/weblogic-azure/2024-02-29-1-Q1/weblogic-azure-vm/arm-oraclelinux-wls-cluster/addnode/src/main/

Enable SSH Authentication to VMs

If the cluster was deployed with SSH Authentication to VMs enabled, add this variable to your parameter file and fill in the base64 decoded public SSH key string to the adminPasswordOrKey field:

        "authenticationType": {
            "value": "sshPublicKey"
        },
        "adminPasswordOrKey": {
            "value": "ssh-rsa ...."
        },

Enable coherence

If enableCoherence is true, the template will create Azure resources to host new managed servers, and configure new application nodes to Coherence cluster. If your cluster is not Coherence cluster, please do not set this parameter true.

Existing managed application servers

To differentiate functionality of managed servers, we use managed application server to represent managed servers that host Java EE application, and use managed cache server to represent managed servers that used for cache.

You can get the existing managed application servers with the following command:

$ resourceGroup=<your-resource-group>
$ managedServerPrefix=<managed-server-prefix>
$ numberOfExistingNodes=$(az resource list -g ${resourceGroup} --resource-type Microsoft.Compute/virtualMachines --query [*].name | grep "${managedServerPrefix}VM[0-9]" | sed -e 's/[^0-9]/ /g' -e 's/^ *//g' -e 's/ *$//g' | tr -s ' ' | sed 's/ /\n/g' | sort  -nr | head -n1)
$ echo ${numberOfExistingNodes}

Log index

If you configured ELK in your cluster to export WebLogic Server logs to ELK, please input the value of Kibana log index, this template will set up ELK connection and export logs to specified index.

You can get the value from Azure portal with the following steps:

Alternatively, use Azure CLI command to list log index inside the resource group deployments:

$ az deployment group list -g 'yourResourceGroup' --query [*].properties.outputs.logIndex.value
[
  "azure-weblogic-cluster-f984df74-ab4d-4c17-a532-7f248659fb28"
]

Storage account

Each Storage Account handles up to 20,000 IOPS, and 500TB of data. If you use a storage account for Standard Virtual Machines, you can store until 40 virtual disks.

We have two disks for one Virtual Machine, it’s suggested no more than 20 Virtual Machines share the same storage account. Number of virtual machines that hosting managed servers should be less than or equal to 20.

You can get the name of storage account from Azure portal with steps:

Alternatively, use Azure CLI command to list storage account inside a resource group:

$ az resource list -g 'yourResourceGroup' --resource-type Microsoft.Storage/storageAccounts --query [*].name
[
  "219846olvm"
]

Example Parameters JSON

Here is a fully filled out parameters file, with Azure Active Directory enabled. We will leave values of adminUsername, authenticationType, dnsLabelPrefix, managedServerPrefix, skuUrnVersion, usePreviewImage and vmSize as default value.

Some things to note:

{
    "$schema": "https://schema.management.azure.com/schemas/2015-01-01/deploymentParameters.json#",
    "contentVersion": "1.0.0.0",
    "parameters": {
        "_artifactsLocation": {
            "value": "https://raw.githubusercontent.com/oracle/weblogic-azure/2024-02-29-1-Q1/weblogic-azure-vm/arm-oraclelinux-wls-cluster/addnode/src/main/"
        },
        "aadsSettings": {
            "value": {
                "enable": true,
                "publicIP":"13.68.244.90",
                "serverHost": "ladps.wls-security.com",
                "certificateBase64String":"LS0tLS1C...tLS0tLQ0K"
            }
        },
        "adminPasswordOrKey": {
            "value": "Secret123!"
        },
        "adminURL":{
            "value": "adminVM:7001"
        },
        "appGatewaySettings": {
            "value": {
               "enable": true,
               "publicIPName": "gwip",
               "certificateBase64String": "MIIKQQI...gIIAA==",
               "certificatePassword": "Secret123!"
            }
         },
         "elkSettings": {
            "value": {
                "enable": true,
                "elasticsearchEndpoint":"https://example.eastus2.azure.elastic-cloud.com:9243",
                "elasticsearchPassword": "Secret123!",
                "elasticsearchUserName":"elastic",
                "logIndex": "azure-weblogic-dynamic-cluster-11122020",
                "logsToIntegrate": ["HTTPAccessLog", "ServerLog", "DomainLog", "DataSourceLog", "StandardErrorAndOutput", "NodeManagerLog"]
            }
        },
        "location": {
            "value": "eastus"
        },
        "numberOfExistingNodes": {
            "value": 4
        },
        "numberOfNewNodes": {
          "value": 3
        },
        "storageAccountName": {
            "value": "496dfdolvm"
        },
        "wlsDomainName": {
            "value": "wlsd"
        },
        "wlsUserName": {
            "value": "weblogic"
        },
        "wlsPassword": {
            "value": "welcome1"
        },
        "customSSLSettings": {
            "value": {
               "enable": true,
               "customIdentityKeyStoreBase64String": "/u3+7QAAAAIAAAABAAAAAQAKc2VydmV....QZL24ljJLq",
               "customIdentityKeyStorePassPhrase": "mypassword",
               "customIdentityKeyStoreType": "JKS",
               "customTrustKeyStoreBase64String": "/u3+7QAAAAIAAAABAAAAAgAJdHJ1c3R....Td4bYVnONyS0PC7k=",
               "customTrustKeyStorePassPhrase": "mypassword",
               "customTrustKeyStoreType": "JKS",
               "privateKeyAlias": "servercert",
               "privateKeyPassPhrase": "mypassword"
            }
        }
    }
}

Invoke the ARM template

Assume your parameters file is available in the current directory and is named parameters.json. This section shows the commands to configure your Oracle WebLogic Server deployment to add new nodes. Replace yourResourceGroup with the Azure resource group in which the Oracle WebLogic Server is deployed.

First, validate your parameters file

The az group deployment validate command is very useful to validate your parameters file is syntactically correct.

az group deployment validate --verbose --resource-group `yourResourceGroup` --parameters @parameters.json --template-uri https://raw.githubusercontent.com/oracle/weblogic-azure/2024-02-29-1-Q1/weblogic-azure-vm/arm-oraclelinux-wls-cluster/addnode/src/main/arm/mainTemplate.json

If the command returns with an exit status other than 0, inspect the output and resolve the problem before proceeding. You can check the exit status by executing the commad echo $? immediately after the az command.

Next, execute the template

After successfully validating the template invocation, change validate to create to invoke the template.

az group deployment create --verbose --resource-group `yourResourceGroup` --parameters @parameters.json --template-uri https://raw.githubusercontent.com/oracle/weblogic-azure/2024-02-29-1-Q1/weblogic-azure-vm/arm-oraclelinux-wls-cluster/addnode/src/main/arm/mainTemplate.json

As with the validate command, if the command returns with an exit status other than 0, inspect the output and resolve the problem.

This is an example output of successful deployment. Look for "provisioningState": "Succeeded" in your output.

{
  "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Resources/deployments/mainTemplate",
  "location": null,
  "name": "mainTemplate",
  "properties": {
    "correlationId": "54517529-a1c4-422f-a539-23b9a5129e80",
    "debugSetting": null,
    "dependencies": [
      {
        "dependsOn": [
          {
            "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Compute/virtualMachines/mspVM7/extensions/newuserscript",
            "resourceGroup": "oraclevm-dcluster-0727",
            "resourceName": "mspVM7/newuserscript",
            "resourceType": "Microsoft.Compute/virtualMachines/extensions"
          }
        ],
        "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Resources/deployments/pid-c7671c10-ae59-5ec5-bff3-c60db22d7ea4",
        "resourceGroup": "oraclevm-dcluster-0727",
        "resourceName": "pid-c7671c10-ae59-5ec5-bff3-c60db22d7ea4",
        "resourceType": "Microsoft.Resources/deployments"
      },
      {
        "dependsOn": [
          {
            "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Network/publicIPAddresses/mspVM7_PublicIP",
            "resourceGroup": "oraclevm-dcluster-0727",
            "resourceName": "mspVM7_PublicIP",
            "resourceType": "Microsoft.Network/publicIPAddresses"
          }
        ],
        "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Network/networkInterfaces/mspVM7_NIC",
        "resourceGroup": "oraclevm-dcluster-0727",
        "resourceName": "mspVM7_NIC",
        "resourceType": "Microsoft.Network/networkInterfaces"
      },
      {
        "dependsOn": [
          {
            "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Network/networkInterfaces/mspVM7_NIC",
            "resourceGroup": "oraclevm-dcluster-0727",
            "resourceName": "mspVM7_NIC",
            "resourceType": "Microsoft.Network/networkInterfaces"
          },
          {
            "apiVersion": "2019-06-01",
            "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Storage/storageAccounts/09b943olvm",
            "resourceGroup": "oraclevm-dcluster-0727",
            "resourceName": "09b943olvm",
            "resourceType": "Microsoft.Storage/storageAccounts"
          }
        ],
        "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Compute/virtualMachines/mspVM7",
        "resourceGroup": "oraclevm-dcluster-0727",
        "resourceName": "mspVM7",
        "resourceType": "Microsoft.Compute/virtualMachines"
      },
      {
        "dependsOn": [
          {
            "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Compute/virtualMachines/mspVM7",
            "resourceGroup": "oraclevm-dcluster-0727",
            "resourceName": "mspVM7",
            "resourceType": "Microsoft.Compute/virtualMachines"
          },
          {
            "actionName": "listKeys",
            "apiVersion": "2019-04-01",
            "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Storage/storageAccounts/09b943olvm",
            "resourceGroup": "oraclevm-dcluster-0727",
            "resourceName": "09b943olvm",
            "resourceType": "Microsoft.Storage/storageAccounts"
          }
        ],
        "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Compute/virtualMachines/mspVM7/extensions/newuserscript",
        "resourceGroup": "oraclevm-dcluster-0727",
        "resourceName": "mspVM7/newuserscript",
        "resourceType": "Microsoft.Compute/virtualMachines/extensions"
      }
    ],
    "duration": "PT9M6.8098765S",
    "mode": "Incremental",
    "onErrorDeployment": null,
    "outputResources": [
      {
        "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Compute/virtualMachines/mspVM7",
        "resourceGroup": "oraclevm-dcluster-0727"
      },
      {
        "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Compute/virtualMachines/mspVM7/extensions/newuserscript",
        "resourceGroup": "oraclevm-dcluster-0727"
      },
      {
        "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Network/networkInterfaces/mspVM7_NIC",
        "resourceGroup": "oraclevm-dcluster-0727"
      },
      {
        "id": "/subscriptions/05887623-95c5-4e50-a71c-6e1c738794e2/resourceGroups/oraclevm-dcluster-0727/providers/Microsoft.Network/publicIPAddresses/mspVM7_PublicIP",
        "resourceGroup": "oraclevm-dcluster-0727"
      }
    ],
    "outputs": {
      "wlsDomainLocation": {
        "type": "String",
        "value": "/u01/domains/wlsd"
      }
    },
    "parameters": {
      "_artifactsLocation": {
        "type": "String",
        "value": "https://raw.githubusercontent.com/oracle/weblogic-azure/2024-02-29-1-Q1/weblogic-azure-vm/arm-oraclelinux-wls-cluster/addnode/src/main/"
      },
      "_artifactsLocationSasToken": {
        "type": "SecureString"
      },
      "aadsSettings": {
        "type": "Object",
        "value": {
          "certificateBase64String": "LS0tLS1C...S0tLQ0K",
          "enable": true,
          "publicIP": "40.76.11.111",
          "serverHost": "ladps.wls-security.com"
        }
      },
      "adminPasswordOrKey": {
        "type": "SecureString"
      },
      "adminURL": {
        "type": "String",
        "value": "adminVM:7001"
      },
      "adminUsername": {
        "type": "String",
        "value": "weblogic"
      },
      "authenticationType": {
        "type": "String",
        "value": "password"
      },
      "dnsLabelPrefix": {
        "type": "String",
        "value": "wls"
      },
      "guidValue": {
        "type": "String",
        "value": "67657ba3-6248-46e5-bedc-53e16ac82571"
      },
      "location": {
        "type": "String",
        "value": "eastus"
      },
      "managedServerPrefix": {
        "type": "String",
        "value": "msp"
      },
      "numberOfExistingNodes": {
        "type": "Int",
        "value": 7
      },
      "numberOfNewNodes": {
        "type": "Int",
        "value": 1
      },
      "skuUrnVersion": {
        "type": "String",
        "value": "owls-122130-8u131-ol74;Oracle:weblogic-122130-jdk8u131-ol74:owls-122130-8u131-ol7;1.1.1"
      },
      "storageAccountName": {
        "type": "String",
        "value": "09b943olvm"
      },
      "usePreviewImage": {
        "type": "Bool",
        "value": false
      },
      "vmSize": {
        "type": "String",
        "value": "Standard_A3"
      },
      "wlsDomainName": {
        "type": "String",
        "value": "wlsd"
      },
      "wlsPassword": {
        "type": "SecureString"
      },
      "wlsUserName": {
        "type": "String",
        "value": "weblogic"
      },
      "customSSLSettings": {
        "type": "Object",
        "value": {
           "enable": true,
           "customIdentityKeyStoreBase64String": "/u3+7QAAAAIAAAABAAAAAQAKc2VydmV....QZL24ljJLq",
           "customIdentityKeyStorePassPhrase": "mypassword",
           "customIdentityKeyStoreType": "JKS",
           "customTrustKeyStoreBase64String": "/u3+7QAAAAIAAAABAAAAAgAJdHJ1c3R....Td4bYVnONyS0PC7k=",
           "customTrustKeyStorePassPhrase": "mypassword",
           "customTrustKeyStoreType": "JKS",
           "privateKeyAliasSecret": "servercert",
           "privateKeyPassPhraseSecret": "mypassword"
        }
      }
    },
    "parametersLink": null,
    "providers": [
      {
        "id": null,
        "namespace": "Microsoft.Resources",
        "registrationPolicy": null,
        "registrationState": null,
        "resourceTypes": [
          {
            "aliases": null,
            "apiVersions": null,
            "capabilities": null,
            "locations": [
              null
            ],
            "properties": null,
            "resourceType": "deployments"
          }
        ]
      },
      {
        "id": null,
        "namespace": "Microsoft.Network",
        "registrationPolicy": null,
        "registrationState": null,
        "resourceTypes": [
          {
            "aliases": null,
            "apiVersions": null,
            "capabilities": null,
            "locations": [
              "eastus"
            ],
            "properties": null,
            "resourceType": "publicIPAddresses"
          },
          {
            "aliases": null,
            "apiVersions": null,
            "capabilities": null,
            "locations": [
              "eastus"
            ],
            "properties": null,
            "resourceType": "networkInterfaces"
          }
        ]
      },
      {
        "id": null,
        "namespace": "Microsoft.Compute",
        "registrationPolicy": null,
        "registrationState": null,
        "resourceTypes": [
          {
            "aliases": null,
            "apiVersions": null,
            "capabilities": null,
            "locations": [
              "eastus"
            ],
            "properties": null,
            "resourceType": "virtualMachines"
          },
          {
            "aliases": null,
            "apiVersions": null,
            "capabilities": null,
            "locations": [
              "eastus"
            ],
            "properties": null,
            "resourceType": "virtualMachines/extensions"
          }
        ]
      }
    ],
    "provisioningState": "Succeeded",
    "template": null,
    "templateHash": "15879952829017360289",
    "templateLink": {
      "contentVersion": "1.0.0.0",
      "uri": "https://raw.githubusercontent.com/oracle/weblogic-azure/2024-02-29-1-Q1/weblogic-azure-vm/arm-oraclelinux-wls-cluster/addnode/src/main/arm/mainTemplate.json"
    },
    "timestamp": "2020-07-27T12:37:03.733682+00:00"
  },
  "resourceGroup": "oraclevm-dcluster-0727",
  "type": "Microsoft.Resources/deployments"
}

Verify

Verify if new nodes are added to the WebLogic Server instance.

Verify if the newly added server has SSL configured successfully

Verify if Azure resources are added

Verify AAD Integration

Verify AAD integration by delpoying a simple Java EE applciation with basic authentication.