Contents

List of Tables

Title and Copyright Information

Preface

• Intended Audience
• Documentation Accessibility
• Related Documents
• Conventions

What's New in Oracle Grid Infrastructure Installation and Configuration?

• Desupported Options
• New Features for Release 2 (11.2.0.3)
• New Features for Release 2 (11.2.0.2)
• New Features for Release 2 (11.2)
• New Features for Release 1 (11.1)

1 Typical Installation for Oracle Grid Infrastructure for a Cluster

• 1.1 Typical and Advanced Installation
• 1.2 Preinstallation Steps Completed Using Typical Installation
• 1.3 Preinstallation Steps Requiring Manual Tasks
  • 1.3.1 Verify System Requirements
  • 1.3.2 Check Network Requirements
    • 1.3.2.1 Single Client Access Name (SCAN) for the Cluster
    • 1.3.2.2 IP Address Requirements
    • 1.3.2.3 Redundant Interconnect Usage
    • 1.3.2.4 Intended Use of Network Interfaces
  • 1.3.3 Check Operating System Packages
  • 1.3.4 Create Groups and Users
  • 1.3.5 Check Storage
  • 1.3.6 Prepare Storage for Oracle Automatic Storage Management
    • 1.3.6.1 Installing ASMLIB Packages Automatically with ULN
    • 1.3.6.2 Installing ASMLIB Packages Manually
    • 1.3.6.3 Mark Oracle ASM Candidate Disk Partitions
  • 1.3.7 Install Oracle Grid Infrastructure Software

2 Advanced Installation Oracle Grid Infrastructure for a Cluster Preinstallation Tasks

• 2.1 About Installing the Linux Operating System
  • 2.1.1 Completing a Minimal Linux Installation
  • 2.1.2 Completing a Default Linux Installation
  • 2.1.3 About Oracle Linux and the Unbreakable Enterprise Kernel
  • 2.1.4 About the Oracle RDBMS Pre-Install and Oracle Validated RPMs
  • 2.1.5 Installing the Oracle Pre-Install or Oracle Validated RPM with ULN Support
  • 2.1.6 Installing the Oracle Pre-Install RPM From DVDs or Images
  • 2.1.7 Using Ksplice to Perform a Zero Downtime Update
• 2.2 Reviewing Upgrade Best Practices
• 2.3 Installation Fixup Scripts
• 2.4 Logging In to a Remote System Using X Terminal
• 2.5 Creating Groups, Users and Paths for Oracle Grid Infrastructure
  • 2.5.1 Determining If the Oracle Inventory and Oracle Inventory Group Exists
  • 2.5.2 Creating the Oracle Inventory Group If an Oracle Inventory Does Not Exist
  • 2.5.3 Creating the Oracle Grid Infrastructure User
    • 2.5.3.1 Understanding Restrictions for Oracle Software Installation Owners
    • 2.5.3.2 Determining if an Oracle Software Owner User Exists
    • 2.5.3.3 Creating or Modifying an Oracle Software Owner User for Oracle Grid Infrastructure
  • 2.5.4 Creating the Oracle Base Directory Path
  • 2.5.5 Creating Job Role Separation Operating System Privileges Groups and Users
    • 2.5.5.1 Overview of Creating Job Role Separation Groups and Users
    • 2.5.5.2 Creating Database Groups and Users with Job Role Separation
  • 2.5.6 Example of Creating Standard Groups, Users, and Paths
  • 2.5.7 Example of Creating Role-allocated Groups, Users, and Paths
• 2.6 Checking the Hardware Requirements
  • 2.6.1 General Server Requirements
  • 2.6.2 Server Hardware Requirements
  • 2.6.3 Server Memory Requirements
    • 2.6.3.1 64-bit System and Linux on System z Memory Requirements
    • 2.6.3.2 32-bit System Memory Requirements
  • 2.6.4 Checking Server Hardware and Memory Configuration
• 2.7 Checking the Network Requirements
  • 2.7.1 Network Hardware Requirements
  • 2.7.2 IP Address Requirements
    • 2.7.2.1 IP Address Requirements with Grid Naming Service
    • 2.7.2.2 IP Address Requirements for Manual Configuration
  • 2.7.3 Broadcast Requirements for Networks Used by Oracle Grid Infrastructure
  • 2.7.4 Multicast Requirements for Networks Used by Oracle Grid Infrastructure
  • 2.7.5 DNS Configuration for Domain Delegation to Grid Naming Service
  • 2.7.6 Grid Naming Service Configuration Example
  • 2.7.7 Manual IP Address Configuration Example
  • 2.7.8 Network Interface Configuration Options
  • 2.7.9 Multiple Private Interconnects and Enterprise Linux
  • 2.7.10 Enabling the Name Service Cache Daemon
• 2.8 Identifying Software Requirements
  • 2.8.1 Software Requirements List for x86 (32-bit) Linux Platforms
  • 2.8.2 Software Requirements List for x86-64 Linux Platforms
  • 2.8.3 Software Requirements list for IBM: Linux on System z
• 2.9 Checking the Software Requirements
• 2.10 Verifying UDP and TCP Kernel Parameters
• 2.11 Network Time Protocol Setting
• 2.12 Installing the cvuqdisk Package for Linux
• 2.13 Enabling Intelligent Platform Management Interface (IPMI)
  • 2.13.1 Requirements for Enabling IPMI
  • 2.13.2 Configuring the IPMI Management Network
  • 2.13.3 Configuring the IPMI Driver
    • 2.13.3.1 Configuring the Open IPMI Driver
    • 2.13.3.2 Configuring the BMC
• 2.14 Automatic SSH Configuration During Installation
• 2.15 Configuring Grid Infrastructure Software Owner User Environments
  • 2.15.1 Environment Requirements for Oracle Grid Infrastructure Software Owner
  • 2.15.2 Procedure for Configuring Oracle Software Owner Environments
  • 2.15.3 Check Resource Limits for the Oracle Software Installation Users
  • 2.15.4 Setting Display and X11 Forwarding Configuration
  • 2.15.5 Preventing Installation Errors Caused by Terminal Output Commands
• 2.16 Requirements for Creating an Oracle Grid Infrastructure Home Directory
• 2.17 Cluster Name Requirements

3 Configuring Storage for Grid Infrastructure for a Cluster and Oracle Real Application Clusters (Oracle RAC)

• 3.1 Reviewing Oracle Grid Infrastructure Storage Options
  • 3.1.1 Overview of Oracle Clusterware and Oracle RAC Storage Options
  • 3.1.2 Oracle ACFS and Oracle ADVM Support
  • 3.1.3 General Information About Oracle ACFS
  • 3.1.4 General Storage Considerations for Oracle Grid Infrastructure and Oracle RAC
    • 3.1.4.1 General Storage Considerations for Oracle Clusterware
    • 3.1.4.2 General Storage Considerations for Oracle RAC
  • 3.1.5 Guidelines for Using Oracle ASM Disk Groups for Storage
  • 3.1.6 Using Logical Volume Managers with Oracle Grid Infrastructure and Oracle RAC
  • 3.1.7 Supported Storage Options
  • 3.1.8 After You Have Selected Disk Storage Options
• 3.2 Shared File System Storage Configuration
  • 3.2.1 Requirements for Using a Shared File System
  • 3.2.2 Deciding to Use a Cluster File System for Oracle Clusterware Files
  • 3.2.3 Deciding to Use Direct NFS for Data Files
    • 3.2.3.1 About Direct NFS Storage
    • 3.2.3.2 Using the Oranfstab File with Direct NFS
    • 3.2.3.3 Mounting NFS Storage Devices with Direct NFS
    • 3.2.3.4 Specifying Network Paths with the Oranfstab File
  • 3.2.4 Deciding to Use NFS for Data Files
  • 3.2.5 Configuring Storage NFS Mount and Buffer Size Parameters
  • 3.2.6 Checking NFS Mount and Buffer Size Parameters for Oracle Clusterware
  • 3.2.7 Checking NFS Mount and Buffer Size Parameters for Oracle RAC
  • 3.2.8 Enabling Direct NFS Client Oracle Disk Manager Control of NFS
  • 3.2.9 Creating Directories for Oracle Clusterware Files on Shared File Systems
  • 3.2.10 Creating Directories for Oracle Database Files on Shared File Systems
  • 3.2.11 Disabling Direct NFS Client Oracle Disk Management Control of NFS
• 3.3 Oracle Automatic Storage Management Storage Configuration
  • 3.3.1 Configuring Storage for Oracle Automatic Storage Management
    • 3.3.1.1 Identifying Storage Requirements for Oracle Automatic Storage Management
    • 3.3.1.2 Creating Files on a NAS Device for Use with Oracle ASM
    • 3.3.1.3 Using an Existing Oracle ASM Disk Group
    • 3.3.1.4 Configuring Disks for Oracle ASM with ASMLIB
    • 3.3.1.5 Configuring ASMLIB for Multipath Disks
    • 3.3.1.6 Configuring Disk Devices Manually for Oracle ASM
  • 3.3.2 Using Disk Groups with Oracle Database Files on Oracle ASM
    • 3.3.2.1 Identifying and Using Existing Oracle Database Diskgroups on Oracle ASM
    • 3.3.2.2 Creating Diskgroups for Oracle Database Data Files
  • 3.3.3 Configuring Oracle Automatic Storage Management Cluster File System
  • 3.3.4 Upgrading Existing Oracle ASM Instances
• 3.4 Desupport of Block and Raw Devices
• 3.5 Configuring Raw Logical Volumes on IBM: Linux on System z

4 Installing Oracle Grid Infrastructure for a Cluster

• 4.1 Preparing to Install Oracle Grid Infrastructure with OUI
• 4.2 Preparing to Install Oracle Clusterware on IBM: Linux on System z
• 4.3 Installing Grid Infrastructure
  • 4.3.1 Running OUI to Install Grid Infrastructure
  • 4.3.2 Installing Grid Infrastructure Using a Cluster Configuration File
• 4.4 Installing Grid Infrastructure Using a Software-Only Installation
  • 4.4.1 Installing the Software Binaries
  • 4.4.2 Configuring the Software Binaries
  • 4.4.3 Configuring the Software Binaries Using a Response File
• 4.5 Restrictions for Oracle Berkeley DB
• 4.6 Confirming Oracle Clusterware Function
• 4.7 Confirming Oracle ASM Function for Oracle Clusterware Files
• 4.8 Understanding Offline Processes in Oracle Grid Infrastructure

5 Oracle Grid Infrastructure Postinstallation Procedures

• 5.1 Required Postinstallation Tasks
  • 5.1.1 Download and Install Patch Updates
• 5.2 Recommended Postinstallation Tasks
  • 5.2.1 Back Up the root.sh Script
  • 5.2.2 Tune Semaphore Parameters
  • 5.2.3 Create a Fast Recovery Area Disk Group
    • 5.2.3.1 About the Fast Recovery Area and the Fast Recovery Area Disk Group
    • 5.2.3.2 Creating the Fast Recovery Area Disk Group
• 5.3 Using Older Oracle Database Versions with Grid Infrastructure
  • 5.3.1 General Restrictions for Using Older Oracle Database Versions
  • 5.3.2 Using ASMCA to Administer Disk Groups for Older Database Versions
  • 5.3.3 Pinning Cluster Nodes for Oracle Database Release 10.x or 11.x
  • 5.3.4 Enabling The Global Services Daemon (GSD) for Oracle Database Release 9.2
  • 5.3.5 Using the Correct LSNRCTL Commands
• 5.4 Modifying Oracle Clusterware Binaries After Installation

6 How to Modify or Deinstall Oracle Grid Infrastructure

• 6.1 Deciding When to Deinstall Oracle Clusterware
• 6.2 Migrating Standalone Grid Infrastructure Servers to a Cluster
• 6.3 Relinking Oracle Grid Infrastructure for a Cluster Binaries
• 6.4 Changing the Oracle Grid Infrastructure Home Path
• 6.5 Deconfiguring Oracle Clusterware Without Removing Binaries
• 6.6 Removing Oracle Clusterware and Oracle ASM
  • 6.6.1 About the Deinstallation Tool
  • 6.6.2 Deinstalling Previous Release Grid Home
  • 6.6.3 Downloading The Deinstall Tool for Use with Failed Installations
  • 6.6.4 Deinstall Command Example for Oracle Clusterware and Oracle ASM
  • 6.6.5 Deinstallation Parameter File Example for Grid Infrastructure for a Cluster

A Troubleshooting the Oracle Grid Infrastructure Installation Process

• A.1 General Installation Issues
  • A.1.1 Other Installation Issues and Errors
• A.2 Interpreting CVU "Unknown" Output Messages Using Verbose Mode
• A.3 Interpreting CVU Messages About Oracle Grid Infrastructure Setup
• A.4 About the Oracle Clusterware Alert Log
• A.5 Missing Operating System Packages On Linux
• A.6 Performing Cluster Diagnostics During Oracle Grid Infrastructure Installations
• A.7 About Using CVU Cluster Healthchecks After Installation
• A.8 Interconnect Configuration Issues
• A.9 SCAN VIP and SCAN Listener Issues
• A.10 Storage Configuration Issues
  • A.10.1 Recovery from Losing a Node Filesystem or Grid Home
  • A.10.2 Oracle ASM Library Driver Issues
• A.11 Completing an Installation Before Finishing Running Scripts

B Installing and Configuring Oracle Database Using Response Files

• B.1 How Response Files Work
  • B.1.1 Reasons for Using Silent Mode or Response File Mode
  • B.1.2 General Procedure for Using Response Files
• B.2 Preparing a Response File
  • B.2.1 Editing a Response File Template
  • B.2.2 Recording a Response File
• B.3 Running the Installer Using a Response File
• B.4 Running Net Configuration Assistant Using a Response File
• B.5 Postinstallation Configuration Using a Response File
  • B.5.1 About the Postinstallation Configuration File
  • B.5.2 Running Postinstallation Configuration Using a Response File

C Configuring Large Memory Optimization

• C.1 Overview of HugePages
  • C.1.1 What HugePages Provides
• C.2 Restrictions for HugePage Configurations

D Oracle Grid Infrastructure for a Cluster Installation Concepts

• D.1 Understanding Preinstallation Configuration
  • D.1.1 Understanding Oracle Groups and Users
    • D.1.1.1 Understanding the Oracle Inventory Group
    • D.1.1.2 Understanding the Oracle Inventory Directory
  • D.1.2 Understanding the Oracle Base Directory Path
    • D.1.2.1 Overview of the Oracle Base directory
    • D.1.2.2 Understanding Oracle Base and Grid Infrastructure Directories
  • D.1.3 Understanding Network Addresses
    • D.1.3.1 About the Public IP Address
    • D.1.3.2 About the Private IP Address
    • D.1.3.3 About the Virtual IP Address
    • D.1.3.4 About the Grid Naming Service (GNS) Virtual IP Address
    • D.1.3.5 About the SCAN
  • D.1.4 Understanding Network Time Requirements
• D.2 Understanding Storage Configuration
  • D.2.1 Understanding Oracle Automatic Storage Management Cluster File System
  • D.2.2 About Migrating Existing Oracle ASM Instances
  • D.2.3 About Converting Standalone Oracle ASM Installations to Clustered Installations
• D.3 Understanding Server Pools
  • D.3.1 Overview of Server Pools and Policy-based Management
  • D.3.2 How Server Pools Work
  • D.3.3 The Free Server Pool
  • D.3.4 The Generic Server Pool
• D.4 Understanding Out-of-Place Upgrade

E How to Complete Installation Prerequisite Tasks Manually

• E.1 Configuring SSH Manually on All Cluster Nodes
  • E.1.1 Checking Existing SSH Configuration on the System
  • E.1.2 Configuring SSH on Cluster Nodes
    • E.1.2.1 Create SSH Directory, and Create SSH Keys On Each Node
    • E.1.2.2 Add All Keys to a Common authorized_keys File
  • E.1.3 Enabling SSH User Equivalency on Cluster Nodes
• E.2 Configuring Kernel Parameters
  • E.2.1 Minimum Parameter Settings for Installation
  • E.2.2 Additional Parameter and Kernel Settings for SUSE Linux
• E.3 Checking OCFS2 Version Manually

F How to Upgrade to Oracle Grid Infrastructure 11g Release 2

• F.1 Back Up the Oracle Software Before Upgrades
• F.2 Unset Oracle Environment Variables
• F.3 About Oracle ASM and Oracle Grid Infrastructure Installation and Upgrade
• F.4 Restrictions for Clusterware and Oracle ASM Upgrades
• F.5 Preparing to Upgrade an Existing Oracle Clusterware Installation
  • F.5.1 Checks to Complete Before Upgrade an Existing Oracle Clusterware Installation
• F.6 Using CVU to Validate Readiness for Oracle Clusterware Upgrades
  • F.6.1 About the CVU Grid Upgrade Validation Command Options
  • F.6.2 Example of Verifying System Upgrade Readiness for Grid Infrastructure
  • F.6.3 Verifying System Readiness for Oracle Database Upgrades
• F.7 Performing Rolling Upgrades From an Earlier Release
  • F.7.1 Performing a Rolling Upgrade of Oracle Clusterware
  • F.7.2 Completing an Oracle Clusterware Upgrade when Nodes Become Unreachable
  • F.7.3 Performing a Rolling Upgrade of Oracle Automatic Storage Management
    • F.7.3.1 Preparing to Upgrade Oracle ASM
    • F.7.3.2 Upgrading Oracle ASM
• F.8 Updating DB Control and Grid Control Target Parameters
• F.9 Unlocking the Existing Oracle Clusterware Installation
• F.10 Downgrading Oracle Clusterware After an Upgrade
• F.11 Checking Cluster Health Monitor Repository Size After Upgrading

Index