Oracle 11gR2 Grid Infrastructure
and Automatic Storage Management
for a Standalone Server
(Part 1)
Today on November 4th, 2009 I successfully Installed Oracle 11gR2 Grid Infrastructure and Automatic Storage Management for a Standalone Server on Oracle Enterprise Linux 5.4. I mostly use SUSE Enterprise Linux because of YAST tool but Oracle ACFS/ADVM is not supported on SUSE Linux. Oracle Automatic Storage Management Cluster File System and Oracle Automatic Storage Management Dynamic Volume Manager (ACFS/ADVM) are supported only on Oracle Enterprise Linux 5 and Red Hat Enterprise Linux 5 for Linux x86 and Linux x86-64. Maybe ACFS/ADVM support on SUSE Linux patches or documents are available on Oracle Metalink. That’s way I chose OEL 5.4 for Grid Infrastructure Installation.
Requirements for Oracle Grid Infrastructure Installation
1) Memory Requirement
At least 1 GB of RAM
2) Disk Space Requirement
At least 3 GB of disk space
At least 1 GB of disk space in the /tmp directory
3) Software Requirement
Linux_11gR2_grid
4) ASMLib Software Requirement
oracleasm-support-2.1.3-1.el5.i386.rpm
oracleasmlib-2.0.4-1.el5.i386.rpm
oracleasm-2.6.18-164.el5-2.0.5-1.el5.i686.rpm
These rpm packages are available on OEL 5.4 DVD.
5) Extra Disk Requirements
There are unformatted disk partitions are required to mark as ASM disks and form into an ASM diskgroup. In my case these drives are named /dev/sda, /dev/sdb and dev/sdc.
Step 1
Login from Root user
Step 2
Create the accounts and groups
#groupadd -g 501 oinstall
#groupadd -g 502 dba
#groupadd -g 503 oper
#groupadd -g 504 asmadmin
#groupadd -g 505 asmoper
#groupadd -g 506 asmdba
#useradd -g oinstall -G dba,asmdba,oper oracle
#useradd -g oinstall -G asmadmin,asmdba,asmoper,oper,dba grid
Step 3
Create directories in /opt directory
#mkdir -p /opt/grid
#mkdir -p /opt/oracle
Set Ownership, Group and mod of these directories
#chown -R grid:oinstall /opt/grid
#chown -R oracle:oinstall /opt/oracle
#chmod -R 775 /opt/grid
#chmod -R 775 /opt/oracle
Step 4
Set password for grid and oracle users
#passwd grid
#passwd oracle
Step 5
Setting System Parameters
i) Edit the /etc/security/limits.conf file and add following lines:
grid soft nproc 2047
grid hard nproc 16384
grid soft nofile 1024
grid hard nofile 65536
oracle soft nproc 2047
oracle hard nproc 16384
oracle soft nofile 1024
oracle hard nofile 65536
ii) Edit the /etc/pam.d/login file and add following line:
session required pam_limits.so
iii) Edit the /etc/sysctl.conf and add following lines:
fs.aio-max-nr = 1048576
fs.file-max = 6815744
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048586 |
You need reboot system or execute "sysctl -p" command to apply above settings
Step 6
i) Setting Grid User Enviroment
Edit the /home/grid/.bash_profile file and add following lines
TMP=/tmp; export TMP
TMPDIR=$TMP; export TMPDIR
ORACLE_HOSTNAME=ws1; export ORACLE_HOSTNAME
ORACLE_SID=+ASM; export ORACLE_SID
ORACLE_BASE=/opt/grid; export ORACLE_BASE
ORACLE_HOME=$ORACLE_BASE/product/Grid11gR2; export ORACLE_HOME
PATH=$ORACLE_HOME/bin:$PATH; export PATH
if [ $USER = "oracle" ] || [ $USER = "grid" ]; then
if [ $SHELL = "/bin/ksh" ]; then
ulimit -p 16384
ulimit -n 65536
else
ulimit -u 16384 -n 65536
fi
umask 022
fi
ii) Setting Oracle User Enviroment
Edit the /home/oracle/.bash_profile file and add following lines
TMP=/tmp; export TMP
TMPDIR=$TMP; export TMPDIR
ORACLE_HOSTNAME=ws1; export ORACLE_HOSTNAME
ORACLE_BASE=/opt/oracle; export ORACLE_BASE
ORACLE_HOME=$ORACLE_BASE/OraDB11gR2; export ORACLE_HOME
ORACLE_SID=ORCL; export ORACLE_SID
ORACLE_TERM=xterm; export ORACLE_TERM
PATH=/usr/sbin:$PATH; export PATH
PATH=$ORACLE_HOME/bin:$PATH; export PATH
LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATH
CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPATH
if [ $USER = "oracle" ] || [ $USER = "grid" ]; then
if [ $SHELL = "/bin/ksh" ]; then
ulimit -p 16384
ulimit -n 65536
else
ulimit -u 16384 -n 65536
fi
umask 022
fi
Step 7
Some additional packages are required for successful instalation of Oracle Grid Infrastructure software. To check wheter required packages are installed on your operating system use following command:
# rpm -q binutils elfutils elfutils-libelf gcc gcc-c++ glibc glibc-common glibc-devel compat-libstdc++-33 cpp make compat-db sysstat libaio libaio-devel unixODBC unixODBC-devel|sort
Step 8
Install required ASMLib softwares
#rpm -ivh oracleasm-support-2.1.3-1.el5.i386.rpm /
oracleasmlib-2.0.4-1.el5.i386.rpm /
oracleasm-2.6.18-164.el5-2.0.5-1.el5.i686.rpm
Step 9
Check the available partitions
#ls -l /dev/sd*
Step 10
Both ASMLib and raw devices require the candidate disks to be partitioned before they can be accessed. The following picture shows the "/dev/sda" disk being partitioned.
The remaining disks ("/dev/sdb" and "/dev/sdc") must be partitioned in the same way.
Step 11
To label the disks for use by ASM, perform the following steps:
i) configure oracleasm by using the command
# oracleasm configure -i
and answer the prompts as shown in the screenshot.
ii) Initialize the asmlib with the oracleasm init command. This command loads the oracleasm module and mounts the oracleasm filesystem.
iii) Use the oracleasm createdisk > command to create the ASM disk label for each disk.
In my casethe disks names are DISK1, DISK2 and DISK3 as shown in the screenshot.
iv) Check that the disk are visible using the oracleasm listdisks command.
vii) Check the the disks are mounted in the oracleasm filesystem with the command
ls -l /dev/oracleasm/disks
Step 12
i) Extract Linux_11R2_grid software into /mnt directory
# unzip /mnt/Linux_11gR2_grid
Change the ownership and group of grid software directory
# chown grid /mnt/grid –R
# chgrp oinstall /mnt/grid –R
Step 13
i) Now login from grid user
ii) Start the installer with the command
./runInstaller
iii) On the first screen of the installer, select Install and Configure Grid Infrastructure for a Standalone Server. Click Next.
iv) On the Select Product Languages screen, select the languages that should be supported in this installation.
v) On the CreateASMDiskGroup screen,
Set Redundancy to Normal
Select the disks: ORCL:DISK1, ORCL:DISK2, and ORCL:DISK3.
Click Next
vi) Specify ASM Password
vii) Privileged Operating System Groups
viii) Specify Installation Location
ix) Perform Prerequisite Checks
x) Summary
xi) The setup page shows the install progress
xii) The Execute Configuration Scripts page asks you to execute a configuration script as the root user.
xiii) Successfully Install
The Result of the execution of root.sh script
[root@ws1 OraGrid11gR2]# ./root.sh
Running Oracle 11g root.sh script...
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /opt/grid/product/OraGrid11gR2
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2009-11-04 19:08:14: Checking for super user privileges
2009-11-04 19:08:14: User has super user privileges
2009-11-04 19:08:14: Parsing the host name
Using configuration parameter file: /opt/grid/product/OraGrid11gR2/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'grid', privgrp 'oinstall'..
Operation successful.
CRS-4664: Node ws1 successfully pinned.
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
ws1 2009/11/04 19:11:01 /opt/grid/product/OraGrid11gR2/cdata/ws1/backup_20091104_191101.olr
Successfully configured Oracle Grid Infrastructure for a Standalone Server
Updating inventory properties for clusterware
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 2000 MB Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /opt/grid/oraInventory
'UpdateNodeList' was successful.
ASM can be used asmca Management
Part -2
