This manual describes the installation of Oracle Grid Release 11.2.0.3 and Oracle Real Application Cluster (RAC) 11.2.0.3 release .
Prereq
- Installation of Oracle Enterprise Linux
Software
The necessary software can be downloaded by clicking the following link (s).
Display
If you do not work directly from the console, you can start a terminal session to the server.
On the server, the display must be exported to the machine from where you will perform the installation.
1 2 3 4 |
prompt> su - oracle oracle> export DISPLAY=<local hostname>:1 oracle> export TMP=/var/tmp oracle> export TEMP=/var/tmp |
VMware tools
In this installation we are using a virtual host. From the VMware vSphere client mount the VMWaretool iso file to the cd-rom player on the specific virtual host. When you are using a physical machine this step can be skipped.
1 2 3 4 5 6 |
prompt> su - root> cd /media/VMware\ Tools/ root> tar -zxvf VMwareTools* -C /tmp/ root> cd /tmp/vmware-tools-distrib/ root> ./vmware-install.pl -d root> init 6 |
Naamresolutie
Pas het hosts bestand aan op node/nodes zodat de hostnaam, priv en vip adressen gedefinieerd worden. Dit is noodzakelijk om het Oracle RAC cluster te configureren.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
prompt> sudo su - root root> vi /etc/hosts 127.0.0.1 localhost.localdomain localhost # Public 192.168.1.24 tss14.tss.nl tss14 192.168.1.25 tss15.tss.nl tss15 # Private 192.168.0.124 tss14-priv.tss.nl tss14-priv 192.168.0.125 tss15-priv.tss.nl tss15-priv # Virtual 192.168.1.124 tss14-vip.tss.nl tss14-vip 192.168.1.125 tss15-vip.tss.nl tss15-vip # SCAN 192.168.1.126 tss-cluster.tss.nl tss-cluster 192.168.1.24 tss14 tss14.tss.nl # Oracle RAC Cluster 11.2.0.3 192.168.1.25 tss15 tss15.tss.nl # Oracle RAC Cluster 11.2.0.3 |
Configure Repository
Configure the connection for the oracle yum-repository.
1 2 3 4 5 6 7 8 9 10 11 |
prompt> su - root> cd /etc/yum.repos.d root> wget http://public-yum.oracle.com/public-yum-el5.repo root> vi public-yum-el5.rep [ol5_u5_base] name=Oracle Linux $releasever - U5 - x86_64 - base baseurl=http://public-yum.oracle.com/repo/OracleLinux/OL5/5/base/x86_64/ gpgkey=http://public-yum.oracle.com/RPM-GPG-KEY-oracle-el5 gpgcheck=1 enabled=0 |
Set enabled to 1 for 64bit systems.
1 |
enabled=1 |
Installation packages
After you have configured the repository the ‘oracle-validated’ package can be downloaded. This package contains all the settings and software you will need to install Oracle related products.
1 2 3 |
prompt> su - root> yum install oracle-validated -y root> yum update |
You can install the packages below, in most cases they are already been installed.
1 2 |
root> yum install binutils compat-libstdc++-33 compat-libstdc++-33.i386 gcc gcc-c++ glibc glibc.i686 glibc-devel glibc-devel.i386 ksh libaio libaio.i386 libaio-devel libaio-devel.i386 libgcc libgcc.i686 libstdc++ libstdc++.i386 libstdc++-devel libstdc++-devel.i386 libXext libXext.i386 libXtst libXtst.i386 libX11 libX11.i386 libXau libXau.i386 libxcb libxcb.i386 libXi libXi.i386 make sysstat unixODBC unixODBC-devel -y |
Add user and groups
Add user(s) and group(s) that will be used for the installation.
1 2 3 4 |
prompt> su - root root> groupadd -g 1000 oinstall root> useradd -u 1100 -g oinstall oracle root> passwd oracle |
Create directory’s
Create the directories in which the Oracle software will be installed.
1 2 3 4 5 6 7 |
prompt> su - root> mkdir -p /u01/app/grid/11.2.0.3 root> mkdir -p /u01/app/oracle/product/database/11.2.0/dbhome_1 root> mkdir -p /u01/oradata root> mkdir -p /u01/software root> chown -R oracle:oinstall /u01 root> chmod -R 775 /u01/ |
Kernel parameters
Use the kernel settings as described below for a succesful Oracle software installation.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 |
prompt> su - root> vi /etc/sysctl.conf # Kernel sysctl configuration file for Oracle Enterprise Linux # # For binary values, 0 is disabled, 1 is enabled. See sysctl(8) and # sysctl.conf(5) for more details. # Controls IP packet forwarding net.ipv4.ip_forward = 0 # Controls source route verification # See /usr/share/doc/kernel-doc-*/Documentation/networking/ip-sysctl.txt net.ipv4.conf.default.rp_filter = 2 # Do not accept source routing net.ipv4.conf.default.accept_source_route = 0 # Controls the System Request debugging functionality of the kernel # Controls whether core dumps will append the PID to the core filename # Useful for debugging multi-threaded applications kernel.core_uses_pid = 1 # Controls the use of TCP syncookies net.ipv4.tcp_syncookies = 1 # Oracle-Validated setting for kernel.msgmnb is 65536 kernel.msgmnb = 65536 # Oracle-Validated setting for kernel.sem is '250 32000 100 142' kernel.sem = 250 32000 100 142 # Oracle-Validated setting for kernel.shmmni is 4096 kernel.shmmni = 4096 # Oracle-Validated setting for kernel.shmall is 1073741824 kernel.shmall = 1073741824 # Oracle-Validated setting for kernel.shmmax is 4398046511104 on x86_64 and 4294967295 on i386 architecture. Refer Note id 567506.1 kernel.shmmax = 4398046511104 # Oracle-Validated setting for kernel.sysrq is 1 kernel.sysrq = 1 # Oracle-Validated setting for net.core.rmem_default is 262144 net.core.rmem_default = 262144 # For 11g, Oracle-Validated setting for net.core.rmem_max is 4194304 net.core.rmem_max = 4194304 # Oracle-Validated setting for net.core.wmem_default is 262144 net.core.wmem_default = 262144 # For 11g, Oracle-Validated setting for net.core.wmem_max is 1048576 # For 10g, uncomment 'net.core.wmem_max = 262144', comment 'net.core.wmem_max = 1048576' entry for this parameter and re-run sysctl -p # net.core.wmem_max = 262144 net.core.wmem_max = 1048576 # Oracle-Validated setting for fs.aio-max-nr is 3145728 fs.aio-max-nr = 3145728 # For 11g, Oracle-Validated setting for net.ipv4.ip_local_port_range is 9000 65500 # For 10g, uncomment 'net.ipv4.ip_local_port_range = 1024 65000', comment 'net.ipv4.ip_local_port_range = 9000 65500' entry and re-run sysctl -p # net.ipv4.ip_local_port_range = 1024 65000 net.ipv4.ip_local_port_range = 9000 65500 # Oracle-Validated setting for vm.min_free_kbytes is 51200 to avoid OOM killer vm.min_free_kbytes = 51200 |
Make using the following command the new kernel parameters active.
1 |
root> /sbin/sysctl -p |
Limits.conf
Add the following below in the limits.conf file.
1 2 3 4 5 6 7 |
prompt> su - root> vi /etc/security/limits.conf oracle soft nproc 2047 oracle hard nproc 16384 oracle soft nofile 1024 oracle hard nofile 65536 |
Config selinux
Set secure Linux to permissive by editing the “/etc/selinux/config” file.
1 2 3 4 |
prompt> su - root> vi /etc/selinux/config SELINUX=permissive |
Once the change is complete, restart the server or run the following command.
1 |
root> setenforce permissive |
NTP Time
Because use is made of a virtual environment, we set the time synchronization at operating system level. This is handled by the VMware ESX 5.0 environment. There may be other problems with the cluster synchronization times .
1 2 3 4 5 |
prompt> su - root> service ntpd stop root> chkconfig ntpd off root> mv /etc/ntp.conf /etc/ntp.conf.org root> rm /var/run/ntpd.pid |
Environment variables
In the .bash_profile file in the home directory of the oracle user, set the path references so that they are automatically set when the user oracle logs in.
1 2 |
prompt> sudo su - root> vi /home/oracle/.bash_profile |
Node 1
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
# Oracle Settings tss14 TMP=/tmp; export TMP TMPDIR=$TMP; export TMPDIR ORACLE_HOSTNAME=tss14.tss.nl; export ORACLE_HOSTNAME ORACLE_UNQNAME=tssdb; export ORACLE_UNQNAME ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE ORACLE_HOME=$ORACLE_BASE/product/11.2.0/dbhome_1; export ORACLE_HOME ORACLE_SID=tssdb; export ORACLE_SID ORACLE_TERM=xterm; export ORACLE_TERM PATH=/usr/sbin:$PATH; export PATH PATH=$ORACLE_HOME/bin:$PATH; export PATH LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATH CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPATH if [ $USER = "oracle" ]; then if [ $SHELL = "/bin/ksh" ]; then ulimit -p 16384 ulimit -n 65536 else ulimit -u 16384 -n 65536 fi fi |
Node 2
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
# Oracle Settings tss15 TMP=/tmp; export TMP TMPDIR=$TMP; export TMPDIR ORACLE_HOSTNAME=tss15.tss.nl; export ORACLE_HOSTNAME ORACLE_UNQNAME=tssdb; export ORACLE_UNQNAME ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE ORACLE_HOME=$ORACLE_BASE/product/11.2.0/dbhome_1; export ORACLE_HOME ORACLE_SID=tssdb; export ORACLE_SID ORACLE_TERM=xterm; export ORACLE_TERM PATH=/usr/sbin:$PATH; export PATH PATH=$ORACLE_HOME/bin:$PATH; export PATH LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATH CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPATH if [ $USER = "oracle" ]; then if [ $SHELL = "/bin/ksh" ]; then ulimit -p 16384 ulimit -n 65536 else ulimit -u 16384 -n 65536 fi fi |
NFS
In the /etc/exports have come to be references to the shared storage where the ASM files are located. This share is linked to the directory / u01 / oradata .
1 2 3 4 5 |
prompt> su - root> vi /etc/fstab #NAS 192.168.1.30:/u01/nfs_shares/tssdb /u01/oradata nfs rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768,actimeo=0 0 |
Subsequently, the directory can be linked to the nfs share.
1 2 3 |
root> mount /u01/oradata root> mount /software root> chown -R oracle:oinstall /u01/oradata |
This installation has been tested 4 to create files of 5GB stored on a redundant backup of the NFS server system. This ‘Archive’ files will represent the ASM disks for the configuration of the ASM instance.
1 2 3 4 5 6 7 8 9 |
prompt> sudo su - root> cd /u01/oradata root> dd if=/dev/zero of=/u01/oradata/asm001 bs=1k count=5000000 dd if=/dev/zero of=/u01/oradata/asm002 bs=1k count=5000000 dd if=/dev/zero of=/u01/oradata/asm003 bs=1k count=5000000 dd if=/dev/zero of=/u01/oradata/asm004 bs=1k count=5000000 root> chown oracle:oinstall * root> chmod 665 * |
Installatie Oracle Grid release 11.2.0.3
Go on Node 1 to the directory where the installation software is . The software will automatically be installed on Node 2 .
1 2 3 |
prompt> sudo su - oracle oracle> cd /u01/software/grid oracle> ./runInstaller.sh |
If no use is made of automatic software updates, then select ‘Skip software updates ” and then click Next.
In this installation , we want to make use of a cluster and this must also be configured . This, select the first option “Install and Configure Oracle Grid Infrastructure for a Cluster , and then click Next.
Select ” Advanced Installation ” if you want to configure settings and then click Next.
Enter the SCAN address as in the host file is given to and de- select ” GNS ” when do not use to be there Grid Naming Service , and then click Next.
Click ‘ Add’ to add a node , enter the details as in the host file and kilk OK. Then click ‘ SSH conectivity “
Enter the password in the Oracle user and click on “Setup” to configure the ssh connection to the other node and kilk then click Next.
Check the Public and Private network , and then click Next.
Select ” Oracle Automatic Storage Management (Oracle ASM ), and then click Next.
Click ” Change Discovery Path ‘ and refer to ‘ / u01 / oradata ‘ mount point (NFS shared file system).
Click OK.
The disks that will be used for the ASM instance are now displayed , select it and then click Next.
If you want to use the same password for the user SYS and ASMSNMP select “Use same password for thesis Accounts” and then click Next.
If you do not want to use Intelligent Platform Management Interface ( IPMI ), select ‘ Do not use Intelligent Platform Management Interface ( IPMI ), and then click Next.
Choose from the drop down box ” oinstall ” and then click Next.
The Oracle base and software location are shown.
The Oracle Grid release 11.2.0.3 location , we want to have in this case at a different location . Enter ‘ / u01 / app / grid ” in the text field next Software Location and then click Next.
Indicate where the ” oraInventory ” to appear a kilk then click Next.
You will now see whether the environment meets the requirements for installing Oracle Grid Release 11.2.0.3.
In this case we have a bug ( Metalink Note 1267569.1 ) is controlled manually or ASM is running.
Tick to put Ignore All and then Next.
Enter the above scripts on both node , and then click OK. Node 1 and Node 2
1 2 3 |
prompt> sudo su - root> cd /tmp/CVU_11.2.0.3.0_oracle/ root> runfixup.sh |
An overview is shown of the installation settings. Check it, and then click Next.
The installation of Oracle Grid release 11.2.0.3 is performed.
At the end of the installation process you will be asked to put on both machines’ orainstRoot.sh “and” root.sh ” under the user to perform root. Do this also in that order.
Node 1 and Node 2
1 2 3 |
prompt> sudo su - root> cd /u01/app/oraInventory root> ./orainstRoot.sh |
Node 1 and Node 2
1 2 3 |
prompt> sudo su - root> cd /u01/app/grid root> root.sh |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
Resultaat tss14 CRS-2672: Attempting to start 'ora.asm' on 'tss14' CRS-2676: Start of 'ora.asm' on 'tss14' succeeded CRS-2672: Attempting to start 'ora.DATA.dg' on 'tss14' CRS-2676: Start of 'ora.DATA.dg' on 'tss14' succeeded Configure Oracle Grid Infrastructure for a Cluster ... succeeded Resultaat tss15 Creating trace directory User ignored Prerequisites during installation OLR initialization - successful Adding Clusterware entries to inittab CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node tss14, number 1, and is terminating An active cluster was found during exclusive startup, restarting to join the cluster Configure Oracle Grid Infrastructure for a Cluster ... succeeded |
Click on Close to exit the installation of Oracle Grid Release 11.2.0.3 .
Installation Database
1 2 3 |
prompt> sudo su - oracle oracle> cd /u01/software/database oracle> ./runInstaller.sh |
If no email is required on security related findings uncheck on ” I wish to … . ‘Away , and then click Next.
Click Yes.
Wanneer er geen gebruik gemaakt moet worden van ‘automatische’ updates selecteer dan ’Skip Software Updates’ en klik vervolgens op Next.
Selecteer ‘Create and configure a database’ en klik vervolgens op Next.
Select ‘Server Class’ and click on next.
Select Oracle Real Application Cluster Database Installation ” and make sure all node are checked, and then click Next.
Select ‘Advanced install’ and then click Next.
Add extra languages , and then click Next.
Select Enterprise Edition , and then click Next.
Indicate what the ” Oracle Base ” should be and what the “Software Location ” for installation vanOracle Real Application Cluster release 11.2.0.3 should be , and then click Next.
In this case, a ” General Purpose / Transaction Processing ” database selected. Make the desired selection, then click Next.
Enter the Global Database name ‘and’ Oracle Service Identifier , and then click Next.
If you want to determine how the memory should be divided then uncheck to ‘Enable Automatic Memory Management ‘ away , and then click Next.
Select the Character Set ” to be used for the database and then click Next.
Put a tick in ” Assert all new security settings , and then click Next.
When not being used is made of a central Oracle Enterprise Manager select “Use Oracle Enterprise Manager Database Control for Database Management , and then click Next.
Enter the password for the user ASMSNMP and then click Next.
Select whether to automatically create backups, and then click Next.
Select the ASM disk group where the database files moved to and then click Next.
If you want to use the same password for the user SYS , SYSTEM , SYSMAN and dbsnmp select “Use same password for thesis Accounts” and then click Next.
Enter the “Database Operator Group ‘ on . In this case is that the user ” oinstall ” and then click Next.
Wait until the prerequisite check is complete . When problems occur repair it or put a tick in “Ignore All” checkbox and then click Next.
Click Next
An overview is shown of the installation. Check these details , and then click Next.
An overview is shown of the installation. Check these details , and click Next .
Press OK.
Log in to the system as root and go to the correct directory. Click OK when it is carried out below.
1 2 3 |
prompt> su - root root> cd /u01/app/oracle/product/database/11.2.0/dbhome_1 root> ./Root.sh |
The Real Application Cluster database is created. Click Close to exit the installation screen.
Sequel
Information
- Grid Infrastructure installatie handleiding voor Linux.
- Real Application Clusters installatie handleiding voor Linux and UNIX
Please let me know if this manual ‘Installation Oracle RAC 11gR2 OEL5.9’ was usefull to you. If there are errors or you have suggestions regarding this manual, please let me know.
No rights can be derived from this manual
Regards,
Maarten