HP-UNIX安装问题汇总

1 、cvu check failed
Check: User equivalence for user "grid"
  Node Name                             Status                  
  ------------------------------------  ------------------------
  pmscpdb2                              passed                  
  pmscpdb1                              passed                  
Result: User equivalence check passed for user "grid"
Version of exectask could not be retrieved from node "pmscpdb2"

ERROR: 
An internal error occurred within cluster verification framework
The command executed was "/tmp/CVU_null_grid/exectask.sh -getver". The output from the command was "/usr/lib/hpux64/dld.so: Unable to find library 'libdiskown.so'."
Version of exectask could not be retrieved from node "pmscpdb1"

ERROR: 
Framework setup check failed on all the nodes
Verification cannot proceed

Pre-check for cluster services setup was unsuccessful on all the nodes. 

Document 549667.1

pmscpdb1:[/home]#find / -name scp
/opt/ssh/bin/scp
/usr/bin/scp
pmscpdb1:[/home]#ln -s /usr/bin/scp /usr/local/bin/scp
无效
安装os补丁通过

补丁列表如下：

PHCO_40381 11.31 Disk Owner Patch

PHKL_38038 vm cumulative patch

PHKL_38938 11.31 SCSI cumulative I/O patch

PHKL_39351  Scheduler patch : post wait hang 

PHSS_36354 11.31 assembler patch

PHSS_37042  11.31 hppac (packed decimal)

PHSS_37959  Libcl patch for alternate stack issue fix 

(QXCR1000818011)

PHSS_39094 11.31 linker + fdp cumulative patch

PHSS_39100 11.31 Math Library Cumulative Patch

PHSS_39102 11.31 Integrity Unwind Library

PHSS_38141 11.31 aC++ Runtime

补丁下载地址：

HP provides patch bundles at

http://www.software.hp.com/SUPPORT_PLUS

Individual patches can be downloaded from

http://itresourcecenter.hp.com/

安装补丁命令：

#swinstall –s  $PATH/patchname

 

2、 Hard limits check failed
Check: Hard limits for "maximum open file descriptors" 
  Node Name         Type          Available     Required      Status          
  ----------------  ------------  ------------  ------------  ----------------
  pmscpdb2          hard          31744         63488         failed          
  pmscpdb1          hard          31744         63488         failed          
Result: Hard limits check failed for "maximum open file descriptors"

修改limit

pmscpdb1:[/dev/vgcxk_sc_vote]#kctune maxfiles_lim=63488
     ==> Update the automatic 'backup' configuration first? yes
       * The automatic 'backup' configuration has been updated.
       * Future operations will update the backup without prompting.
       * The requested changes have been applied to the currently
         running configuration.
Tunable                 Value  Expression  Changes
maxfiles_lim  (before)  31744  31744       Immed
              (now)     63488  63488 
              
              
  
3、2节点安装GI时attachhome失败，抖动attachhome
Remote 'AttachHome' failed on nodes: 'pmscpdb2'. Refer to '/oracle/app/oraInventory/logs/installActions2019-07-03_03-56-20PM.log' for details.
It is recommended that the following command needs to be manually run on the failed nodes: 
 /oracle/app/11.2/grid/oui/bin/runInstaller -attachHome -noClusterEnabled ORACLE_HOME=/oracle/app/11.2/grid ORACLE_HOME_NAME=Ora11g_gridinfrahome1 CLUSTER_NODES=pmscpdb1,pmscpdb2 "INVENTORY_LOCATION=/oracle/app/oraInventory" LOCAL_NODE=<node on which command is to be run>. 
Please refer 'AttachHome' logs under central inventory of remote nodes where failure occurred for more details.

grid:
/oracle/app/11.2/grid/oui/bin/runInstaller -attachHome -noClusterEnabled ORACLE_HOME=/oracle/app/11.2/grid ORACLE_HOME_NAME=Ora11g_gridinfrahome1 CLUSTER_NODES=pmscpdb1,pmscpdb2 "INVENTORY_LOCATION=/oracle/app/oraInventory" LOCAL_NODE=pmscpdb2
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 189120 MB    Passed
The inventory pointer is located at /var/opt/oracle/oraInst.loc
The inventory is located at /oracle/app/oraInventory
'AttachHome' was successful.

 

4、root.sh执行失败
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /oracle/app/11.2/grid/crs/install/crsconfig_params
Creating trace directory
User ignored Prerequisites during installation
Installing Trace File Analyzer
OLR initialization - successful
  root wallet
  root wallet cert
  root cert export
  peer wallet
  profile reader wallet
  pa wallet
  peer wallet keys
  pa wallet keys
  peer cert request
  pa cert request
  peer cert
  pa cert
  peer root cert TP
  profile reader root cert TP
  pa root cert TP
  peer pa cert TP
  pa peer cert TP
  profile reader pa cert TP
  profile reader peer cert TP
  peer user cert
  pa user cert
Adding Clusterware entries to inittab
CRS-2672: Attempting to start 'ora.mdnsd' on 'pmscpdb1'
CRS-2676: Start of 'ora.mdnsd' on 'pmscpdb1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'pmscpdb1'
CRS-2676: Start of 'ora.gpnpd' on 'pmscpdb1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'pmscpdb1'
CRS-2672: Attempting to start 'ora.gipcd' on 'pmscpdb1'
CRS-2676: Start of 'ora.gipcd' on 'pmscpdb1' succeeded
CRS-2676: Start of 'ora.cssdmonitor' on 'pmscpdb1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'pmscpdb1'
CRS-2672: Attempting to start 'ora.diskmon' on 'pmscpdb1'
CRS-2676: Start of 'ora.diskmon' on 'pmscpdb1' succeeded
CRS-2674: Start of 'ora.cssd' on 'pmscpdb1' failed
CRS-2679: Attempting to clean 'ora.cssd' on 'pmscpdb1'
CRS-2681: Clean of 'ora.cssd' on 'pmscpdb1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'pmscpdb1'
CRS-2677: Stop of 'ora.gipcd' on 'pmscpdb1' succeeded
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'pmscpdb1'
CRS-2677: Stop of 'ora.cssdmonitor' on 'pmscpdb1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'pmscpdb1'
CRS-2677: Stop of 'ora.gpnpd' on 'pmscpdb1' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'pmscpdb1'
CRS-2677: Stop of 'ora.mdnsd' on 'pmscpdb1' succeeded
CRS-5804: Communication error with agent process
CRS-4000: Command Start failed, or completed with errors.
CSS startup failed with return code 1
The exlusive mode cluster start failed, see Grid Infrastructure alert log for more information
Initial cluster configuration failed.  See /oracle/app/11.2/grid/cfgtoollogs/crsconfig/rootcrs_pmscpdb1.log for details
/oracle/app/11.2/grid/perl/bin/perl -I/oracle/app/11.2/grid/perl/lib -I/oracle/app/11.2/grid/crs/install /oracle/app/11.2/grid/crs/install/rootcrs.pl execution failed
pmscpdb1:[/oracle/app]#ps -ef|grep d.bin
    root 15772     1  0 17:03:10 ?         0:09 /oracle/app/11.2/grid/bin/ohasd.bin reboot
    root 16406   545  1 17:16:30 pts/2     0:00 grep d.bin

2节点磁盘权限不对
pmscpdb2:[/dev/vgcxk_sc_vote]#ls -lrt
total 0
crw-rw-rw-   1 root       sys        128 0x010000 Jun 22  2016 group
brw-r-----   1 root       sys        128 0x010001 Jun 22  2016 lvcxk_sc_vote1
crw-rw-rw-   1 111        oinstall   128 0x010001 Jun 22  2016 rlvcxk_sc_vote1
brw-r-----   1 root       sys        128 0x010002 Jun 22  2016 lvcxk_sc_vote2
crw-rw-rw-   1 111        oinstall   128 0x010002 Jun 22  2016 rlvcxk_sc_vote2
brw-r-----   1 root       sys        128 0x010003 Jun 22  2016 lvcxk_sc_vote3
crw-rw-rw-   1 111        oinstall   128 0x010003 Jun 22  2016 rlvcxk_sc_vote3
pmscpdb2:[/dev/vgcxk_sc_vote]#chown grid:oinstall rlvcxk_sc_vote*

重新执行root.sh

perl /oracle/app/11.2/grid/crs/install/rootcrs.pl -deconfig -force
dd if=/dev/zero count=10 bs=1024k of=/dev/vgcxk_sc_vote/lvcxk_sc_vote1
dd if=/dev/zero count=10 bs=1024k of=/dev/vgcxk_sc_vote/lvcxk_sc_vote2
dd if=/dev/zero count=10 bs=1024k of=/dev/vgcxk_sc_vote/lvcxk_sc_vote3

 

5、asm写入spfile失败
CRS-2672: Attempting to start 'ora.mdnsd' on 'pmscpdb1'
CRS-2676: Start of 'ora.mdnsd' on 'pmscpdb1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'pmscpdb1'
CRS-2676: Start of 'ora.gpnpd' on 'pmscpdb1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'pmscpdb1'
CRS-2672: Attempting to start 'ora.gipcd' on 'pmscpdb1'
CRS-2676: Start of 'ora.gipcd' on 'pmscpdb1' succeeded
CRS-2676: Start of 'ora.cssdmonitor' on 'pmscpdb1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'pmscpdb1'
CRS-2672: Attempting to start 'ora.diskmon' on 'pmscpdb1'
CRS-2676: Start of 'ora.diskmon' on 'pmscpdb1' succeeded
CRS-2676: Start of 'ora.cssd' on 'pmscpdb1' succeeded

Creation of ASM spfile in disk group failed. Following error occured: ORA-29780: unable to connect to GPnP daemon [CLSGPNP_ERR]

Configuration of ASM ... failed
see asmca logs at /oracle/app/grid/cfgtoollogs/asmca for details
Did not succssfully configure and start ASM at /oracle/app/11.2/grid/crs/install/crsconfig_lib.pm line 6912.
/oracle/app/11.2/grid/perl/bin/perl -I/oracle/app/11.2/grid/perl/lib -I/oracle/app/11.2/grid/crs/install /oracle/app/11.2/grid/crs/install/rootcrs.pl execution failed
pmscpdb1:[/oracle/app/11.2/grid/install]#su - grid
export ORACLE_CRS_HOME=/oracle/app/11.2/grid

增加ORACLE_CRS_HOME变量并与ORACLE_HOME保持一致
export ORACLE_HOME=/oracle/app/11.2/grid
export ORACLE_CRS_HOME=/oracle/app/11.2/grid

root的profile也需要修改
export PS1=`hostname`:['$PWD']#
export ORACLE_BASE=/oracle/app
export ORA_CRS_HOME=/oracle/app/crs/product/10.2.0/crs
export ORACLE_HOME=/oracle/app/database/product/10.2.0/db_1
export PATH=$PATH:$ORA_CRS_HOME/bin:$ORACLE_HOME/bin:$ORACLE_HOME/dcm/bin:$ORACLE_HOME/webcache/bin:$ORACLE_HOME/opmn/bin
export PATH=$PATH:/opt/iscsi/bin

6、2节点挂载data盘失败
SQL> alter diskgroup data mount;
alter diskgroup data mount
*
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15017: diskgroup "DATA" cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "DATA"

SQL> show parameter disk

NAME                                 TYPE
------------------------------------ ----------------------
VALUE
------------------------------
asm_diskgroups                       string
DATA
asm_diskstring                       string
/dev/vgcxk_sc_vote/*, /dev/vgc
asm_diskgroups参数2节点没有，alter system修改后还是同样的报错

asmca挂载显示了更多信息
Generic failure interacting with CRS. Details PRCR-1079 : Failed to start resource ora.DATA.dg
CRS-5017: The resource action "ora.DATA.dg start" encountered the following error: 
ORA-15032: not all alterations performed
ORA-15040: diskgroup is incomplete
ORA-15042: ASM disk "730" is missing from group number "2" 
ORA-15042: ASM disk "729" is missing from group number "2" 
ORA-15042: ASM disk "728" is missing from group number "2" 
ORA-15042: ASM disk "727" is missing from group number "2" 
ORA-15042: ASM disk "726" is missing from group number "2" 
ORA-15042: ASM disk "725" is missing from group number "2" 
ORA-15042: ASM disk "724" is missing from group number "2" 
ORA-15042: ASM . For details refer to "(:CLSN00107:)" in "/oracle/app/11.2/grid/log/pmscpdb2/agent/crsd/oraagent_grid/oraagent_grid.log".

CRS-2674: Start of 'ora.DATA.dg' on 'pmscpdb2' failed

那几个盘有问题，drop掉那几个盘然后再mount就ok了

 

 

7、oracle ssh认证通不过，grid已经没问题了

step1、增加/etc/profile和/etc/csh.login配置
#/etc/profile chmod +w /etc/profile
if [ $USER = "oracle" ] || [ $USER = "grid" ]; then
        if [ $SHELL = "/bin/ksh" ]; then
              ulimit -p 16384
              ulimit -n 65536
        else
              ulimit -u 16384 -n 65536
        fi
        umask 022
fi

if [ -t 0 ]; then
   stty intr ^C
fi

#/etc/csh.login  chmod +w /etc/csh.login
if ( $USER == "oracle" || $USER == "grid" ) then
        limit maxproc 16384
        limit descriptors 65536
endif

test -t 0
if ($status == 0) then
   stty intr ^C
endif
删除.ssh文件，重新手工建立互信，不行

 

step2、重启机器，还是不行

 

step3、密码为空，ssh互信必须要有密码

pmscpdb2:[/]#passwd oracle
Changing password for oracle
New password: 
Re-enter new password: 
Passwd successfully changed

 

终于成功了

 

8、crs重启，css启动失败
#vgdisplay
vgdisplay: Volume group not activated.
vgdisplay: Cannot display volume group "/dev/vgepmhis".
vgdisplay: Volume group not activated.
vgdisplay: Cannot display volume group "/dev/vgcxk_sc_vote".
vgdisplay: Volume group not activated.
vgdisplay: Cannot display volume group "/dev/vg_empty".
vgdisplay: Volume group not activated.
vgdisplay: Cannot display volume group "/dev/vglock".
vgdisplay: Volume group not activated.
vgdisplay: Cannot display volume group "/dev/vgcxk_sc".

这个问题是由于存储集群没有起

通知主机重启存储集群

9、安装报错
INFO:   PATH = /usr/bin:/usr/ccs/bin:/usr/bin:/usr/ccs/bin:/usr/contrib/bin:/usr/contrib/Q4/bin:/opt/perl/bin:/opt/ipf/bin:/opt/gvsd/bin:/opt/nettladm/bin:/opt/fcms/bin:/opt/wbem/bin:/opt/wbem/sbin:/opt/sas/bin:/opt/graphics/common/bin:/opt/atok/bin:/usr/bin/X11:/usr/contrib/bin/X11:/opt/sec_mgmt/bastille/bin:/opt/caliper/bin:/opt/resmon/bin:/opt/drd/bin:/opt/dsau/bin:/opt/dsau/sbin:/opt/firefox:/opt/gnome/bin:/opt/perf/bin:/usr/contrib/kwdb/bin:/opt/mozilla:/opt/perl_32/bin:/opt/perl_64/bin:/opt/prm/bin:/opt/sfm/bin:/opt/swm/bin:/opt/sec_mgmt/spc/bin:/opt/ssh/bin:/opt/sentinel/bin:/opt/swa/bin:/opt/hpsmh/bin:/opt/thunderbird:/opt/langtools/bin:/opt/wlm/bin:/opt/gwlm/bin:/opt/ignite/bin:/bin:/oracle/app/oracle/product/11.2/db_1/bin:/oracle/app/oracle/product/11.2/db_1/dcm/bin:/oracle/app/oracle/product/11.2/db_1/webcache/bin:/oracle/app/oracle/product/11.2/db_1/opmn/bin:/oracle/app/oracle/product/11.2/db_1/OPatch:.:/oracle/soft/database/install

INFO:   CLASSPATH = 

INFO: Username:oracle

INFO: Oracle Universal Installer version is 11.2.0.4.0

INFO: Initializing the OiicInstallAPISession
INFO: Shutting down OUISetupDriver.JobExecutorThread
SEVERE: [FATAL] [INS-00001] Unknown irrecoverable error
   CAUSE: No additional information available.
   ACTION: Refer to the logs or contact Oracle Support Services
   SUMMARY:
       - java.lang.NullPointerException.
Refer associated stacktrace #oracle.install.commons.util.exception.DefaultErrorAdvisor:1875
INFO: Advice is ABORT
SEVERE: Unconditional Exit
INFO: Adding ExitStatus FAILURE to the exit status set
INFO: Adding ExitStatus SUCCESS_WITH_WARNINGS to the exit status set
INFO: Finding the most appropriate exit status for the current application
INFO: Exit Status is -1
INFO: Shutdown Oracle Database 11g Release 2 Installer
INFO: Unloading Setup Drive

重跑预安装检查，发现没有oracle home
mkdir -p /oracle/app/oracle/product/11.2/db_1  
再跑就没有报错了

 

10、opatch 应用失败
pmscpdb1:[/oracle/soft]#/oracle/app/11.2/grid/OPatch/opatch auto /oracle/soft/28813878 -ocmrf  /tmp/ocm.rsp -oh /oracle/app/11.2/grid
Executing /oracle/app/11.2/grid/perl/bin/perl /oracle/app/11.2/grid/OPatch/crs/patch11203.pl -patchdir /oracle/soft -patchn 28813878 -ocmrf /tmp/ocm.rsp -oh /oracle/app/11.2/grid -paramfile /oracle/app/11.2/grid/crs/install/crsconfig_params

This is the main log file: /oracle/app/11.2/grid/cfgtoollogs/opatchauto2019-07-04_18-41-54.log

This file will show your detected configuration and all the steps that opatchauto attempted to do on your system:
/oracle/app/11.2/grid/cfgtoollogs/opatchauto2019-07-04_18-41-54.report.log

2019-07-04 18:41:54: Starting Clusterware Patch Setup
Using configuration parameter file: /oracle/app/11.2/grid/crs/install/crsconfig_params

Unable to determine if /oracle/app/11.2/grid is shared oracle home
Enter 'yes' if this is not a shared home or if the prerequiste actions are performed to patch this shared home (yes/no):yes

Stopping CRS...

Stopped CRS successfully

patch /oracle/soft/28813878/28729234  apply successful for home  /oracle/app/11.2/grid 

patch /oracle/soft/28813878/28729262  apply failed  for home  /oracle/app/11.2/grid

Starting CRS...
Installing Trace File Analyzer
CRS-4123: Oracle High Availability Services has been started.

单独应用/oracle/soft/28813878/28729262补丁