oracle 异常关闭 Instance Critical Process (pid: 6, ospid: 16851, MMAN) died unexpectedly

os: ubuntu 16.04
db: oracle 12.1.0.2

开发人员反馈说 连接不上测试环境的 oracle 数据库,登录主机看了下,oracle 用户仅有监听程序,查看监听了,没有service.

$ lsnrctl status

LSNRCTL for Linux: Version 12.1.0.2.0 - Production on 08-JUL-2019 10:08:47

Copyright (c) 1991, 2014, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=test-node1)(PORT=1521)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER
Version                   TNSLSNR for Linux: Version 12.1.0.2.0 - Production
Start Date                18-MAR-2019 18:48:18
Uptime                    111 days 15 hr. 20 min. 29 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /data/u01/oracle/app/oracle/product/12.1.0/dbhome_1/network/admin/listener.ora
Listener Log File         /data/u01/oracle/app/oracle/diag/tnslsnr/test-node1/listener/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=test-node1)(PORT=1521)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC1521)))
The listener supports no services
The command completed successfully

查看 alert 日志

Mon Jul 08 09:52:43 2019
Instance Critical Process (pid: 6, ospid: 16851, MMAN) died unexpectedly
PMON (ospid: 16841): terminating the instance due to error 822
Mon Jul 08 09:52:44 2019
System state dump requested by (instance=1, osid=16841 (PMON)), summary=[abnormal instance termination].
System State dumped to trace file /data/u01/oracle/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_diag_16899_20190708095244.trc
Mon Jul 08 09:52:49 2019
Instance terminated by PMON, pid = 16841

查看系统日志

# vi /var/log/syslog

Jul  8 09:52:39 test-node1 kernel: [9673285.040654] Out of memory: Kill process 16851 (ora_mman_orcl) score 57 or sacrifice child
Jul  8 09:52:39 test-node1 kernel: [9673285.040659] Killed process 16851 (ora_mman_orcl) total-vm:5282848kB, anon-rss:2148kB, file-rss:1189548kB

16851 为 MMAN 进程,被OS OOM killer 干掉了.

查看主机上后,发现还跑了很多java应用,给虚拟机添加内存吧.

参考:
<<PMON Terminating the Instance Due To Error 822 (文档 ID 2342018.1)>>
https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=243037990294809&id=2342018.1&_adf.ctrl-state=92l8p1hys_177