<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">
<META NAME="Generator" CONTENT="MS Exchange Server version 6.5.7226.0">
<TITLE>ORA-01207 after SAN maintenance</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/rtf format -->
<P><FONT SIZE=2 FACE="Arial">We had a situation over the weekend with our production database that we can't figure out, hoping someone can shed some light.</FONT></P>
<P><FONT SIZE=2 FACE="Arial">Specifics:</FONT>
<BR><FONT SIZE=2 FACE="Arial">Oracle 9.2.0.4</FONT>
<BR><FONT SIZE=2 FACE="Arial">OS is Redhat AS2.1</FONT>
<BR><FONT SIZE=2 FACE="Arial">ocfs-2.4.9-e-summit-1.0.12-1</FONT>
<BR><FONT SIZE=2 FACE="Arial">ocfs-tools-1.0.10-1</FONT>
<BR><FONT SIZE=2 FACE="Arial">ocfs-support-1.0.10-1</FONT>
<BR><FONT SIZE=2 FACE="Arial">ocfs-2.4.9-e-enterprise-1.0.12-1</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">All database, redo, undo, and control files are on ocfs, archived logs are on ext3.</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">We shut down the database for san maintenance, but didn't shut down cluster</FONT>
<BR><FONT SIZE=2 FACE="Arial">manager. The san was disconnected from the server, a tray was added and then</FONT>
<BR><FONT SIZE=2 FACE="Arial">the san was reconnected. The server and cluster manager remained up during the</FONT>
<BR><FONT SIZE=2 FACE="Arial">maintenance.</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">When we tried to restart the database, we got an ORA-01207, saying the control</FONT>
<BR><FONT SIZE=2 FACE="Arial">file was older than the datafiles. Per Oracle support, we recreated the control file</FONT>
<BR><FONT SIZE=2 FACE="Arial">and attempted to bring the db up with the new one. At this point we received the</FONT>
<BR><FONT SIZE=2 FACE="Arial">following:</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">Errors in file /opt/oracle/product/9.2.0/admin/ENTPRD/udump/entprd2_ora_22596.trc:</FONT>
<BR><FONT SIZE=2 FACE="Arial">ORA-00600: internal error code, arguments: [kcoapl_blkchk], [5], [393], [6101], [], [], [], []</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">There's a RAC bug entry for [kcoapl_blkchk], but it was for a 4-node RAC, ours is only</FONT>
<BR><FONT SIZE=2 FACE="Arial">2 nodes, so Oracle internals support said they didn't think it applied to our case. We</FONT>
<BR><FONT SIZE=2 FACE="Arial">ended up doing a point-in-time recovery to before the san maintenance, but moved the</FONT>
<BR><FONT SIZE=2 FACE="Arial">datafiles to an ext3 partition for now.</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">Has anyone seen this before, or have any input as to what happened? We're trying to</FONT>
<BR><FONT SIZE=2 FACE="Arial">determine if this is a bug, and if we should move back to RAC/ocfs.</FONT>
</P>
<P><FONT SIZE=2 FACE="Arial">Thanks very much,</FONT>
<BR><FONT SIZE=2 FACE="Arial">Matt Daniels</FONT>
<BR><FONT SIZE=2 FACE="Arial">Apps DBA, Priority Healthcare Corp</FONT>
</P>
</BODY>
</HTML>