<div>Luis,</div> <div>Let me understanfd your suggestion. Are you suggesting:</div> <div>$ORA_CRS_HOME -- without datavolume,nointr</div> <div>$ORACLE_HOME -- without datavolume,nointr</div> <div>But place OCR, Voting Disks & future datafiles with datavolume,nointr</div> <div> </div> <div>Did I understand correctly?</div> <div>I have also gone back to OCFS2 1.2.5-6.</div> <div>Okay, if this is the suggestion -- I will surely try.</div> <div>Thanks.</div> <div>Anjan<BR><BR><B><I>Luis Freitas <lfreitas34@yahoo.com></I></B> wrote:</div> <BLOCKQUOTE class=replbq style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #1010ff 2px solid"><BR> <BLOCKQUOTE class=replbq style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: rgb(16,16,255) 2px solid"><OCFS2-USER@OSS.ORACLE.COM><OCFS2-USER@OSS.ORACLE.COM>Anjan,<BR><BR> The two installs I did with x86_64 were with ASM, with kernel versions that today are very old, some years
ago. Here I am using x86 (even as the hardware is x86_64 capable) due to a managment decision not to go to x86_64. <BR><BR> Anyone else on the list?<BR><BR> About the mount points, the CRS home is a ORACLE_HOME, so you shouldnt mount it with datavolume. If you want to keep the CRS ORACLE_HOME and the RDBMS ORACLE_HOME each on one filesystem you should have at least a third partition for the cluster registry, voting disks and datafiles, mounted with the datavolume option, and mount those two without it. <BR><BR> If you need to get this working fast, I think you should try a older OCFS2 module version. If not keep working with Mark and the other Oracle people here on the list as they can diagnose these errors and get it fixed.<BR><BR> What is the firewire disk you are using?<BR><BR>Regards,<BR>Luis<BR><BR><BR><B><I>Anjan Chakraborty <anjan.chakraborty@yahoo.com></I></B>
wrote:</OCFS2-USER@OSS.ORACLE.COM></OCFS2-USER@OSS.ORACLE.COM> <BLOCKQUOTE class=replbq style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: rgb(16,16,255) 2px solid"><BR><BR><B><I>Luis Freitas <lfreitas34@yahoo.com></I></B> wrote: <BLOCKQUOTE class=replbq style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: rgb(16,16,255) 2px solid">Luis,<BR>As far as I know, it's not recommended to mount ORACLE_HOME with datavolume,nointr but that's not the case with CRS. So, I have different mount options for ORA_CRS_HOME (home/oracle/ocrvotcrs) & ORACLE_HOME (home/oracle/orasys). If I am wrong, please correct me. Also, I don't have any datafile yet because I don't have the basic thing -- Oracle binary under ORACLE_HOME. Once I have that, I will have datafiles & mount will contain datavolume,nointr.<BR>Do you know anybody has successfully implemented OCFS2 1.2.7-1 on Red Hat4.5 (kernel 2.6.9-55.EL) under 86_64 architecture? <BR>What exactly you have?<BR>Thanks
for your continuous effort to help me.<BR>I hope somebody else will also start joining this discussion & help me.<BR>I am really stuck -- can't advance at all -- need help desperately.<BR>Anjan<BR><BR><BR>Anjan,<BR><BR> Well it is only a sugestion.<BR><BR> About those mount options, perhaps the Oracle people can give you a feedback on that also. But I noticed that you have two mount points, and seems to be installing CRS binaries on one, and RDBMS binaries on the other. So, where are datafiles? <BR><BR> You shouldnt be installing the CRS home on /home/oracle/ocrvotcrs as it has the datavolume option. It is not clear if you are trying this.<BR><BR> The filesystems where you have binaries should not have the datavolume option, and the filesystems with datafiles, voting disks and the cluster registry need to have the datavolume option.<BR><BR>Regards,<BR>Luis<BR><BR><B><I>Anjan Chakraborty
<anjan.chakraborty@yahoo.com></I></B> wrote: <BLOCKQUOTE class=replbq style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: rgb(16,16,255) 2px solid"> <DIV>Mark,</DIV> <DIV>Thanks to both of you for trying to help me.</DIV> <DIV>I have alreaddy communicated to Luis that I have to have OCFS2 because my software needs Clustering technology that is absent in EXT3. Moreover, both CRS & RDBMS homes should also be on shared/clustered system -- so, OCFS2 is the only choice.</DIV> <DIV>If you can help me to understand/resolve this issue, I will really appreciate that.</DIV> <DIV>Please note that my FireWire shared drive works perfectly when I use RAW but as soon as I am trying to use OCFS2, all the problems started.</DIV> <DIV>Thanks.</DIV> <DIV>Anjan <BR><BR><B><I>Mark Fasheh <mark.fasheh@oracle.com></I></B> wrote:</DIV> <BLOCKQUOTE class=replbq style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: rgb(16,16,255) 2px solid">Luis,<BR>Thanks
for helping here. I have one comment regarding moving the<BR>shared home to ext3. If Anjan's setup is having issues like this, moving his<BR>oracle home to a local disk would only hide problems which take longer to<BR>reproduce for the crs and data files partitions. What needs to happen is<BR>that the root cause of his problems is discovered and fixed.<BR><BR>Keep in mind, I'm not saying someone couldn't use ext3 for their oracle<BR>install - it's an excellent choice for running a non-shared oracle home.<BR>It's just not a good shared disk diagnostic tool ;)<BR><BR>Once again, thanks for stepping up and lending a hand.<BR>--Mark<BR><BR>On Tue, Nov 27, 2007 at 08:50:28AM -0800, Luis Freitas wrote:<BR>> Anjan,<BR>> <BR>> You dont need to share the database binaries, only the CRS and the<BR>> datafiles. You can do it to save disk space, but it is not mandatory. The CRS<BR>> and datafiles are much less stressfull to the filesystem structures as there is<BR>>
a reduced number of large files, although they usually have a heavy i/o load,<BR>> and stress the disk subsystem and the locking algorithms.<BR>> <BR>> So you can have two separated ext3 filesystems located at the same place on<BR>> each server, and one or more ocfs2 shared filesystems for the CRS and the<BR>> database datafiles. The Oracle installer takes care of copying the binaries<BR>> between the servers during the installation.<BR>> <BR>> It might be usefull to try a lower version like 1.2.6, as you are using the<BR>> latest version available. I am using 1.2.4-2 here with RH 4.0 and kernel<BR>> 2.6.9-42 and it seems rather stable, only needed to increase the timeouts. (But<BR>> I dont have the oracle_home shared.)<BR>> <BR>> Also you might have a hardware problem somewhere on the SAN. And I still<BR>> have to check those mount options you sent...<BR>> <BR>> One detail. I dont know if the Centos distro includes the OCFS2
module. Are<BR>> you using the modules downloaded from the oss.oracle.com site for the<BR>> equivalent RH 4.0 kernel, or modules built by Centos? If using CENTOS modules<BR>> you might get better results by changing to the Oracle built modules for the<BR>> equivalent RH 4.0 kernel.<BR>> <BR>> Regards,<BR>> Luis<BR>> <BR>> Anjan Chakraborty <ANJAN.CHAKRABORTY@YAHOO.COM>wrote:<BR>> <BR>> Luis,<BR>> I am intending to use CRS/RAC that needs a Cluster File System. How does<BR>> EXT3 falls into that area?<BR>> Thanks.<BR>> Anjan<BR>> <BR>> Thanks a lot for the response. Here is what I am doing:<BR>> <BR>> 1.<BR>> mkfs.ocfs2 -b 4K -C 32K -N 4 -L ocrvotcrs /dev/sdb3 -- for CRS<BR>> mkfs.ocfs2 -b 4K -C 32K -N 4 -L orasys /dev/sdb4 -- for RDBMS<BR>> <BR>> 2. Then mounting using /etc/fstab:<BR>> /dev/sdb3 /home/oracle/ocrvotcrs ocfs2 _netdev,datavolume,nointr<BR>> 0 0<BR>> /dev/sdb4 /home/oracle/orasys
ocfs2 _netdev 0 0<BR>> If you find anything wrong here, can you please tell what to do?<BR>> It's a non-production system & so I can experiment with whatever you<BR>> suggest and won't held you responsible for that.<BR>> Thanks.<BR>> Anjan<BR>> <BR>> <BR>> Luis Freitas <LFREITAS34@YAHOO.COM>wrote:<BR>> <BR>> Anjan,<BR>> <BR>> Are you installing the binaries on OCSF2 too? How are you mounting<BR>> the filesystem?<BR>> <BR>> You might want to try using ext3 for the binaries and OCF2 only for<BR>> datafiles and archives, until you get this fixed.<BR>> <BR>> Regards,<BR>> Luis<BR>> <BR>> Anjan Chakraborty <ANJAN.CHAKRABORTY@YAHOO.COM>wrote:<BR>> <BR>> Hi,<BR>> I sent an email to Mark Fisheh of Oracle Corp. & posted this issue<BR>> at OTN under Linux thread this morning. I hope that someone among<BR>> you might have experienced this and can help. On that basis, I am<BR>> sending this to you
too. I am stuck & will really appreciate if you<BR>> can shed some light on this.<BR>> Thanks.<BR>> Anjan<BR>> ***********************************************************************************************************<BR>> I have a 2 node CentOS 4.5 86_64 system (kernel 2.6.9-55.EL). On<BR>> this I installed Oracle OCFS2 1.2.7-1 (with exact kernel matching).<BR>> After this I installed Oracle CRS 10.2.0.1 and that installation<BR>> went fine. Then I tried to install Oracle RDBMS 10.2.0.1 and all<BR>> the problems started from there. The /var/log/messages file got<BR>> filled up with messages (giving some to avoid confusion):<BR>> ocfs2_read_locked_inode: .. : ERROR: Invalid dinode #0 signature =<BR>> ocfs2_lookup: .. : ERROR: Unable to create inode ....<BR>> <BR>> Then OUI gave several error messages, e.g.<BR>> .... Invalid stored block length on file ...../em/em.war followed<BR>> by I/O error in file<BR>> Errors in
invoking to files ins_rdbms.mk and ins_ldap.mk<BR>> <BR>> Then /var/log/messages gave:<BR>> OCFS2: ERROR (device ....): ocfs2_extend_file: Dinode # ...... has<BR>> bad signature O' # I ....<BR>> And the installation failed & CRS died. And the machines reboot.<BR>> I ran fsck.ocfs2 -n /dev/...., it came clean.<BR>> I have tested this several timnes & always same thing happening.<BR>> If I use RAW partitions, everything works fine. So, the problem may<BR>> be in the OCFS2 & OS/Oracle -- but, not sure how to bypass this.<BR>> I have to have OCFS2 -- can't use RAW for various reasons.<BR>> Can somebody please help me to resolve this?<BR>> Thanks.<BR>> ***********************************************************************************************************<BR>>
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<BR>> Be a better pen pal. Text or chat with friends inside Yahoo! Mail.<BR>> See how._______________________________________________<BR>> Ocfs2-users mailing list<BR>> Ocfs2-users@oss.oracle.com<BR>> http://oss.oracle.com/mailman/listinfo/ocfs2-users<BR>> <BR>> <BR>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<BR>> Be a better pen pal. Text or chat with friends inside Yahoo! Mail. See<BR>> how.<BR>> <BR>> <BR>>
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<BR>> Never miss a thing. Make Yahoo your homepage.<BR>> <BR>> <BR>> <BR>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<BR>> Get easy, one-click access to your favorites. Make Yahoo! your homepage.<BR><BR>> _______________________________________________<BR>> Ocfs2-users mailing list<BR>> Ocfs2-users@oss.oracle.com<BR>> http://oss.oracle.com/mailman/listinfo/ocfs2-users<BR>--<BR>Mark Fasheh<BR>Senior Software Developer,
Oracle<BR>mark.fasheh@oracle.com<BR></ANJAN.CHAKRABORTY@YAHOO.COM></LFREITAS34@YAHOO.COM></ANJAN.CHAKRABORTY@YAHOO.COM></BLOCKQUOTE><BR> <DIV></DIV> <HR SIZE=1> Get easy, one-click access to your favorites. <A href="http://us.rd.yahoo.com/evt=51443/*http://www.yahoo.com/r/hs">Make Yahoo! your homepage.</A> </BLOCKQUOTE><BR> <DIV></DIV> <HR SIZE=1> Be a better pen pal. Text or chat with friends inside Yahoo! Mail. <A href="http://us.rd.yahoo.com/evt=51732/*http://overview.mail.yahoo.com/">See how.</A></BLOCKQUOTE><BR> <DIV></DIV> <HR SIZE=1> Be a better sports nut! Let your teams follow you with Yahoo Mobile. <A href="http://us.rd.yahoo.com/evt=51731/*http://mobile.yahoo.com/sports;_ylt=At9_qDKvtAbMuh1G1SQtBI7ntAcJ">Try it now.</A></BLOCKQUOTE><BR> <DIV></DIV> <HR SIZE=1> Never miss a thing. <A href="http://us.rd.yahoo.com/evt=51438/*http://www.yahoo.com/r/hs">Make Yahoo your homepage.</A> </BLOCKQUOTE><BR> <div> <HR SIZE=1> Be a better pen pal. Text or chat
with friends inside Yahoo! Mail. <A href="http://us.rd.yahoo.com/evt=51732/*http://overview.mail.yahoo.com/">See how.</A>Anjan,<BR><BR> The two installs I did with x86_64 were with ASM, with kernel versions that today are very old, some years ago. Here I am using x86 (even as the hardware is x86_64 capable) due to a managment decision not to go to x86_64. <BR><BR> Anyone else on the list?<BR><BR> About the mount points, the CRS home is a ORACLE_HOME, so you shouldnt mount it with datavolume. If you want to keep the CRS ORACLE_HOME and the RDBMS ORACLE_HOME each on one filesystem you should have at least a third partition for the cluster registry, voting disks and datafiles, mounted with the datavolume option, and mount those two without it. <BR><BR> If you need to get this working fast, I think you should try a older OCFS2 module version. If not keep working with Mark and the other Oracle
people here on the list as they can diagnose these errors and get it fixed.<BR><BR> What is the firewire disk you are using?<BR><BR>Regards,<BR>Luis<BR><BR><BR><B><I>Anjan Chakraborty <anjan.chakraborty@yahoo.com></I></B> wrote: <BLOCKQUOTE class=replbq style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: rgb(16,16,255) 2px solid"><BR><BR><B><I>Luis Freitas <lfreitas34@yahoo.com></I></B> wrote: <BLOCKQUOTE class=replbq style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: rgb(16,16,255) 2px solid">Luis,<BR>As far as I know, it's not recommended to mount ORACLE_HOME with datavolume,nointr but that's not the case with CRS. So, I have different mount options for ORA_CRS_HOME (home/oracle/ocrvotcrs) & ORACLE_HOME (home/oracle/orasys). If I am wrong, please correct me. Also, I don't have any datafile yet because I don't have the basic thing -- Oracle binary under ORACLE_HOME. Once I have that, I will have datafiles & mount will
contain datavolume,nointr.<BR>Do you know anybody has successfully implemented OCFS2 1.2.7-1 on Red Hat4.5 (kernel 2.6.9-55.EL) under 86_64 architecture? <BR>What exactly you have?<BR>Thanks for your continuous effort to help me.<BR>I hope somebody else will also start joining this discussion & help me.<BR>I am really stuck -- can't advance at all -- need help desperately.<BR>Anjan<BR><BR><BR>Anjan,<BR><BR> Well it is only a sugestion.<BR><BR> About those mount options, perhaps the Oracle people can give you a feedback on that also. But I noticed that you have two mount points, and seems to be installing CRS binaries on one, and RDBMS binaries on the other. So, where are datafiles? <BR><BR> You shouldnt be installing the CRS home on /home/oracle/ocrvotcrs as it has the datavolume option. It is not clear if you are trying this.<BR><BR> The filesystems where you have binaries should not have the datavolume
option, and the filesystems with datafiles, voting disks and the cluster registry need to have the datavolume option.<BR><BR>Regards,<BR>Luis<BR><BR><B><I>Anjan Chakraborty <anjan.chakraborty@yahoo.com></I></B> wrote: <BLOCKQUOTE class=replbq style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: rgb(16,16,255) 2px solid"> <DIV>Mark,</DIV> <DIV>Thanks to both of you for trying to help me.</DIV> <DIV>I have alreaddy communicated to Luis that I have to have OCFS2 because my software needs Clustering technology that is absent in EXT3. Moreover, both CRS & RDBMS homes should also be on shared/clustered system -- so, OCFS2 is the only choice.</DIV> <DIV>If you can help me to understand/resolve this issue, I will really appreciate that.</DIV> <DIV>Please note that my FireWire shared drive works perfectly when I use RAW but as soon as I am trying to use OCFS2, all the problems started.</DIV> <DIV>Thanks.</DIV> <DIV>Anjan <BR><BR><B><I>Mark Fasheh
<mark.fasheh@oracle.com></I></B> wrote:</DIV> <BLOCKQUOTE class=replbq style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: rgb(16,16,255) 2px solid">Luis,<BR>Thanks for helping here. I have one comment regarding moving the<BR>shared home to ext3. If Anjan's setup is having issues like this, moving his<BR>oracle home to a local disk would only hide problems which take longer to<BR>reproduce for the crs and data files partitions. What needs to happen is<BR>that the root cause of his problems is discovered and fixed.<BR><BR>Keep in mind, I'm not saying someone couldn't use ext3 for their oracle<BR>install - it's an excellent choice for running a non-shared oracle home.<BR>It's just not a good shared disk diagnostic tool ;)<BR><BR>Once again, thanks for stepping up and lending a hand.<BR>--Mark<BR><BR>On Tue, Nov 27, 2007 at 08:50:28AM -0800, Luis Freitas wrote:<BR>> Anjan,<BR>> <BR>> You dont need to share the database binaries, only the CRS and
the<BR>> datafiles. You can do it to save disk space, but it is not mandatory. The CRS<BR>> and datafiles are much less stressfull to the filesystem structures as there is<BR>> a reduced number of large files, although they usually have a heavy i/o load,<BR>> and stress the disk subsystem and the locking algorithms.<BR>> <BR>> So you can have two separated ext3 filesystems located at the same place on<BR>> each server, and one or more ocfs2 shared filesystems for the CRS and the<BR>> database datafiles. The Oracle installer takes care of copying the binaries<BR>> between the servers during the installation.<BR>> <BR>> It might be usefull to try a lower version like 1.2.6, as you are using the<BR>> latest version available. I am using 1.2.4-2 here with RH 4.0 and kernel<BR>> 2.6.9-42 and it seems rather stable, only needed to increase the timeouts. (But<BR>> I dont have the oracle_home shared.)<BR>> <BR>> Also you might have a
hardware problem somewhere on the SAN. And I still<BR>> have to check those mount options you sent...<BR>> <BR>> One detail. I dont know if the Centos distro includes the OCFS2 module. Are<BR>> you using the modules downloaded from the oss.oracle.com site for the<BR>> equivalent RH 4.0 kernel, or modules built by Centos? If using CENTOS modules<BR>> you might get better results by changing to the Oracle built modules for the<BR>> equivalent RH 4.0 kernel.<BR>> <BR>> Regards,<BR>> Luis<BR>> <BR>> Anjan Chakraborty <ANJAN.CHAKRABORTY@YAHOO.COM>wrote:<BR>> <BR>> Luis,<BR>> I am intending to use CRS/RAC that needs a Cluster File System. How does<BR>> EXT3 falls into that area?<BR>> Thanks.<BR>> Anjan<BR>> <BR>> Thanks a lot for the response. Here is what I am doing:<BR>> <BR>> 1.<BR>> mkfs.ocfs2 -b 4K -C 32K -N 4 -L ocrvotcrs /dev/sdb3 -- for CRS<BR>> mkfs.ocfs2 -b 4K -C 32K -N 4 -L orasys /dev/sdb4 -- for
RDBMS<BR>> <BR>> 2. Then mounting using /etc/fstab:<BR>> /dev/sdb3 /home/oracle/ocrvotcrs ocfs2 _netdev,datavolume,nointr<BR>> 0 0<BR>> /dev/sdb4 /home/oracle/orasys ocfs2 _netdev 0 0<BR>> If you find anything wrong here, can you please tell what to do?<BR>> It's a non-production system & so I can experiment with whatever you<BR>> suggest and won't held you responsible for that.<BR>> Thanks.<BR>> Anjan<BR>> <BR>> <BR>> Luis Freitas <LFREITAS34@YAHOO.COM>wrote:<BR>> <BR>> Anjan,<BR>> <BR>> Are you installing the binaries on OCSF2 too? How are you mounting<BR>> the filesystem?<BR>> <BR>> You might want to try using ext3 for the binaries and OCF2 only for<BR>> datafiles and archives, until you get this fixed.<BR>> <BR>> Regards,<BR>> Luis<BR>> <BR>> Anjan Chakraborty <ANJAN.CHAKRABORTY@YAHOO.COM>wrote:<BR>> <BR>> Hi,<BR>> I sent an email to Mark Fisheh of Oracle Corp. & posted this
issue<BR>> at OTN under Linux thread this morning. I hope that someone among<BR>> you might have experienced this and can help. On that basis, I am<BR>> sending this to you too. I am stuck & will really appreciate if you<BR>> can shed some light on this.<BR>> Thanks.<BR>> Anjan<BR>> ***********************************************************************************************************<BR>> I have a 2 node CentOS 4.5 86_64 system (kernel 2.6.9-55.EL). On<BR>> this I installed Oracle OCFS2 1.2.7-1 (with exact kernel matching).<BR>> After this I installed Oracle CRS 10.2.0.1 and that installation<BR>> went fine. Then I tried to install Oracle RDBMS 10.2.0.1 and all<BR>> the problems started from there. The /var/log/messages file got<BR>> filled up with messages (giving some to avoid confusion):<BR>> ocfs2_read_locked_inode: .. : ERROR: Invalid dinode #0 signature =<BR>> ocfs2_lookup: .. : ERROR: Unable to create inode
....<BR>> <BR>> Then OUI gave several error messages, e.g.<BR>> .... Invalid stored block length on file ...../em/em.war followed<BR>> by I/O error in file<BR>> Errors in invoking to files ins_rdbms.mk and ins_ldap.mk<BR>> <BR>> Then /var/log/messages gave:<BR>> OCFS2: ERROR (device ....): ocfs2_extend_file: Dinode # ...... has<BR>> bad signature O' # I ....<BR>> And the installation failed & CRS died. And the machines reboot.<BR>> I ran fsck.ocfs2 -n /dev/...., it came clean.<BR>> I have tested this several timnes & always same thing happening.<BR>> If I use RAW partitions, everything works fine. So, the problem may<BR>> be in the OCFS2 & OS/Oracle -- but, not sure how to bypass this.<BR>> I have to have OCFS2 -- can't use RAW for various reasons.<BR>> Can somebody please help me to resolve this?<BR>> Thanks.<BR>>
***********************************************************************************************************<BR>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<BR>> Be a better pen pal. Text or chat with friends inside Yahoo! Mail.<BR>> See how._______________________________________________<BR>> Ocfs2-users mailing list<BR>> Ocfs2-users@oss.oracle.com<BR>> http://oss.oracle.com/mailman/listinfo/ocfs2-users<BR>> <BR>> <BR>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<BR>> Be a better pen pal. Text or chat with friends inside Yahoo! Mail. See<BR>> how.<BR>> <BR>> <BR>>
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<BR>> Never miss a thing. Make Yahoo your homepage.<BR>> <BR>> <BR>> <BR>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<BR>> Get easy, one-click access to your favorites. Make Yahoo! your homepage.<BR><BR>> _______________________________________________<BR>> Ocfs2-users mailing list<BR>> Ocfs2-users@oss.oracle.com<BR>> http://oss.oracle.com/mailman/listinfo/ocfs2-users<BR>--<BR>Mark Fasheh<BR>Senior Software Developer,
Oracle<BR>mark.fasheh@oracle.com<BR></ANJAN.CHAKRABORTY@YAHOO.COM></LFREITAS34@YAHOO.COM></ANJAN.CHAKRABORTY@YAHOO.COM></BLOCKQUOTE><BR> <DIV></DIV> <HR SIZE=1> Get easy, one-click access to your favorites. <A href="http://us.rd.yahoo.com/evt=51443/*http://www.yahoo.com/r/hs">Make Yahoo! your homepage.</A> </BLOCKQUOTE><BR> <DIV></DIV> <HR SIZE=1> Be a better pen pal. Text or chat with friends inside Yahoo! Mail. <A href="http://us.rd.yahoo.com/evt=51732/*http://overview.mail.yahoo.com/">See how.</A></BLOCKQUOTE><BR> <DIV></DIV> <HR SIZE=1> Be a better sports nut! Let your teams follow you with Yahoo Mobile. <A href="http://us.rd.yahoo.com/evt=51731/*http://mobile.yahoo.com/sports;_ylt=At9_qDKvtAbMuh1G1SQtBI7ntAcJ">Try it now.</A></BLOCKQUOTE><BR> <div> <HR SIZE=1> Never miss a thing. <A href="http://us.rd.yahoo.com/evt=51438/*http://www.yahoo.com/r/hs">Make Yahoo your homepage.</A> _______________________________________________<BR>Ocfs2-users mailing
list<BR>Ocfs2-users@oss.oracle.com<BR>http://oss.oracle.com/mailman/listinfo/ocfs2-users</BLOCKQUOTE><BR><p> 
<hr size=1>Be a better sports nut! Let your teams follow you
with Yahoo Mobile. <a href="http://us.rd.yahoo.com/evt=51731/*http://mobile.yahoo.com/sports;_ylt=At9_qDKvtAbMuh1G1SQtBI7ntAcJ
">Try it now.</a>