Anjan,<br><br> Yes, it should be like that. <br><br> Also see if you can follow Mark suggestion as he knows this stuff better than me. You could get a iSCSI server running with a third machine and openfiler and test to see if you get the same results. (Btw I never installed openfiler, last time I installed a test system like this I used NFS :-P, neither are supported of course)<br><br>Regards,<br>Luis<br><br><b><i>Anjan Chakraborty <anjan.chakraborty@yahoo.com></i></b> wrote:<blockquote class="replbq" style="border-left: 2px solid rgb(16, 16, 255); margin-left: 5px; padding-left: 5px;"> <div>Luis,</div> <div>Let me understanfd your suggestion. Are you suggesting:</div> <div>$ORA_CRS_HOME -- without datavolume,nointr</div> <div>$ORACLE_HOME -- without datavolume,nointr</div> <div>But place OCR, Voting Disks & future datafiles with datavolume,nointr</div> <div> </div> <div>Did I understand correctly?</div> <div>I have
also gone back to OCFS2 1.2.5-6.</div> <div>Okay, if this is the suggestion -- I will surely try.</div> <div>Thanks.</div> <div>Anjan<br><br><b><i>Luis Freitas <lfreitas34@yahoo.com></i></b> wrote:</div> <blockquote class="replbq" style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;"><br> <blockquote class="replbq" style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;"><OCFS2-USER@OSS.ORACLE.COM><OCFS2-USER@OSS.ORACLE.COM>Anjan,<br><br> The two installs I did with x86_64 were with ASM, with kernel versions that today are very old, some years ago. Here I am using x86 (even as the hardware is x86_64 capable) due to a managment decision not to go to x86_64. <br><br> Anyone else on the list?<br><br> About the mount points, the CRS home is a ORACLE_HOME, so you shouldnt mount it with datavolume. If you want to keep the CRS ORACLE_HOME and
the RDBMS ORACLE_HOME each on one filesystem you should have at least a third partition for the cluster registry, voting disks and datafiles, mounted with the datavolume option, and mount those two without it. <br><br> If you need to get this working fast, I think you should try a older OCFS2 module version. If not keep working with Mark and the other Oracle people here on the list as they can diagnose these errors and get it fixed.<br><br> What is the firewire disk you are using?<br><br>Regards,<br>Luis<br><br><br><b><i>Anjan Chakraborty <anjan.chakraborty@yahoo.com></i></b> wrote:</OCFS2-USER@OSS.ORACLE.COM></OCFS2-USER@OSS.ORACLE.COM> <blockquote class="replbq" style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;"><br><br><b><i>Luis Freitas <lfreitas34@yahoo.com></i></b> wrote: <blockquote class="replbq" style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left:
5px;">Luis,<br>As far as I know, it's not recommended to mount ORACLE_HOME with datavolume,nointr but that's not the case with CRS. So, I have different mount options for ORA_CRS_HOME (home/oracle/ocrvotcrs) & ORACLE_HOME (home/oracle/orasys). If I am wrong, please correct me. Also, I don't have any datafile yet because I don't have the basic thing -- Oracle binary under ORACLE_HOME. Once I have that, I will have datafiles & mount will contain datavolume,nointr.<br>Do you know anybody has successfully implemented OCFS2 1.2.7-1 on Red Hat4.5 (kernel 2.6.9-55.EL) under 86_64 architecture? <br>What exactly you have?<br>Thanks for your continuous effort to help me.<br>I hope somebody else will also start joining this discussion & help me.<br>I am really stuck -- can't advance at all -- need help desperately.<br>Anjan<br><br><br>Anjan,<br><br> Well it is only a sugestion.<br><br> About those mount options, perhaps the Oracle people can give
you a feedback on that also. But I noticed that you have two mount points, and seems to be installing CRS binaries on one, and RDBMS binaries on the other. So, where are datafiles? <br><br> You shouldnt be installing the CRS home on /home/oracle/ocrvotcrs as it has the datavolume option. It is not clear if you are trying this.<br><br> The filesystems where you have binaries should not have the datavolume option, and the filesystems with datafiles, voting disks and the cluster registry need to have the datavolume option.<br><br>Regards,<br>Luis<br><br><b><i>Anjan Chakraborty <anjan.chakraborty@yahoo.com></i></b> wrote: <blockquote class="replbq" style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;"> <div>Mark,</div> <div>Thanks to both of you for trying to help me.</div> <div>I have alreaddy communicated to Luis that I have to have OCFS2 because my software needs Clustering technology that is
absent in EXT3. Moreover, both CRS & RDBMS homes should also be on shared/clustered system -- so, OCFS2 is the only choice.</div> <div>If you can help me to understand/resolve this issue, I will really appreciate that.</div> <div>Please note that my FireWire shared drive works perfectly when I use RAW but as soon as I am trying to use OCFS2, all the problems started.</div> <div>Thanks.</div> <div>Anjan <br><br><b><i>Mark Fasheh <mark.fasheh@oracle.com></i></b> wrote:</div> <blockquote class="replbq" style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;">Luis,<br>Thanks for helping here. I have one comment regarding moving the<br>shared home to ext3. If Anjan's setup is having issues like this, moving his<br>oracle home to a local disk would only hide problems which take longer to<br>reproduce for the crs and data files partitions. What needs to happen is<br>that the root cause of his problems is discovered and
fixed.<br><br>Keep in mind, I'm not saying someone couldn't use ext3 for their oracle<br>install - it's an excellent choice for running a non-shared oracle home.<br>It's just not a good shared disk diagnostic tool ;)<br><br>Once again, thanks for stepping up and lending a hand.<br>--Mark<br><br>On Tue, Nov 27, 2007 at 08:50:28AM -0800, Luis Freitas wrote:<br>> Anjan,<br>> <br>> You dont need to share the database binaries, only the CRS and the<br>> datafiles. You can do it to save disk space, but it is not mandatory. The CRS<br>> and datafiles are much less stressfull to the filesystem structures as there is<br>> a reduced number of large files, although they usually have a heavy i/o load,<br>> and stress the disk subsystem and the locking algorithms.<br>> <br>> So you can have two separated ext3 filesystems located at the same place on<br>> each server, and one or more ocfs2 shared filesystems for the CRS and the<br>> database datafiles.
The Oracle installer takes care of copying the binaries<br>> between the servers during the installation.<br>> <br>> It might be usefull to try a lower version like 1.2.6, as you are using the<br>> latest version available. I am using 1.2.4-2 here with RH 4.0 and kernel<br>> 2.6.9-42 and it seems rather stable, only needed to increase the timeouts. (But<br>> I dont have the oracle_home shared.)<br>> <br>> Also you might have a hardware problem somewhere on the SAN. And I still<br>> have to check those mount options you sent...<br>> <br>> One detail. I dont know if the Centos distro includes the OCFS2 module. Are<br>> you using the modules downloaded from the oss.oracle.com site for the<br>> equivalent RH 4.0 kernel, or modules built by Centos? If using CENTOS modules<br>> you might get better results by changing to the Oracle built modules for the<br>> equivalent RH 4.0 kernel.<br>> <br>> Regards,<br>> Luis<br>>
<br>> Anjan Chakraborty <ANJAN.CHAKRABORTY@YAHOO.COM>wrote:<br>> <br>> Luis,<br>> I am intending to use CRS/RAC that needs a Cluster File System. How does<br>> EXT3 falls into that area?<br>> Thanks.<br>> Anjan<br>> <br>> Thanks a lot for the response. Here is what I am doing:<br>> <br>> 1.<br>> mkfs.ocfs2 -b 4K -C 32K -N 4 -L ocrvotcrs /dev/sdb3 -- for CRS<br>> mkfs.ocfs2 -b 4K -C 32K -N 4 -L orasys /dev/sdb4 -- for RDBMS<br>> <br>> 2. Then mounting using /etc/fstab:<br>> /dev/sdb3 /home/oracle/ocrvotcrs ocfs2 _netdev,datavolume,nointr<br>> 0 0<br>> /dev/sdb4 /home/oracle/orasys ocfs2 _netdev 0 0<br>> If you find anything wrong here, can you please tell what to do?<br>> It's a non-production system & so I can experiment with whatever you<br>> suggest and won't held you responsible for that.<br>> Thanks.<br>> Anjan<br>> <br>> <br>> Luis Freitas <LFREITAS34@YAHOO.COM>wrote:<br>> <br>>
Anjan,<br>> <br>> Are you installing the binaries on OCSF2 too? How are you mounting<br>> the filesystem?<br>> <br>> You might want to try using ext3 for the binaries and OCF2 only for<br>> datafiles and archives, until you get this fixed.<br>> <br>> Regards,<br>> Luis<br>> <br>> Anjan Chakraborty <ANJAN.CHAKRABORTY@YAHOO.COM>wrote:<br>> <br>> Hi,<br>> I sent an email to Mark Fisheh of Oracle Corp. & posted this issue<br>> at OTN under Linux thread this morning. I hope that someone among<br>> you might have experienced this and can help. On that basis, I am<br>> sending this to you too. I am stuck & will really appreciate if you<br>> can shed some light on this.<br>> Thanks.<br>> Anjan<br>> ***********************************************************************************************************<br>> I have a 2 node CentOS 4.5 86_64 system (kernel 2.6.9-55.EL). On<br>> this I installed Oracle
OCFS2 1.2.7-1 (with exact kernel matching).<br>> After this I installed Oracle CRS 10.2.0.1 and that installation<br>> went fine. Then I tried to install Oracle RDBMS 10.2.0.1 and all<br>> the problems started from there. The /var/log/messages file got<br>> filled up with messages (giving some to avoid confusion):<br>> ocfs2_read_locked_inode: .. : ERROR: Invalid dinode #0 signature =<br>> ocfs2_lookup: .. : ERROR: Unable to create inode ....<br>> <br>> Then OUI gave several error messages, e.g.<br>> .... Invalid stored block length on file ...../em/em.war followed<br>> by I/O error in file<br>> Errors in invoking to files ins_rdbms.mk and ins_ldap.mk<br>> <br>> Then /var/log/messages gave:<br>> OCFS2: ERROR (device ....): ocfs2_extend_file: Dinode # ...... has<br>> bad signature O' # I ....<br>> And the installation failed & CRS died. And the machines reboot.<br>> I ran fsck.ocfs2 -n /dev/...., it came clean.<br>>
I have tested this several timnes & always same thing happening.<br>> If I use RAW partitions, everything works fine. So, the problem may<br>> be in the OCFS2 & OS/Oracle -- but, not sure how to bypass this.<br>> I have to have OCFS2 -- can't use RAW for various reasons.<br>> Can somebody please help me to resolve this?<br>> Thanks.<br>> ***********************************************************************************************************<br>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<br>> Be a better pen pal. Text or chat with friends inside Yahoo! Mail.<br>> See how._______________________________________________<br>> Ocfs2-users mailing list<br>> Ocfs2-users@oss.oracle.com<br>> http://oss.oracle.com/mailman/listinfo/ocfs2-users<br>> <br>> <br>>
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<br>> Be a better pen pal. Text or chat with friends inside Yahoo! Mail. See<br>> how.<br>> <br>> <br>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<br>> Never miss a thing. Make Yahoo your homepage.<br>> <br>> <br>> <br>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<br>> Get easy, one-click access to your favorites. Make Yahoo! your homepage.<br><br>>
_______________________________________________<br>> Ocfs2-users mailing list<br>> Ocfs2-users@oss.oracle.com<br>> http://oss.oracle.com/mailman/listinfo/ocfs2-users<br>--<br>Mark Fasheh<br>Senior Software Developer, Oracle<br>mark.fasheh@oracle.com<br></ANJAN.CHAKRABORTY@YAHOO.COM></LFREITAS34@YAHOO.COM></ANJAN.CHAKRABORTY@YAHOO.COM></blockquote><br> <div></div> <hr size="1"> Get easy, one-click access to your favorites. <a href="http://us.rd.yahoo.com/evt=51443/*http://www.yahoo.com/r/hs">Make Yahoo! your homepage.</a> </blockquote><br> <div></div> <hr size="1"> Be a better pen pal. Text or chat with friends inside Yahoo! Mail. <a href="http://us.rd.yahoo.com/evt=51732/*http://overview.mail.yahoo.com/">See how.</a></blockquote><br> <div></div> <hr size="1"> Be a better sports nut! Let your teams follow you with Yahoo Mobile. <a href="http://us.rd.yahoo.com/evt=51731/*http://mobile.yahoo.com/sports;_ylt=At9_qDKvtAbMuh1G1SQtBI7ntAcJ">Try it
now.</a></blockquote><br> <div></div> <hr size="1"> Never miss a thing. <a href="http://us.rd.yahoo.com/evt=51438/*http://www.yahoo.com/r/hs">Make Yahoo your homepage.</a> </blockquote><br> <div> <hr size="1"> Be a better pen pal. Text or chat with friends inside Yahoo! Mail. <a href="http://us.rd.yahoo.com/evt=51732/*http://overview.mail.yahoo.com/">See how.</a>Anjan,<br><br> The two installs I did with x86_64 were with ASM, with kernel versions that today are very old, some years ago. Here I am using x86 (even as the hardware is x86_64 capable) due to a managment decision not to go to x86_64. <br><br> Anyone else on the list?<br><br> About the mount points, the CRS home is a ORACLE_HOME, so you shouldnt mount it with datavolume. If you want to keep the CRS ORACLE_HOME and the RDBMS ORACLE_HOME each on one filesystem you should have at least a third partition for the cluster registry, voting disks
and datafiles, mounted with the datavolume option, and mount those two without it. <br><br> If you need to get this working fast, I think you should try a older OCFS2 module version. If not keep working with Mark and the other Oracle people here on the list as they can diagnose these errors and get it fixed.<br><br> What is the firewire disk you are using?<br><br>Regards,<br>Luis<br><br><br><b><i>Anjan Chakraborty <anjan.chakraborty@yahoo.com></i></b> wrote: <blockquote class="replbq" style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;"><br><br><b><i>Luis Freitas <lfreitas34@yahoo.com></i></b> wrote: <blockquote class="replbq" style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;">Luis,<br>As far as I know, it's not recommended to mount ORACLE_HOME with datavolume,nointr but that's not the case with CRS. So, I have different mount options for ORA_CRS_HOME
(home/oracle/ocrvotcrs) & ORACLE_HOME (home/oracle/orasys). If I am wrong, please correct me. Also, I don't have any datafile yet because I don't have the basic thing -- Oracle binary under ORACLE_HOME. Once I have that, I will have datafiles & mount will contain datavolume,nointr.<br>Do you know anybody has successfully implemented OCFS2 1.2.7-1 on Red Hat4.5 (kernel 2.6.9-55.EL) under 86_64 architecture? <br>What exactly you have?<br>Thanks for your continuous effort to help me.<br>I hope somebody else will also start joining this discussion & help me.<br>I am really stuck -- can't advance at all -- need help desperately.<br>Anjan<br><br><br>Anjan,<br><br> Well it is only a sugestion.<br><br> About those mount options, perhaps the Oracle people can give you a feedback on that also. But I noticed that you have two mount points, and seems to be installing CRS binaries on one, and RDBMS binaries on the other. So, where are datafiles?
<br><br> You shouldnt be installing the CRS home on /home/oracle/ocrvotcrs as it has the datavolume option. It is not clear if you are trying this.<br><br> The filesystems where you have binaries should not have the datavolume option, and the filesystems with datafiles, voting disks and the cluster registry need to have the datavolume option.<br><br>Regards,<br>Luis<br><br><b><i>Anjan Chakraborty <anjan.chakraborty@yahoo.com></i></b> wrote: <blockquote class="replbq" style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;"> <div>Mark,</div> <div>Thanks to both of you for trying to help me.</div> <div>I have alreaddy communicated to Luis that I have to have OCFS2 because my software needs Clustering technology that is absent in EXT3. Moreover, both CRS & RDBMS homes should also be on shared/clustered system -- so, OCFS2 is the only choice.</div> <div>If you can help me
to understand/resolve this issue, I will really appreciate that.</div> <div>Please note that my FireWire shared drive works perfectly when I use RAW but as soon as I am trying to use OCFS2, all the problems started.</div> <div>Thanks.</div> <div>Anjan <br><br><b><i>Mark Fasheh <mark.fasheh@oracle.com></i></b> wrote:</div> <blockquote class="replbq" style="border-left: 2px solid rgb(16, 16, 255); padding-left: 5px; margin-left: 5px;">Luis,<br>Thanks for helping here. I have one comment regarding moving the<br>shared home to ext3. If Anjan's setup is having issues like this, moving his<br>oracle home to a local disk would only hide problems which take longer to<br>reproduce for the crs and data files partitions. What needs to happen is<br>that the root cause of his problems is discovered and fixed.<br><br>Keep in mind, I'm not saying someone couldn't use ext3 for their oracle<br>install - it's an excellent choice for running a non-shared oracle
home.<br>It's just not a good shared disk diagnostic tool ;)<br><br>Once again, thanks for stepping up and lending a hand.<br>--Mark<br><br>On Tue, Nov 27, 2007 at 08:50:28AM -0800, Luis Freitas wrote:<br>> Anjan,<br>> <br>> You dont need to share the database binaries, only the CRS and the<br>> datafiles. You can do it to save disk space, but it is not mandatory. The CRS<br>> and datafiles are much less stressfull to the filesystem structures as there is<br>> a reduced number of large files, although they usually have a heavy i/o load,<br>> and stress the disk subsystem and the locking algorithms.<br>> <br>> So you can have two separated ext3 filesystems located at the same place on<br>> each server, and one or more ocfs2 shared filesystems for the CRS and the<br>> database datafiles. The Oracle installer takes care of copying the binaries<br>> between the servers during the installation.<br>> <br>> It might be usefull to try a
lower version like 1.2.6, as you are using the<br>> latest version available. I am using 1.2.4-2 here with RH 4.0 and kernel<br>> 2.6.9-42 and it seems rather stable, only needed to increase the timeouts. (But<br>> I dont have the oracle_home shared.)<br>> <br>> Also you might have a hardware problem somewhere on the SAN. And I still<br>> have to check those mount options you sent...<br>> <br>> One detail. I dont know if the Centos distro includes the OCFS2 module. Are<br>> you using the modules downloaded from the oss.oracle.com site for the<br>> equivalent RH 4.0 kernel, or modules built by Centos? If using CENTOS modules<br>> you might get better results by changing to the Oracle built modules for the<br>> equivalent RH 4.0 kernel.<br>> <br>> Regards,<br>> Luis<br>> <br>> Anjan Chakraborty <ANJAN.CHAKRABORTY@YAHOO.COM>wrote:<br>> <br>> Luis,<br>> I am intending to use CRS/RAC that needs a Cluster File System.
How does<br>> EXT3 falls into that area?<br>> Thanks.<br>> Anjan<br>> <br>> Thanks a lot for the response. Here is what I am doing:<br>> <br>> 1.<br>> mkfs.ocfs2 -b 4K -C 32K -N 4 -L ocrvotcrs /dev/sdb3 -- for CRS<br>> mkfs.ocfs2 -b 4K -C 32K -N 4 -L orasys /dev/sdb4 -- for RDBMS<br>> <br>> 2. Then mounting using /etc/fstab:<br>> /dev/sdb3 /home/oracle/ocrvotcrs ocfs2 _netdev,datavolume,nointr<br>> 0 0<br>> /dev/sdb4 /home/oracle/orasys ocfs2 _netdev 0 0<br>> If you find anything wrong here, can you please tell what to do?<br>> It's a non-production system & so I can experiment with whatever you<br>> suggest and won't held you responsible for that.<br>> Thanks.<br>> Anjan<br>> <br>> <br>> Luis Freitas <LFREITAS34@YAHOO.COM>wrote:<br>> <br>> Anjan,<br>> <br>> Are you installing the binaries on OCSF2 too? How are you mounting<br>> the filesystem?<br>> <br>> You might want to try using
ext3 for the binaries and OCF2 only for<br>> datafiles and archives, until you get this fixed.<br>> <br>> Regards,<br>> Luis<br>> <br>> Anjan Chakraborty <ANJAN.CHAKRABORTY@YAHOO.COM>wrote:<br>> <br>> Hi,<br>> I sent an email to Mark Fisheh of Oracle Corp. & posted this issue<br>> at OTN under Linux thread this morning. I hope that someone among<br>> you might have experienced this and can help. On that basis, I am<br>> sending this to you too. I am stuck & will really appreciate if you<br>> can shed some light on this.<br>> Thanks.<br>> Anjan<br>> ***********************************************************************************************************<br>> I have a 2 node CentOS 4.5 86_64 system (kernel 2.6.9-55.EL). On<br>> this I installed Oracle OCFS2 1.2.7-1 (with exact kernel matching).<br>> After this I installed Oracle CRS 10.2.0.1 and that installation<br>> went fine. Then I tried to install
Oracle RDBMS 10.2.0.1 and all<br>> the problems started from there. The /var/log/messages file got<br>> filled up with messages (giving some to avoid confusion):<br>> ocfs2_read_locked_inode: .. : ERROR: Invalid dinode #0 signature =<br>> ocfs2_lookup: .. : ERROR: Unable to create inode ....<br>> <br>> Then OUI gave several error messages, e.g.<br>> .... Invalid stored block length on file ...../em/em.war followed<br>> by I/O error in file<br>> Errors in invoking to files ins_rdbms.mk and ins_ldap.mk<br>> <br>> Then /var/log/messages gave:<br>> OCFS2: ERROR (device ....): ocfs2_extend_file: Dinode # ...... has<br>> bad signature O' # I ....<br>> And the installation failed & CRS died. And the machines reboot.<br>> I ran fsck.ocfs2 -n /dev/...., it came clean.<br>> I have tested this several timnes & always same thing happening.<br>> If I use RAW partitions, everything works fine. So, the problem may<br>> be in
the OCFS2 & OS/Oracle -- but, not sure how to bypass this.<br>> I have to have OCFS2 -- can't use RAW for various reasons.<br>> Can somebody please help me to resolve this?<br>> Thanks.<br>> ***********************************************************************************************************<br>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<br>> Be a better pen pal. Text or chat with friends inside Yahoo! Mail.<br>> See how._______________________________________________<br>> Ocfs2-users mailing list<br>> Ocfs2-users@oss.oracle.com<br>> http://oss.oracle.com/mailman/listinfo/ocfs2-users<br>> <br>> <br>>
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<br>> Be a better pen pal. Text or chat with friends inside Yahoo! Mail. See<br>> how.<br>> <br>> <br>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<br>> Never miss a thing. Make Yahoo your homepage.<br>> <br>> <br>> <br>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━<br>> Get easy, one-click access to your favorites. Make Yahoo! your homepage.<br><br>>
_______________________________________________<br>> Ocfs2-users mailing list<br>> Ocfs2-users@oss.oracle.com<br>> http://oss.oracle.com/mailman/listinfo/ocfs2-users<br>--<br>Mark Fasheh<br>Senior Software Developer, Oracle<br>mark.fasheh@oracle.com<br></ANJAN.CHAKRABORTY@YAHOO.COM></LFREITAS34@YAHOO.COM></ANJAN.CHAKRABORTY@YAHOO.COM></blockquote><br> <div></div> <hr size="1"> Get easy, one-click access to your favorites. <a href="http://us.rd.yahoo.com/evt=51443/*http://www.yahoo.com/r/hs">Make Yahoo! your homepage.</a> </blockquote><br> <div></div> <hr size="1"> Be a better pen pal. Text or chat with friends inside Yahoo! Mail. <a href="http://us.rd.yahoo.com/evt=51732/*http://overview.mail.yahoo.com/">See how.</a></blockquote><br> <div></div> <hr size="1"> Be a better sports nut! Let your teams follow you with Yahoo Mobile. <a href="http://us.rd.yahoo.com/evt=51731/*http://mobile.yahoo.com/sports;_ylt=At9_qDKvtAbMuh1G1SQtBI7ntAcJ">Try it
now.</a></blockquote><br> <div> <hr size="1"> Never miss a thing. <a href="http://us.rd.yahoo.com/evt=51438/*http://www.yahoo.com/r/hs">Make Yahoo your homepage.</a> _______________________________________________<br>Ocfs2-users mailing list<br>Ocfs2-users@oss.oracle.com<br>http://oss.oracle.com/mailman/listinfo/ocfs2-users</div></div></blockquote><br><div> </div><hr size="1">Be a better sports nut! Let your teams follow you with Yahoo Mobile. <a href="http://us.rd.yahoo.com/evt=51731/*http://mobile.yahoo.com/sports;_ylt=At9_qDKvtAbMuh1G1SQtBI7ntAcJ">Try it now.</a></blockquote><br><p> 
<hr size=1>Never miss a thing. <a href="http://us.rd.yahoo.com/evt=51438/*http://www.yahoo.com/r/hs"> Make Yahoo your homepage.</a>