<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"><html><head><meta content="text/html;charset=UTF-8" http-equiv="Content-Type"></head><body ><div style='font-size:10pt;'><div>Thanks guozhonghua. Its working.<br></div><div><br></div><div id=""><div><span style="color:rgb(0, 0, 0)" class="colour">Regards</span><br></div><div>Prabu<br></div><div style="color: rgb(255, 0, 0);"><b></b><br></div><div><span style="font-size:16px" class="size"><span style="color:rgb(192, 192, 192)" class="colour"><span style="font-family:arial,helvetica,sans-serif" class="font"><span style="font-size:24px" class="size"><span style="color:rgb(0, 0, 255)" class="colour"></span></span><span></span></span></span></span><br></div></div><div><br></div><div class="zmail_extra"><div id="1"><div><br></div><div> ---- On Thu, 30 Jul 2015 16:29:18 +0530 <b>Guozhonghua <guozhonghua@h3c.com></b> wrote ----<br></div></div><div><br></div><blockquote style="border-left: 1px solid #cccccc; padding-left: 6px; margin:0 0 0 5px"><div><div><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size">Hi, </span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size"></span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size">The number of the node should begin with 1 in the cluster.conf, you can try it. </span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size">I always start with 1. </span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size"></span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size">You should check the directory: ls -al /sys/kernel/config/cluster/pool/node ; and all the three node should have same node directory information on three nodes. </span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size"></span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size">Otherwise, umount all the fs, copy one /etc/ocfs2/cluster.conf to other two node. </span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size">service o2cb offline/unload ; service o2cb online ;</span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size">Remount the disk again and check the nodes info again. </span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size"></span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size">The cluter.conf file should be same on everyone node. </span></span></span><br></p><p><span style="color:rgb(31, 73, 125)" class="colour"><span style="font-family:Calibri,sans-serif" class="font"><span style="font-size:10.5pt" class="size"></span></span></span><br></p><div><div style="border: none;border-top: solid rgb(181,196,223) 1.0pt;padding: 3.0pt 0.0cm 0.0cm 0.0cm;"><p><b><span style="font-size:10pt" class="size">发件人<span>:</span></span></b><span style="font-size:10pt" class="size"><a href="mailto:ocfs2-users-bounces@oss.oracle.com" target="_blank">ocfs2-users-bounces@oss.oracle.com</a> [mailto:<a href="mailto:ocfs2-users-bounces@oss.oracle.com" target="_blank">ocfs2-users-bounces@oss.oracle.com</a>] </span><b><span style="font-size:10pt" class="size">代表 </span></b><span style="font-size:10pt" class="size">gjprabu<br></span><b><span style="font-size:10pt" class="size">发送时间<span>:</span></span></b><span style="font-size:10pt" class="size"> 2015</span><span style="font-size:10pt" class="size">年<span>7</span>月<span>30</span>日<span> 17:57<br></span><b>收件人<span>:</span></b><span><a href="mailto:ocfs2-users@oss.oracle.com" target="_blank">ocfs2-users@oss.oracle.com</a><br></span><b>主题<span>:</span></b><span> [Ocfs2-users] ceph osd mounting issue with ocfs2 file system</span></span></p></div></div><p><span></span><br></p><div><div><p><span style="font-size:10pt" class="size">Hi All,</span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span><span style="font-size:10pt" class="size"> We are using ceph with two OSD and three clients. Clients try to mount with OCFS2 file system. Here when i start mounting only two clients i can able to mount properly and third client giving below errors. Some time i can able to mount third client but data not sync to third client.</span></span><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><b><span style="font-size:10pt" class="size">mount /dev/rbd/rbd/integdownloads /soho/build/downloads</span></b><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size">mount.ocfs2: Invalid argument while mounting /dev/rbd0 on /soho/build/downloads. Check 'dmesg' for more information on this error.</span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><b><u><span style="font-size:10pt" class="size">dmesg</span></u></b><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size">[1280548.676688] (mount.ocfs2,1807,4):dlm_send_nodeinfo:1294 ERROR: node mismatch -22, node 0</span><br></p></div><div><p><span style="font-size:10pt" class="size">[1280548.676766] (mount.ocfs2,1807,4):dlm_try_to_join_domain:1681 ERROR: status = -22</span><br></p></div><div><p><span style="font-size:10pt" class="size">[1280548.677278] (mount.ocfs2,1807,8):dlm_join_domain:1950 ERROR: status = -22</span><br></p></div><div><p><span style="font-size:10pt" class="size">[1280548.677443] (mount.ocfs2,1807,8):dlm_register_domain:2210 ERROR: status = -22</span><br></p></div><div><p><span style="font-size:10pt" class="size">[1280548.677541] (mount.ocfs2,1807,8):o2cb_cluster_connect:368 ERROR: status = -22</span><br></p></div><div><p><span style="font-size:10pt" class="size">[1280548.677602] (mount.ocfs2,1807,8):ocfs2_dlm_init:2988 ERROR: status = -22</span><br></p></div><div><p><span style="font-size:10pt" class="size">[1280548.677703] (mount.ocfs2,1807,8):ocfs2_mount_volume:1864 ERROR: status = -22</span><br></p></div><div><p><span style="font-size:10pt" class="size">[1280548.677800] ocfs2: Unmounting device (252,0) on (node 0)</span><br></p></div><div><p><span style="font-size:10pt" class="size">[1280548.677808] (mount.ocfs2,1807,8):ocfs2_fill_super:1238 ERROR: status = -22</span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><b><u><span style="font-size:10pt" class="size">OCFS2 configuration</span></u></b><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size">cluster:</span><br></p></div><div><p><span style="font-size:10pt" class="size"> node_count=3</span><br></p></div><div><p><span style="font-size:10pt" class="size"> heartbeat_mode = local</span><br></p></div><div><p><span style="font-size:10pt" class="size"> name=ocfs2</span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size">node:</span><br></p></div><div><p><span style="font-size:10pt" class="size"> ip_port = 7777</span><br></p></div><div><p><span style="font-size:10pt" class="size"> ip_address = 192.168.112.192</span><br></p></div><div><p><span style="font-size:10pt" class="size"> number = 0</span><br></p></div><div><p><span style="font-size:10pt" class="size"> name = integ-hm5</span><br></p></div><div><p><span style="font-size:10pt" class="size"> cluster = ocfs2</span><br></p></div><div><p><span style="font-size:10pt" class="size">node:</span><br></p></div><div><p><span style="font-size:10pt" class="size"> ip_port = 7777</span><br></p></div><div><p><span style="font-size:10pt" class="size"> ip_address = 192.168.113.42</span><br></p></div><div><p><span style="font-size:10pt" class="size"> number = 1</span><br></p></div><div><p><span style="font-size:10pt" class="size"> name = integ-soho</span><br></p></div><div><p><span style="font-size:10pt" class="size"> cluster = ocfs2</span><br></p></div><div><p><span style="font-size:10pt" class="size">node:</span><br></p></div><div><p><span style="font-size:10pt" class="size"> ip_port = 7778</span><br></p></div><div><p><span style="font-size:10pt" class="size"> ip_address = 192.168.112.115</span><br></p></div><div><p><span style="font-size:10pt" class="size"> number = 2</span><br></p></div><div><p><span style="font-size:10pt" class="size"> name = integ-hm2</span><br></p></div><div><p><span style="font-size:10pt" class="size"> cluster = ocfs2</span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><b><span style="font-size:10pt" class="size">Version :- </span></b><span style="font-size:10pt" class="size">o2cb 1.8.0</span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><b><span style="font-size:10pt" class="size">OS : -</span></b><span style="font-size:10pt" class="size"> Centos 7 64 bit (Kernel 3.18.16)</span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div><div><div><p><span><span style="color:black" class="colour"><span style="font-size:10pt" class="size">Regards</span></span></span><span style="font-size:10pt" class="size"></span><br></p></div><div><p><span style="font-size:10pt" class="size">Prabu GJ</span><br></p></div><div><p><span style="color:red" class="colour"><span style="font-size:10pt" class="size"></span></span><br></p></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div></div><div><p><span style="font-size:10pt" class="size"></span><br></p></div></div></div><div><span style="color:gray" class="colour"><span style="font-size:7.5pt" class="size"><span>-------------------------------------------------------------------------------------------------------------------------------------<br></span>本邮件及其附件含有杭州华三通信技术有限公司的保密信息，仅限于发送给上面地址中列出<span><br></span>的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、<span><br></span>或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本<span><br></span>邮件！<span><br></span></span></span><span style="color:gray" class="colour"><span style="font-family:Arial,sans-serif" class="font"><span style="font-size:7.5pt" class="size">This e-mail and its attachments contain confidential information from H3C, which is <br> intended only for the person or entity whose address is listed above. Any use of the <br> information contained herein in any way (including, but not limited to, total or partial <br> disclosure, reproduction, or dissemination) by persons other than the intended <br> recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender <br> by phone or email immediately and delete it!</span></span></span></div></div></blockquote></div><div><br></div></div></body></html>