<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style>
<!--
@font-face
{font-family:宋体}
@font-face
{font-family:宋体}
@font-face
{font-family:Calibri}
@font-face
{font-family:"\@宋体"}
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:宋体}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline}
span.size
{}
span.colour
{}
span.font
{}
span.EmailStyle20
{font-family:"Calibri","sans-serif";
color:#1F497D}
.MsoChpDefault
{font-size:10.0pt}
@page WordSection1
{margin:72.0pt 90.0pt 72.0pt 90.0pt}
div.WordSection1
{}
-->
</style>
</head>
<body lang="ZH-CN" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D">Hi,
</span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D"> </span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D">The number of the node should begin with 1 in the cluster.conf, you can try it.
</span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D">I always start with 1.
</span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D"> </span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D">You should check the directory: ls -al /sys/kernel/config/cluster/pool/node ; and all the three node should have same node directory information
on three nodes. </span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D"> </span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D">Otherwise, umount all the fs, copy one /etc/ocfs2/cluster.conf to other two node.
</span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D">service o2cb offline/unload ; service o2cb online ;</span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D">Remount the disk again and check the nodes info again.
</span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D"> </span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D">The cluter.conf file should be same on everyone node.
</span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt; font-family:"Calibri","sans-serif"; color:#1F497D"> </span></p>
<div>
<div style="border:none; border-top:solid #B5C4DF 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:10.0pt">发件人<span lang="EN-US">:</span></span></b><span lang="EN-US" style="font-size:10.0pt"> ocfs2-users-bounces@oss.oracle.com [mailto:ocfs2-users-bounces@oss.oracle.com]
</span><b><span style="font-size:10.0pt">代表 </span></b><span lang="EN-US" style="font-size:10.0pt">gjprabu<br>
</span><b><span style="font-size:10.0pt">发送时间<span lang="EN-US">:</span></span></b><span lang="EN-US" style="font-size:10.0pt"> 2015</span><span style="font-size:10.0pt">年<span lang="EN-US">7</span>月<span lang="EN-US">30</span>日<span lang="EN-US"> 17:57<br>
</span><b>收件人<span lang="EN-US">:</span></b><span lang="EN-US"> ocfs2-users@oss.oracle.com<br>
</span><b>主题<span lang="EN-US">:</span></b><span lang="EN-US"> [Ocfs2-users] ceph osd mounting issue with ocfs2 file system</span></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">Hi All,</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><span class="size"><span lang="EN-US" style="font-size:10.0pt"> We are using ceph with two OSD and three clients. Clients try to mount with OCFS2 file system. Here when i start mounting only two clients i can able to mount properly and
third client giving below errors. Some time i can able to mount third client but data not sync to third client.</span></span><span lang="EN-US" style="font-size:10.0pt"></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt">mount /dev/rbd/rbd/integdownloads /soho/build/downloads</span></b><span lang="EN-US" style="font-size:10.0pt"></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">mount.ocfs2: Invalid argument while mounting /dev/rbd0 on /soho/build/downloads. Check 'dmesg' for more information on this error.</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><b><u><span lang="EN-US" style="font-size:10.0pt">dmesg</span></u></b><span lang="EN-US" style="font-size:10.0pt"></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">[1280548.676688] (mount.ocfs2,1807,4):dlm_send_nodeinfo:1294 ERROR: node mismatch -22, node 0</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">[1280548.676766] (mount.ocfs2,1807,4):dlm_try_to_join_domain:1681 ERROR: status = -22</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">[1280548.677278] (mount.ocfs2,1807,8):dlm_join_domain:1950 ERROR: status = -22</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">[1280548.677443] (mount.ocfs2,1807,8):dlm_register_domain:2210 ERROR: status = -22</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">[1280548.677541] (mount.ocfs2,1807,8):o2cb_cluster_connect:368 ERROR: status = -22</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">[1280548.677602] (mount.ocfs2,1807,8):ocfs2_dlm_init:2988 ERROR: status = -22</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">[1280548.677703] (mount.ocfs2,1807,8):ocfs2_mount_volume:1864 ERROR: status = -22</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">[1280548.677800] ocfs2: Unmounting device (252,0) on (node 0)</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">[1280548.677808] (mount.ocfs2,1807,8):ocfs2_fill_super:1238 ERROR: status = -22</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><b><u><span lang="EN-US" style="font-size:10.0pt">OCFS2 configuration</span></u></b><span lang="EN-US" style="font-size:10.0pt"></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">cluster:</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> node_count=3</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> heartbeat_mode = local</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> name=ocfs2</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">node:</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> ip_port = 7777</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> ip_address = 192.168.112.192</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> number = 0</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> name = integ-hm5</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> cluster = ocfs2</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">node:</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> ip_port = 7777</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> ip_address = 192.168.113.42</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> number = 1</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> name = integ-soho</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> cluster = ocfs2</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">node:</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> ip_port = 7778</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> ip_address = 192.168.112.115</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> number = 2</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> name = integ-hm2</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> cluster = ocfs2</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt">Version :- </span>
</b><span lang="EN-US" style="font-size:10.0pt">o2cb 1.8.0</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt">OS : -</span></b><span lang="EN-US" style="font-size:10.0pt"> Centos 7 64 bit (Kernel 3.18.16)</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
<div id="">
<div>
<p class="MsoNormal"><span class="colour"><span lang="EN-US" style="font-size:10.0pt; color:black">Regards</span></span><span lang="EN-US" style="font-size:10.0pt"></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">Prabu GJ</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt; color:red"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt"> </span></p>
</div>
</div>
</div>
<span style="font-size:7.5pt; font-family:华文细黑; color:gray"><span lang="EN-US">-------------------------------------------------------------------------------------------------------------------------------------<br>
</span>本邮件及其附件含有杭州华三通信技术有限公司的保密信息，仅限于发送给上面地址中列出<span lang="EN-US"><br>
</span>的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、<span lang="EN-US"><br>
</span>或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本<span lang="EN-US"><br>
</span>邮件！<span lang="EN-US"><br>
</span></span><span lang="EN-US" style="font-size:7.5pt; font-family:"Arial","sans-serif"; color:gray">This e-mail and its attachments contain confidential information from H3C, which is
<br>
intended only for the person or entity whose address is listed above. Any use of the
<br>
information contained herein in any way (including, but not limited to, total or partial
<br>
disclosure, reproduction, or dissemination) by persons other than the intended <br>
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender
<br>
by phone or email immediately and delete it!</span>
</body>
</html>