Try if are a problem of try rsync or a copy try cp and see if the size are difernt.<br><br>try too rsyncd in the server or rsynd in the other side. "do you has similar results?"<br><br>make a fsck of ocfs2 system for discard errors<br>
<br><br><div class="gmail_quote">On Tue, Apr 3, 2012 at 8:37 PM, Dirk Bonenkamp - ProActive <span dir="ltr"><<a href="mailto:dirk@proactive.nl">dirk@proactive.nl</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
Hi,<br>
<br>
I've did the --stats thing:<br>
<br>
Number of files: 1495981<br>
Number of files transferred: 2944<br>
Total file size: 201701039047 bytes<br>
Total transferred file size: <a href="tel:613318155" value="+34613318155" target="_blank">613318155</a> bytes<br>
Literal data: <a href="tel:613292255" value="+34613292255" target="_blank">613292255</a> bytes<br>
Matched data: 25900 bytes<br>
File list size: 24705311<br>
File list generation time: 0.001 seconds<br>
File list transfer time: 0.000 seconds<br>
Total bytes sent: 118692<br>
Total bytes received: <a href="tel:638195567" value="+34638195567" target="_blank">638195567</a><br>
<br>
sent 118692 bytes received <a href="tel:638195567" value="+34638195567" target="_blank">638195567</a> bytes 154163.57 bytes/sec<br>
total size is 201701039047 speedup is 315.99<br>
<br>
This took a staggering 69 minutes, over a Gb connection, useing
rsync direcly (no ssh overhead)<br>
<br>
To compare this, this is a similar backup, only this is an ext3
filesystem over a 100 Mbit connection, using an ssh shell:<br>
<br>
Number of files: 6486854<br>
Number of files transferred: 0<br>
Total file size: 506568034168 bytes<br>
Total transferred file size: 0 bytes<br>
Literal data: 0 bytes<br>
Matched data: 0 bytes<br>
File list size: 153625912<br>
File list generation time: 0.001 seconds<br>
File list transfer time: 0.000 seconds<br>
Total bytes sent: 335<br>
Total bytes received: 153627330<br>
<br>
sent 335 bytes received 153627330 bytes 419175.08 bytes/sec<br>
total size is 506568034168 speedup is 3297.38<br>
Total backup took 368 seconds.<br>
Rsync took 368 seconds.<br>
<br>
(I left the -q switch in this the first time... oeps, so this is the
second run. It took 1315 seconds (21 minutes) the first time,
transferring about 10.000 files).<br>
<br>
Any ideas?<br>
<br>
Kind regards,<br>
<br>
Dirk<br>
<br>
<br>
Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
<div><div class="h5"><blockquote type="cite">For backup I use a local copy using tar, but I use
rsync too.<br>
<br>
I don't compare but if you send any stadistics about rsync we can
said more information.<br>
<br>
use rsync <b><b>--stats<br>
<br>
I don't note difernt speed, but did you make a full rsync, and
show --progress for see that file it is going at what speed?<br>
<br>
regards<br>
</b></b><br>
<br>
<div class="gmail_quote">On Mon, Apr 2, 2012 at 9:04 PM, Dirk
Bonenkamp - ProActive <span dir="ltr"><<a href="mailto:dirk@proactive.nl" target="_blank">dirk@proactive.nl</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi All,<br>
<br>
I'm currently testing a OCFS2 set-up, and I'm having issues
with<br>
creating backups.<br>
<br>
I have a 2 node cluster, running OCFS2 on a dual primary DRBD
device.<br>
<br>
The file system is 3.7Tb of which 211 Gb is used: about 1.5
million<br>
files in 95 directories.<br>
<br>
Everything works fine, except for the backups, which are
taking way more<br>
time than on 'regular' file systems.<br>
<br>
I'm using rsync for my backups. When I rsync the file system
above, this<br>
takes more than an hour, without any modifications to the file
system.<br>
<br>
Network / disk speed is good. I can rsync a 10 Gb file from
the OCFS2<br>
filesystem to the same backup server with just under 100 Mb/s.<br>
<br>
I know there is some penalty to be expected from a clustered
file<br>
system, but this is al lot. Rsyncing an ext3 file system
double the size<br>
(in Mb's and files) of this file system takes about 600
seconds...<br>
<br>
Has anybody some advice on a backup strategy for me? Or some
tuning tips?<br>
<br>
Thanks in advance,<br>
<br>
Dirk<br>
<br>
--<br>
<<a href="http://www.proactive.nl" target="_blank">http://www.proactive.nl</a>><br>
T 023 - 5422299<br>
F 023 - 5422728<br>
<br>
<a href="http://www.proactive.nl" target="_blank">www.proactive.nl</a> <<a href="http://www.proactive.nl" target="_blank">http://www.proactive.nl</a>><br>
<br>
<br>
<br>
_______________________________________________<br>
Ocfs2-users mailing list<br>
<a href="mailto:Ocfs2-users@oss.oracle.com" target="_blank">Ocfs2-users@oss.oracle.com</a><br>
<a href="http://oss.oracle.com/mailman/listinfo/ocfs2-users" target="_blank">http://oss.oracle.com/mailman/listinfo/ocfs2-users</a><br>
</blockquote>
</div>
<br>
</blockquote>
<br>
</div></div><div><span class="HOEnZb"><font color="#888888">-- <br>
<a href="http://www.proactive.nl" target="_blank"><img alt="" src="cid:part7.00030401.04060506@proactive.nl" border="0" height="105" width="84"></a></font></span><div class="im"><br>
<table cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td width="20">T</td>
<td>023 - 5422299</td>
</tr>
<tr>
<td>F</td>
<td>023 - 5422728</td>
</tr>
<tr>
<td colspan="2"> </td>
</tr>
<tr>
<td colspan="2"><a href="http://www.proactive.nl" target="_blank">www.proactive.nl</a></td>
</tr>
</tbody>
</table>
<br>
</div></div>
</div>
</blockquote></div><br>