Sure, I am on the same list too :).<br><br>I don't have the issue, but only make copy over rsync to a USB disk.<br><br>my recomendation mount the filesystem over NFS and try make the rsync and use cp (only copy the new) too.. (usually see the diference in time..)<br>
<br>good luck<br><br><div class="gmail_quote">On Wed, Apr 4, 2012 at 11:56 AM, Dirk Bonenkamp - ProActive <span dir="ltr"><<a href="mailto:dirk@proactive.nl">dirk@proactive.nl</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<font size="-1"><font face="Arial">Hi,<br>
<br>
The file-system is clean, a check with -f reports no issues.
Changing the direction of rsync doesn't help much either....<br>
<br>
I'll give this issue a try on the drdb mailing list, maybe there
is somebody on there with a similar set-up.<br>
<br>
Regards,<br>
<br>
Dirk<br>
</font></font><a href="http://www.proactive.nl" target="_blank"><img alt="" src="cid:part1.01090303.08070507@proactive.nl" border="0" height="105" width="84"></a><br>
<div>
<table cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td width="20"><br>
</td>
<td><br>
</td>
</tr>
<tr>
<td><br>
</td>
<td><br>
</td>
</tr>
<tr>
<td colspan="2"><br>
</td>
</tr>
<tr>
<td colspan="2"><br>
</td>
</tr>
<tr>
<td colspan="2"><br>
</td>
</tr>
<tr>
<td colspan="2"><br>
</td>
</tr>
</tbody>
</table>
<br>
</div>
Op 4-4-2012 1:14, Eduardo Diaz - Gmail schreef:
<div><div class="h5"><blockquote type="cite"> Try if are a problem of try rsync or a copy try cp
and see if the size are difernt.<br>
<br>
try too rsyncd in the server or rsynd in the other side. "do you
has similar results?"<br>
<br>
make a fsck of ocfs2 system for discard errors<br>
<br>
<br>
<div class="gmail_quote">On Tue, Apr 3, 2012 at 8:37 PM, Dirk
Bonenkamp - ProActive <span dir="ltr"><<a href="mailto:dirk@proactive.nl" target="_blank">dirk@proactive.nl</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"> Hi,<br>
<br>
I've did the --stats thing:<br>
<br>
Number of files: 1495981<br>
Number of files transferred: 2944<br>
Total file size: 201701039047 bytes<br>
Total transferred file size: <a href="tel:613318155" value="+34613318155" target="_blank">613318155</a>
bytes<br>
Literal data: <a href="tel:613292255" value="+34613292255" target="_blank">613292255</a>
bytes<br>
Matched data: 25900 bytes<br>
File list size: 24705311<br>
File list generation time: 0.001 seconds<br>
File list transfer time: 0.000 seconds<br>
Total bytes sent: 118692<br>
Total bytes received: <a href="tel:638195567" value="+34638195567" target="_blank">638195567</a><br>
<br>
sent 118692 bytes received <a href="tel:638195567" value="+34638195567" target="_blank">638195567</a>
bytes 154163.57 bytes/sec<br>
total size is 201701039047 speedup is 315.99<br>
<br>
This took a staggering 69 minutes, over a Gb connection,
useing rsync direcly (no ssh overhead)<br>
<br>
To compare this, this is a similar backup, only this is an
ext3 filesystem over a 100 Mbit connection, using an ssh
shell:<br>
<br>
Number of files: 6486854<br>
Number of files transferred: 0<br>
Total file size: 506568034168 bytes<br>
Total transferred file size: 0 bytes<br>
Literal data: 0 bytes<br>
Matched data: 0 bytes<br>
File list size: 153625912<br>
File list generation time: 0.001 seconds<br>
File list transfer time: 0.000 seconds<br>
Total bytes sent: 335<br>
Total bytes received: 153627330<br>
<br>
sent 335 bytes received 153627330 bytes 419175.08
bytes/sec<br>
total size is 506568034168 speedup is 3297.38<br>
Total backup took 368 seconds.<br>
Rsync took 368 seconds.<br>
<br>
(I left the -q switch in this the first time... oeps, so
this is the second run. It took 1315 seconds (21 minutes)
the first time, transferring about 10.000 files).<br>
<br>
Any ideas?<br>
<br>
Kind regards,<br>
<br>
Dirk<br>
<br>
<br>
Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
<div>
<div>
<blockquote type="cite">For backup I use a local copy
using tar, but I use rsync too.<br>
<br>
I don't compare but if you send any stadistics about
rsync we can said more information.<br>
<br>
use rsync <b><b>--stats<br>
<br>
I don't note difernt speed, but did you make a
full rsync, and show --progress for see that file
it is going at what speed?<br>
<br>
regards<br>
</b></b><br>
<br>
<div class="gmail_quote">On Mon, Apr 2, 2012 at 9:04
PM, Dirk Bonenkamp - ProActive <span dir="ltr"><<a href="mailto:dirk@proactive.nl" target="_blank">dirk@proactive.nl</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi
All,<br>
<br>
I'm currently testing a OCFS2 set-up, and I'm
having issues with<br>
creating backups.<br>
<br>
I have a 2 node cluster, running OCFS2 on a dual
primary DRBD device.<br>
<br>
The file system is 3.7Tb of which 211 Gb is used:
about 1.5 million<br>
files in 95 directories.<br>
<br>
Everything works fine, except for the backups,
which are taking way more<br>
time than on 'regular' file systems.<br>
<br>
I'm using rsync for my backups. When I rsync the
file system above, this<br>
takes more than an hour, without any modifications
to the file system.<br>
<br>
Network / disk speed is good. I can rsync a 10 Gb
file from the OCFS2<br>
filesystem to the same backup server with just
under 100 Mb/s.<br>
<br>
I know there is some penalty to be expected from a
clustered file<br>
system, but this is al lot. Rsyncing an ext3 file
system double the size<br>
(in Mb's and files) of this file system takes
about 600 seconds...<br>
<br>
Has anybody some advice on a backup strategy for
me? Or some tuning tips?<br>
<br>
Thanks in advance,<br>
<br>
Dirk<br>
<br>
--<br>
<<a href="http://www.proactive.nl" target="_blank">http://www.proactive.nl</a>><br>
T 023 - 5422299<br>
F 023 - 5422728<br>
<br>
<a href="http://www.proactive.nl" target="_blank">www.proactive.nl</a>
<<a href="http://www.proactive.nl" target="_blank">http://www.proactive.nl</a>><br>
<br>
<br>
<br>
_______________________________________________<br>
Ocfs2-users mailing list<br>
<a href="mailto:Ocfs2-users@oss.oracle.com" target="_blank">Ocfs2-users@oss.oracle.com</a><br>
<a href="http://oss.oracle.com/mailman/listinfo/ocfs2-users" target="_blank">http://oss.oracle.com/mailman/listinfo/ocfs2-users</a><br>
</blockquote>
</div>
<br>
</blockquote>
<br>
</div>
</div>
<div><span><font color="#888888">-- <br>
<a href="http://www.proactive.nl" target="_blank"><img alt="" src="cid:part14.06000403.00020304@proactive.nl" border="0" height="105" width="84"></a></font></span>
<div><br>
<table cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td width="20">T</td>
<td>023 - 5422299</td>
</tr>
<tr>
<td>F</td>
<td>023 - 5422728</td>
</tr>
<tr>
<td colspan="2"> </td>
</tr>
<tr>
<td colspan="2"><a href="http://www.proactive.nl" target="_blank">www.proactive.nl</a></td>
</tr>
</tbody>
</table>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</blockquote>
</div></div></div>
</blockquote></div><br>